Skip to content

Create pg_catalog wrapper for DataFusion catalog structure #14

Open

Description

@returnString

We should support a minimal subset of Postgres' system metadata tables for automatic introspection in IDEs and data vis tooling.

Activity

  1. magick93 commented on Feb 25, 2023

    @magick93

    This would be very helpful.

    I'm trying to connect to https://github.com/roapi/roapi using postgres fdw but am unable to due to not having a pg_catalog and lack of a postgres user.

  2. returnString commented on Feb 25, 2023

    @returnString
    OwnerAuthor

    I had a branch a while back where I started investigating this in the context of getting this working for IDEs like DataGrip, but ran into a lot of stumbling blocks in terms of parsing some of the (frankly insane 😅) queries that these tools use to inspect metadata.

    Haven't had a lot of time lately to work on this project, but potentially a good starting point for anyone who wants to pick up this work.

    Edit: Also, that basic approach might be enough for something like an FDW - it's not something I've tested.

  3. returnString commented on Mar 27, 2023

    @returnString
    OwnerAuthor

    Revived and merged the pgcatalog branch (see here).

    @magick93 lemme know if there's more metadata required for your use-case - it's pretty barebones atm, but it's a start :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions