Connect to Data: Index
Core skills
- How to choose which DataConnector to use
- How to configure an InferredAssetDataConnector
- How to configure a ConfiguredAssetDataConnector
- How to configure a RuntimeDataConnector
- How to configure a DataConnector to introspect and partition a file system or blob store
- How to configure a DataConnector to introspect and partition tables in SQL
- How to create a Batch of data from an in-memory Spark or Pandas dataframe or path
- How to get one or more Batches of data from a configured Datasource
In memory
- How to connect to in-memory data in a Pandas dataframe
- How to connect to in-memory data in a Spark dataframe
Database
- How to connect to a Athena database
- How to connect to a BigQuery database
- How to connect to an MSSQL database
- How to connect to a MySQL database
- How to connect to a PostgreSQL database
- How to connect to a Redshift database
- How to connect to a Snowflake database
- How to connect to a SQLite database
- How to connect to a Trino database (formerly Presto SQL)
Filesystem
- How to connect to data on a filesystem using Pandas
- How to connect to data on a filesystem using Spark
Cloud
- How to connect to data on S3 using Pandas
- How to connect to data on S3 using Spark
- How to connect to data on GCS using Pandas
- How to connect to data on GCS using Spark
- How to connect to data on Azure Blob Storage using Pandas
- How to connect to data on Azure Blob Storage using Spark