Databricks administration with Lakebase experience

Role: Databricks administration with Lakebase experience

Location: REMOTE

Duration: Long-term/Fulltime

Roles and responsibilities:

|—|
| |
| |

Databricks administration with Lakebase experience involves managing Postgres-compatible OLTP databases integrated directly into the Databricks Lakehouse. Key administrative responsibilities include creating and managing Lakebase database instances, setting up user permissions (especially with Unity Catalog integration), configuring high availability and data recovery, and ensuring seamless synchronization between Lakebase and Delta Lake tables for both operational and analytical workloads.

Key Responsibilities

Instance Management:

Create and administer Lakebase database instances, which are managed serverless Postgres databases within the Databricks platform.

Permission and Governance:

Implement access controls and manage permissions, leveraging Unity Catalog to govern operational data just as it does for analytical data.

High Availability and Recovery:

Configure features like multi-zone high availability and point-in-time recovery for Lakebase instances to ensure data resilience.

Data Synchronization:

Manage the two-way sync between Lakebase and Delta Lake tables, allowing for consistent data flow between operational and analytical systems.

Application Integration:

Support developers by enabling the integration of Lakebase database instances as resources for Databricks Apps, facilitating operational and AI/ML workflows.

Monitoring and Performance:

Monitor Lakebase instance performance, ensuring sub-10 ms query latency and handling high transaction volumes