Senior Software Engineer, Data Platform (San Francisco) Job at Jobright.ai, San Francisco, CA

bDBSVWVvUEhlNldDa3lmTHQxZHY1QnpUU0E9PQ==
  • Jobright.ai
  • San Francisco, CA

Job Description

Join to apply for the Senior Software Engineer, Data Platform role at Jobright.ai

3 days ago Be among the first 25 applicants

Join to apply for the Senior Software Engineer, Data Platform role at Jobright.ai

Parafin is dedicated to supporting small businesses by providing them with essential financial tools through innovative technology. The Senior Software Engineer for the Data Platform will lead the development of a reliable and scalable data infrastructure, collaborating with various teams to enhance data-driven decision-making and product development.

Responsibilities:

Design and build robust, highly scalable data pipelines and lakehouse infrastructure with PySpark, Databricks, and Airflow on AWS.

Improve the data platform development experience for Engineering, Data Science, and Product by creating intuitive abstractions, selfservice tooling, and clear documentation.

Own and maintain core data pipelines and models that power internal dashboards, ML models, and customer-facing products.

Own the Data & ML platform infrastructure using Terraform, including endtoend administration of Databricks workspaces: manage user access, monitor performance, optimize configurations (e.g., clusters, lakehouse settings), and ensure high availability of data pipelines.

Lead projects to improve data quality, testing, observability, and cost efficiency across existing pipelines and backend systems (e.g., migrating Databricks SQL pipelines to dbt, scaling data ingestion, improving data-lineage tracking, and enhancing monitoring).

Work closely with backend engineers and data scientists to design performant data models and support new product development initiatives.

Share best practices and mentor other engineers working on data-centric systems.

Qualifications:

Required:

4+ years of experience in software engineering with a strong background in data infrastructure, pipelines, and distributed systems.

Advanced proficiency in Python and SQL.

Expertise with modern cloud data stacksAWS (S3, RDS), Databricks, and Airflowand lakehouse architectures.

Hands-on experience with foundational data-infrastructure technologies such as Hadoop, Hive, Kafka (or similar streaming platforms), Delta Lake/Iceberg, and distributed query engines like Trino/Presto.

Familiarity with ingestion frameworks, developer-experience tooling, and best practices for data versioning, lineage, partitioning, and clustering.

Strong problem-solving skills and a proactive attitude toward ownership and platform health.

Excellent communication and collaboration skills, especially in cross-functional settings.

Preferred:

Experience with AWS infrastructure using Terraform.

Familiarity with observability tools (e.g., Datadog) and cost tracking in cloud environments.

Experience with financial systems or building platforms in a fintech setting.

Prior work on ML infrastructure: Feature stores (e.g., Tecton), ML model lifecycle (training, deployment, monitoring, retraining), real-time inference.

Contributions to internal tooling or open-source projects in the data ecosystem.

Company:

Parafin is a financial infrastructure company that offers pre-built financial services programs to support small businesses. Founded in 2020, the company is headquartered in San Francisco, California, USA, with a team of 51-200 employees. The company is currently Growth Stage. Parafin has a track record of offering H1B sponsorships.

Seniority level

  • Seniority level

    Mid-Senior level

Employment type

  • Employment type

    Full-time

Job function

  • Industries

    Software Development

Referrals increase your chances of interviewing at Jobright.ai by 2x

Inferred from the description for this job

Medical insurance

Vision insurance

401(k)

Get notified about new Software Engineer jobs in San Francisco, CA .

San Francisco, CA $160,000.00-$180,000.00 2 weeks ago

San Francisco, CA $130,000.00-$238,000.00 2 weeks ago

San Francisco, CA $150,000.00-$250,000.00 2 weeks ago

Full-Stack Software Engineer (Jr/Mid level)

San Francisco, CA $120,000.00-$180,000.00 1 month ago

San Francisco, CA $150,000.00-$230,000.00 3 months ago

Software Development Engineer I - Frontend & Mobile

San Francisco, CA $150,000.00-$176,000.00 3 months ago

San Francisco, CA $120,000.00-$190,000.00 9 months ago

San Francisco, CA $57.00-$61.00 2 days ago

San Francisco, CA $57.00-$61.00 2 days ago

San Francisco, CA $125,000.00-$175,000.00 2 months ago

San Francisco, CA $163,200.00-$223,200.00 2 weeks ago

Software Engineer, Frontend (All Levels)

San Francisco, CA $150,000.00-$180,000.00 5 days ago

Software Engineer, AI Intern (Winter 2026)

San Francisco, CA $57.00-$61.00 2 days ago

Software Engineer, AI Intern (Summer 2026)

San Francisco, CA $57.00-$61.00 2 days ago

San Francisco, CA $165,000.00-$165,000.00 2 years ago

San Francisco, CA $120,000.00-$200,000.00 2 years ago

Alameda, CA $130,000.00-$160,000.00 2 months ago

San Francisco, CA $140,000.00-$280,000.00 8 months ago

Were unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

Job Tags

Full time, Summer work, H1b,

Similar Jobs

Headway

LMHC (Remote) Job at Headway

 ...LMHC (Remote) at Headway summary: A Licensed Mental Health Counselor (LMHC) providing therapeutic services through a remote private...  ...payment stability, and client access to affordable mental health care. Licensed Mental Health Counselor (LMHC) Wage: Between $95-... 

INTEGR8STAFF LLC

Airline Cargo Truck Dispatcher (Weekend Only) Job at INTEGR8STAFF LLC

Job Title: Airline Cargo Truck DispatcherLocation: Hawthorne, CA (Near LAX)Work Type: On-Site, Full-Time (Weekend Only)Compensation: $26.00/hour (DOE - Depending on Experience)NOTE: The schedule for this position is Weekends Only, Saturday and Sunday from 6am to 2:... 

Yexgo

Remote Data Entry Clerk - Work From Home Job at Yexgo

 ...passion for precision and thrive in independent work environments, this opportunity might be...  ...and strong computer skills.Excellent typing speed and accuracy.Strong attention to...  ...in data entry from the comfort of your own home, don't hesitate to apply today and become... 

Lakeland Regional Health

Hospital at Home Physician Job at Lakeland Regional Health

 ...inpatient and outpatient healthcare in 40 specialties. LRH has achieved multiple workplace awards from highly reputable names, including Aetna, Forbes, and the Florida Hospital Association. LRH is a 900-bed academic state-of-the-art teaching facility and operates as a... 

University of Massachusetts Boston

Professor- (Gerontology) Job at University of Massachusetts Boston

 ...students in their research. Applicants must have an earned doctoral degree in one of the following fields: gerontology, nursing, sociology, psychology, demography, economics, social work, public health, or an interdisciplinary program. Applicants with terminal degrees...