Sr. Data Engineer (San Francisco)

Company: Craft.co
Location: San Francisco
Posted on: May 3, 2025

Job Description:

About Craft:Craft is the leader in supplier risk intelligence, enabling enterprises to discover, evaluate, and continuously monitor their suppliers at scale. Our unique, proprietary data platform tracks real-time signals on millions of companies globally, delivering best-in-class monitoring and insight into global supply chains. Our customers include Fortune 500 companies, government agencies, SMEs, and global service platforms. Through our configurable Software-as-a-Service portal, our customers can monitor any company they work with and execute critical actions in real-time. We've developed distribution partnerships with some of the largest integrators and software platforms globally.We are a post-Series B high-growth technology company backed by top-tier investors in Silicon Valley and Europe, headquartered in San Francisco with hubs in Seattle and London. We support remote and hybrid work, with team members across North America, Canada, and Europe.We're looking for innovative and driven people passionate about building the future of Enterprise Intelligence to join our growing team!About the Role:Craft is looking for an experienced and motivated senior-level Data Engineer to join one of our teams responsible for a key product within the organization. As a core member of this team you will have a great say in how solutions are engineered and delivered. Craft gives engineers a lot of responsibility and authority, which is matched by our investment in their growth and development.We're growing quickly and looking to hire data engineers for multiple teams. We're always looking for folks with strong data engineering experience, Python coding experience, Pandas expertise, and solid software engineering practices. In addition to those skills, we're looking for two different categories of data engineers. If you feel that your experience aligns with one or both of the categories below, we have a place for you!

• Someone who has experience with data lakes and data warehousing, graph databases and knowledge graphs
• Someone who has experience with streaming and batching of data from data partners and building data pipelines for transactional use, as well as experience with API development, FastAPI, and asyncio.We're looking for someone who is open to a hybrid work schedule and is available to come into our San Francisco office roughly three days per week. Due to this, we're only able to consider individuals located in San Francisco, CA for this specific role.What You'll Do:

• Building and optimizing data pipelines (batch and streaming).
• Extracting, analyzing and modeling rich and diverse datasets of structured and unstructured data.
• Designing software that is easily testable and maintainable.
• Support in setting data strategies and our vision.
• Keep track of emerging technologies and trends in the Data Engineering world, incorporating modern tooling and best practices at Craft.
• Work on extendable data processing systems that allows to add and scale pipelines.
• Applying machine learning techniques such as anomaly detection, clustering, regression classification, and summarization to extract value from our data sets.Who You Are:
  • 4+ years of experience in Data Engineering.
  • 4+ years of experience with Python.
  • Experience in developing, maintaining, and ensuring the reliability, scalability, fault tolerance, and observability of data pipelines in a production environment.
  • Strong knowledge of SDLC and solid software engineering practices.
  • Knowledge and experience with Amazon Web Services (AWS) and Databricks (nice to have).
  • Demonstrated curiosity through asking questions, digging into new technologies, and always trying to grow.
  • Strong problem solving and the ability to communicate ideas effectively.
  • Familiar with infrastructure-as-code approach.
  • Self-starter, independent, likes to take initiative.
  • Have fundamental knowledge of data engineering techniques: ETL/ELT, batch and streaming, DWH, Data Lakes, distributed processing.
  • Familiarity with at least some technologies in our current tech stack:
    • Python, PySpark, Pandas, SQL (PostgreSQL), ElasticSearch, Airflow, Docker
    • Databricks, AWS (S3, Batch, Athena, RDS, DynamoDB, Glue, ECS, Amazon Neptune)
    • CircleCI, GitHub, TerraformWhat We Offer:
      • Competitive salary starting at $190,000 USD/ year. This starting number can be increased based on levels of expertise, location, cost of living, taxes, market experience, etc.
      • Equity at a well-funded, fast-growing startup
      • Unlimited vacation time so you can take what you need, when you need it
      • 99% covered health + dental + vision insurance for employees and dependents
      • 401K through Empower with options to invest how you want itA Note to Candidates:We are an equal opportunity employer who values and encourages diversity, equity and belonging at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, caste, or disability status.Don't meet every requirement? Studies have shown that women, communities of color and historically underrepresented talent are less likely to apply to jobs unless they meet every single qualification. At Craft, we are dedicated to building a diverse, inclusive and authentic workplace, so if you're excited about this role but your past experience doesn't align perfectly with every qualification in the job description, we strongly encourage you to apply. You may be just the right candidate for this or other roles!
        #J-18808-Ljbffr

Keywords: Craft.co, West Sacramento , Sr. Data Engineer (San Francisco), Engineering , San Francisco, California