Write to jdbc/database

[0x0ece]

Hi, possibly related to #3, could you provide a hint on where to start to write a jdbc output?
Ideally I'd like to read from a streaming source, do some computation, and write in a db instead of TextIO.

I have a running dataflow pipeline (with output via TextIO), and I saw examples on Flink's DataSet to write to a database via jdbc. I feel I'm close, but I need a hint on how to connect the dots, e.g. how to extract a dataset from a (streaming) pipeline?

Thank you much, E.

[mxm]

Hi @ecesena! There is a pending issue #6 to integrate sinks into the streaming support. We plan to add it very soon. We would provide you with the generic interface Write.Bound to implement your own sinks. Like for the sources, a wrapper for Flink's sinks will be introduced such that you can reuse the existing sinks (e.g. JDBC, RollingFileSink, Kafka, ..).

[0x0ece]

Thanks @mxm, in the meantime I hacked a Kafka sink, then it's relatively easy to push from there into any db. Do you have already a rough timeline by chance?

[mxm]

Sorry for the late reply, we'll add support very soon in Apache Beam.