The CData JDBC Driver for Spark implements JDBC standards that enable third-party tools to interoperate, from wizards in IDEs to business intelligence tools. This article shows how to connect to Spark data with wizards in DBeaver and browse data in the DBeaver GUI.
Databases are logically modelled clusters of information, or data. A database management system (DBMS), on the other hand, is a computer program that interacts with a database. A DBMS allows you to control access to a database, write data, run queries, and perform any other tasks related to database management. This tutorial shows you how to get started with CrateDB and DBeaver, a free, open-source tool for developers and database administrators. DBeaver not showing dbmsoutput. View primary key in DBeaver. Dbeaver: can't find database in navigator.
Create a JDBC Data Source for Spark Data
Follow the steps below to load the driver JAR in DBeaver.
- Open the DBeaver application and, in the Databases menu, select the Driver Manager option. Click New to open the Create New Driver form.
- In the Driver Name box, enter a user-friendly name for the driver.
- To add the .jar, click Add File.
- In the create new driver dialog that appears, select the cdata.jdbc.sparksql.jar file, located in the lib subfolder of the installation directory.
- Click the Find Class button and select the SparkSQLDriver class from the results. This will automatically fill the Class Name field at the top of the form. The class name for the driver is cdata.jdbc.sparksql.SparkSQLDriver.
- Add jdbc:sparksql: in the URL Template field.
Create a Connection to Spark Data
Follow the steps below to add credentials and other required connection properties.
- In the Databases menu, click New Connection.
- In the Create new connection wizard that results, select the driver.
- On the next page of the wizard, click the driver properties tab.
Enter values for authentication credentials and other properties required to connect to Spark.
Set the Server, Database, User, and Password connection properties to connect to SparkSQL.
Built-in Connection String Designer
For assistance in constructing the JDBC URL, use the connection string designer built into the Spark JDBC Driver. Either double-click the JAR file or execute the jar file from the command-line.
java -jar cdata.jdbc.sparksql.jarFill in the connection properties and copy the connection string to the clipboard.
Below is a typical connection string:
jdbc:sparksql:Server=127.0.0.1;
Query Spark Data
You can now query information from the tables exposed by the connection: Right-click a Table and then click Edit Table. The data is available on the Data tab.
6 просмотра
1 ответ
8459 Репутация автора
Недавно я получил новый MacBook Pro для работы, и я перенес много настроек со своей старой машины. Я надеялся, что есть способ экспортировать конфигурацию / свойства соединения из моей старой машины, а не проходить процесс воссоздания каждого из них.
Кто-нибудь знает как это сделать? Версия dbeaver на моей старой машине — 6.0.3, а версия на моей новой машине — 6.1.x
Comments
Copy link Quote reply
ced75 commented Nov 21, 2016 •
I’m testing the new DBeaver release 8.0 on Linux Mint 17.3.
When I try the new 'Backup database' tool, I have a message on top of the 'Database backup' window displaying: 'Client home is not specified for connection'.
So, I edit my connection. There, I suppose the client home can be defined with 'Local Client' combobox.
I clic on 'Browse. ', then on 'Add home' and I select the repository where my local PostgreSQL binaries are on my computer.
When I validate, nothing appears in the window. The fields ID, Path, Name, etc. can not be filled in.
I have the same problem in the PostgreSQL driver interface.
Comments
Copy link Quote reply
MrBrax commented Feb 28, 2017 •
You really gotta specify what this means in the export database window, i have no idea what to set, and no idea what it’s about either.
I can’t export it because of this (i think).
This comment has been minimized.
Copy link Quote reply
serge-rider commented Feb 28, 2017
Native client home can be set in connection properties (first page).
This comment has been minimized.
Copy link Quote reply
MrBrax commented Feb 28, 2017
This comment has been minimized.
Copy link Quote reply
serge-rider commented Feb 28, 2017
'Local client' combo. It is empty if there is no native client installed on your machine (or DBeaver can’t find it).
You can specify path where mysqldump resides manually (Browse->Add home).
This comment has been minimized.
Dbeaver Not Showing Databases Yahoo
Copy link Quote reply
MrBrax commented Feb 28, 2017 •
That’s a really weird workflow, why do i need all that? Why can’t i just select a filename and it would dump it there?
Now i gotta find that ‘mysqldump.exe’ too.
edit: i can’t even find a simple download for it, this is not very good design
This comment has been minimized.
Copy link Quote reply
serge-rider commented Feb 28, 2017
Because this is native mysql tool. It is different for every MySQL version and every platform.
And this is extended functionality.
If you don’t have MySQL client (or you don’t want to bother with this stuff) then you can use data export (which doesn’t require any native tools).
This comment has been minimized.
Copy link Quote reply
MrBrax commented Feb 28, 2017
I guess I’m too used to other MySQL tools then, which have it built in.
This IS my MySQL client, I can change data and create databases etc. The only way to get that mysqldump.exe as far as i can see, is downloading a 350MB zip file from oracle.
This comment has been minimized.
Copy link Quote reply
serge-rider commented Feb 28, 2017
Some MySQL UI clients may have builtin mysqldump, mysqlrestore, mysql.exe + set of libraries of some particular MySQL client version.
But DBeaver definitely not one of such clients.
On Windows you can install MySQL Workbench (it includes all command line tools). DBeaver will find it automatically.
On Linux you can use something like apt-get install mysql-client
This comment has been minimized.
Copy link Quote reply
MrBrax commented Feb 28, 2017
. i’ll just use one of the other tools for exporting
This comment has been minimized.
Copy link Quote reply
serge-rider commented Feb 28, 2017
Sure.
DBeaver dump/restore functions are for lazy people who want to use one client for all tasks. And who don’t like MySQL Workbench.
This comment has been minimized.
Copy link Quote reply
javirebu commented Apr 21, 2017
i use phpmyadmin on xampp from the beggining and now dbeaver for mongo mysql. etc, so XAMPP/mysql/bin has all mysql command line executables. And i like to import a 400mb sql dump, and update my development copy. it is very usefull to import a sql dump. maybe dbeaver should include this command line files.
Im using xampp/mysql and is working perfectly
This comment has been minimized.
Dbeaver Not Showing Databases Using
Copy link Quote reply
serge-rider commented Apr 22, 2017
Well, this looks wrong.
- You should set home to c:xamppmysql — not to bin folder.
- When you click on home in the left panel there should be some information about it in the right panel. Otherwise this is some bug and I’ll need error/debug logs (https://github.com/serge-rider/dbeaver/wiki/Log-files)
This comment has been minimized.
Copy link Quote reply
This comment has been minimized.
Copy link Quote reply
javirebu commented Apr 24, 2017
Serge c:xamppmysql works fine too. Intead of this folder does not contain mysql executables 👍
This comment has been minimized.
Copy link Quote reply
paulbrzeski commented Aug 30, 2017
This issue is still valid — I found this thread because of the error.
Can you guys please fix the error message? Just put something useful in there like 'error: mysqldump missing, please fix in config'
This comment has been minimized.
Copy link Quote reply
serge-rider commented Aug 30, 2017
Yep, there was a bug in MySQL binaries location detection. See fix in the next version
This comment has been minimized.
Copy link Quote reply
vveettil commented Sep 1, 2017
downloaded MySQL 5.6.37 macos version and attached to dbeaver (3.8.4) db connection local client path. mysqldump is working fine.
This comment has been minimized.
Copy link Quote reply
sandorspruit commented Oct 26, 2017 •
I just installed DBeaver 4.2.3 and I still see this issue. Must be something I am missing, but what? Update: quick workaround is to add a symlink in mysql home folder, e.g. ln -s /usr/local/mysql mysql. Then select ‘mysql’ in home folder as the MySQL home.
This comment has been minimized.
Copy link Quote reply
This comment has been minimized.
Copy link Quote reply
alesanfer commented Oct 28, 2017
I followed this steps on the Mac:
1- find the mysql path install
2 — Open Edit connection settings and click on Browse on Local Client
3 — After that click in add home button then use the Command+Shift+G for open the prompt for input the Mysql path location.
Done, its works fine for me!
This comment has been minimized.
Copy link Quote reply
BornToDrink commented Apr 3, 2018
A local mysql client is needed and by default is not selected in connection properties.
So on Linux Mint I did the same as @alesanfer said: just selected '/usr' in 'Local Client' row and it works good.
This comment has been minimized.
Copy link Quote reply
ztl8702 commented Apr 7, 2018 •
Can confirm that on Windows installing MySQL Workbench solves the issue. Less stuff to install than MySQL Server.
This comment has been minimized.
Copy link Quote reply
chriszrc commented Apr 17, 2018
Yeah, similarly for postgres, you hit 'Browse' for local client, and put in the path where the pgdump/restore executables live on your system. If you’re using Postgres.app, it’s:
This comment has been minimized.
Copy link Quote reply
GeeeCoin commented Apr 25, 2018
Why is a local client necessary? I’m connected to my database remotely and just need a path to store my dump file. Is there a reason I need one locally?
This comment has been minimized.
Copy link Quote reply
chriszrc commented Apr 25, 2018
@GeeeCoin afaik, you could of course ssh to your remote db server and use the export tools on that machine, but typically, if the goal is to create the backup file on your local machine, then you would use the tools on your own machine and point it at the remote db.
Even though you’re 'connected' to your remote db, the import/export tools are usually separate from what’s exposed directly over the db connection-
This comment has been minimized.
Copy link Quote reply
GeeeCoin commented Apr 25, 2018 •
@chriszrc thanks for the quick reply, that makes total sense. My line of thinking was: dbeaver (which is great) already is that toolset which is calling on the remote db, so why not already have that functionality? Perhaps it has to do with the lowest common denominator design of dbeaver to accommodate all SQL types.
This comment has been minimized.
Copy link Quote reply
serge-rider commented Apr 28, 2018
After all I’m thinking about inclusion of native tools (pg_dump/pg_restore and mysql/mysqldump) into DBeaver distribution. Some DB clients do this, we also could try. Thus we won’t need this native client configurations at all.
However this will require to include at least 3 versions of these binaries (Windows/Linux/MacOS).
This comment has been minimized.
Copy link Quote reply
serge-rider commented Apr 28, 2018
And this is more than 10Mb of binaries just for one OS.
Combined it is close to full DBeaver CE distribution size 🙁
But can be solved with automatic binaries download from DBeaver website. While EE may include them by default. Need to think about that.
Please vote if you think this makes sense..
This comment has been minimized.
Copy link Quote reply
p91paul commented Apr 29, 2018
automatic download (more or less what happens with db drivers) seems a good way. Power users should be left the option to don’t download them and just use the ones they already have installed.
This comment has been minimized.
Copy link Quote reply
jesstelford commented May 10, 2018 •
To get dbeaver data export working on OSX with PostgreSQL, I followed these steps:
Find the PostgreSQL install path
If you used homebrew to install postgresql:
If you installed via the installer package, the location is:
Add the location to the database config
Right click the top-level connection in the 'Database Navi' pane (on the left), and select 'Edit Connection'
Click the empty drop-down next to 'Local Client', then click 'Browse' from within the dropdown.
In the popup, click 'Add Home', which will show a file-selector prompt.
Press Command+Shift+G , then paste in the PostgreSQL install path.
Export / Backup
Expand the top-level connection in the 'Database Navi' pane (on the left), then right click on the database name you want to export/backup.
Select Tools > Backup.
In the popup, select at least one item from the 'Objects' section, then the individual items you want to export from the second section.
Click 'Next' (not 'Start') to select the directory to save to, by editing the 'Output folder' option.
No related posts.