Black markets (sparkles and data leaks in general)

This forum is the ideal place for all discussion relating to X4. You will also find additional information from developers here.

Moderator: Moderators for English X Forum

Malloy_at
Posts: 11
Joined: Mon, 19. Aug 24, 11:30

Black markets (sparkles and data leaks in general)

Post by Malloy_at »

Ok, I've logged 100+ hours now, and slowly getting a grib of the game, one part frustrates me more than others. Black markets, or the myth of them :)

I've spend several hours now looking over stations in several sectors, I've kept an eye out for smugglers/criminals, no connection. I've tried having the scanner running for 2 of those stations. no luck.

Watched alot of Youtube guides to black market, no luck there. Finding the sparkel (or anything seems to be the problem now)

I dont know what to do now. I have no idea what is going on, and lately I actually noticed that im not getting ANY sparkles or data leaks on stations atm.

Running Young gun, just started doing research (Boron quest).

Also side question, does an installation need to be of a certain size to have sparkles/data leaks? Can they pop up on say, a one unit energy factory, or does it need to have habitation, a pier, something else?

Thanks in advance
Alan Phipps
Moderator (English)
Moderator (English)
Posts: 31834
Joined: Fri, 16. Apr 04, 19:21
x4

Re: Black markets (sparkles and data leaks in general)

Post by Alan Phipps »

Leaks can be on any module (sometimes more than one on a module) and may be either type of signal or data leak. Fly around stations with the purple HUD scan mode (Shift-2) on and when you get close enough to a leak you will start to hear something and also see a waveform strength indication in the HUD, even before you can see the regular flash, sparkles or red pulsing glow. Their appearance is random but does not change much until you go OOS/low attention to the station for some time.

There is no connection with nearby smugglers/pirates/illegal drones.
A dog has a master; a cat has domestic staff.
Malloy_at
Posts: 11
Joined: Mon, 19. Aug 24, 11:30

Re: Black markets (sparkles and data leaks in general)

Post by Malloy_at »

Thank you for your prompt reply!

I've done 2 stations with purm scan running non-stop, nothing. Not even data leaks. Im my first 'test game' (ran 10h before I got a hang of basic things and realized I screw up) I found lots of data leaks, now nothing. I've started the Boron quest line as mentioned, so I've found THAT sparkle, but nothing since, and thats wierding me out :)
Alan Phipps
Moderator (English)
Moderator (English)
Posts: 31834
Joined: Fri, 16. Apr 04, 19:21
x4

Re: Black markets (sparkles and data leaks in general)

Post by Alan Phipps »

You will find lots of leaks on Boron stations (worrying given that their stations are often filled with water :D ) when you get that far into the plot - including many of the shady mission ones that unlock the bar for black market traders. Most of the Boron stations in my game now have that shady symbol on their icons (vanilla). :wink:

I have occasionally seen other 'no leaks' threads here, but many turned out to be due to game corruption or mods. The rest stayed a mystery.
A dog has a master; a cat has domestic staff.
Malloy_at
Posts: 11
Joined: Mon, 19. Aug 24, 11:30

Re: Black markets (sparkles and data leaks in general)

Post by Malloy_at »

No mods here, clean game :)

I've searched for 2h this morning, I've found a total of one data leak. I'll try to advance the Boron quest and see if that'll help. thanks again for feedback!
User avatar
Duncaroos
Posts: 719
Joined: Wed, 4. Jan 12, 22:23
x4

Re: Black markets (sparkles and data leaks in general)

Post by Duncaroos »

The location of black marketeers is fixed in the seed of the game, so although random between games it is fixed. A station always has a black marketeers if it is set as such, it is just whether or not the player has "activated" them.

This tool reads your save file and gives you an idea on the concentration of black marketeers in your universe. You can go down to the station level if you wish, but not necessary...this helps with it being too cheat-y by only viewing the # of them in a sector and not specific locations.

viewtopic.php?t=463804
Playing X4+All_DLC on:
CPU: Ryzen 5 5600X; RAM: 4x8GB DDR4 3200MHz; GPU: GTX 1070 8GB, Driver v536.23, DirectX 12.0; OS: Win10 Home 22H2 (19045.4780); Monitor: Single Acer S232HL 1920x1080

Duncaroo's Empire Logistics Tool (v0.23 Beta) - {{Vanilla Economy - Direct link}} {{Economy Overhaul Mod Version - Direct link}}
Malloy_at
Posts: 11
Joined: Mon, 19. Aug 24, 11:30

Re: Black markets (sparkles and data leaks in general)

Post by Malloy_at »

Wow, thank you so much!

I'll try it out, step by step to see if I have any success! :)
zakaluka
Posts: 599
Joined: Sat, 16. Nov 13, 19:47
x4

Re: Black markets (sparkles and data leaks in general)

Post by zakaluka »

THERE IS A BUG that has been assigned a reference number (that means it's confirmed)

viewtopic.php?p=5237234#p5237234

This seems to affect some people a lot more than others for unknown reasons.

Sometimes when the initialization scripts for a new universe run, an error causes the scripts for core sectors (specifically) to stop creating shadyguys much too early. These are sectors owned by TEL ARG ANT HAT PAR and HOP, specifically.

If your save isn't affected by the bug, around 2/3 of any given faction's stations have black markets. With all DLC enabled the entire save should have around 800 shadyguys. In a bugged save with all DLC you might have only around 300 shadyguys.

To see if your save is affected, use one of the tools. I found this python script here that doesn't spoil much. I use this one because I don't want hints about where they're located. Someone else gave you the UI tool which will show you in a readable format where to find them.

Check your save. If you're affected, gonna have to start over or move to a region that has black markets. There might be another workaround that could force scripts to run in the correct order, see the linked thread for details.
H34Dru5H
Posts: 146
Joined: Sat, 18. Feb 06, 03:49
x4

Re: Black markets (sparkles and data leaks in general)

Post by H34Dru5H »

Alan Phipps wrote: Wed, 4. Sep 24, 11:51 Leaks can be on any module (sometimes more than one on a module) and may be either type of signal or data leak. Fly around stations with the purple HUD scan mode (Shift-2) on and when you get close enough to a leak you will start to hear something and also see a waveform strength indication in the HUD, even before you can see the regular flash, sparkles or red pulsing glow. Their appearance is random but does not change much until you go OOS/low attention to the station for some time.

There is no connection with nearby smugglers/pirates/illegal drones.
This! I have recently become an expert in detecting 'sparkles' as you so elegantly put it, while trying to get my rep restored with FAF. The 'waveform strength indication in the HUD' is your best tool (Shift+2), just fly around the station until it appears and follow it until it becomes bigger and you will start to see which direction it is (waveform becomes bigger left or right), before you know it, you will be right next to it, and hear it. If there are no data leaks around the stations you are searching, leave the sector for a while and when you return, new data leaks will have spawned. I have found Black Marketeers in nearly every FRF station in the north east sectors while looking for FAF missions.
B450 Tomahawk Max II, Ryzen 5600X, RTX2070S, 16GB 3600 CL14
zakaluka
Posts: 599
Joined: Sat, 16. Nov 13, 19:47
x4

Re: Black markets (sparkles and data leaks in general)

Post by zakaluka »

also if you back up a good 10km, the normal object & animation with sparkles may disappear but you will also notice these very bright flashes. The flashing happens from pretty far away and shows you where to look.

The flash animation also plays a kind of subdued, short buzzing sound. You can hear it even if the waveform on your scanner is pretty faint.

So there are all these different visual and audio indicators that you can use together.
vvvvvvvv
Posts: 1376
Joined: Tue, 28. Nov 23, 15:38
x4

Re: Black markets (sparkles and data leaks in general)

Post by vvvvvvvv »

Malloy_at wrote: Wed, 4. Sep 24, 11:32 Ok, I've logged 100+ hours now, and slowly getting a grib of the game, one part frustrates me more than others. Black markets, or the myth of them :)

I've spend several hours now looking over stations in several sectors, I've kept an eye out for smugglers/criminals, no connection. I've tried having the scanner running for 2 of those stations. no luck.

Watched alot of Youtube guides to black market, no luck there. Finding the sparkel (or anything seems to be the problem now)

I dont know what to do now. I have no idea what is going on, and lately I actually noticed that im not getting ANY sparkles or data leaks on stations atm.

Running Young gun, just started doing research (Boron quest).

Also side question, does an installation need to be of a certain size to have sparkles/data leaks? Can they pop up on say, a one unit energy factory, or does it need to have habitation, a pier, something else?

Thanks in advance
There is a bug where the game occasionally fails to spawn black market sector upon start of the new game:

viewtopic.php?t=463823

However. Even when this bug is under effect, most stations will have leaks when you approach them. You can find leaks through hearing, and make sure you have leak visual indicator turned on in accessibility otpions.

Leak is a "sparkly" sounds like a pile of electric sounds that repeats. If you hear it, the leak is nearby, then you aim at the sound. Then you can tilt ship 90 degrees to the side aim again, slowly move forward, and you'll find the leak. It is not a whole lot of fun.
zakaluka wrote: Thu, 5. Sep 24, 21:52 THERE IS A BUG that has been assigned a reference number (that means it's confirmed)

viewtopic.php?p=5237234#p5237234

This seems to affect some people a lot more than others for unknown reasons.
There's another tool for finding black market called shady-search on github. I think if that one fails to process a save and complains about "cluster_black_sector01_macro", the save has that bug.
db48x
Posts: 107
Joined: Mon, 15. Jul 13, 06:25
x4

Re: Black markets (sparkles and data leaks in general)

Post by db48x »

Malloy_at wrote: Wed, 4. Sep 24, 11:32 […] lately I actually noticed that im not getting ANY sparkles or data leaks on stations atm.
Be aware also that if you have low rep with a faction then their stations won’t have many leaks at all. Most leaks are only useful if you can dock, so below −10 they mostly disappear.

That said, finding them is a skill that you need to practice. As others have mentioned, the local scanner mode gives you a HUD indicator that helps guide you towards leaks. Sound is also a useful guide, especially if you have a good surround–sound setup. If you use headphones then you might consider turning on OpenAL’s HRTF support for better spatialization. The bright flashes can be seen and heard from much further away than the other effects, so using those to find the leaks is useful. Visually the leaks are also quite distinctive, and can often be seen from quite far away. Of course your view of them can also be obstructed by the station itself, so sound is often your best guide. Just don’t ask where the sound is actually coming from. It should also go without saying that finding them is easier in a small, nimble scout than in a large lumbering freighter.

There are never more than eight leaks on any station, four yellow and four red. Red leaks only give discounts and/or commissions, so when looking for black marketeers they are a distraction. Go ahead and scan them, however, as it will eliminate the sound from the leak and help you track down the others. Plus, who doesn’t like a nice discount?

The yellow leaks always give missions. These are almost always from criminals or from a faction that is at war with the owner of the station. If the station has a black marketeer, then one of these yellow leaks will always give you the Lucrative Offer mission that introduces you to them. If you find all the leaks on a station and none of them were for the Lucrative offer mission, then the station simply doesn’t have a black marketeer. Something like 70−90% of all normal stations should have a black marketeer, but stations that sell illegal goods (spaceweed, spacefuel, maja dust, or stimulants) will never have one. And it goes without saying that Xenon stations never have one.

The bug others have mentioned is very real. Any save that is affected will have black marketeers only in sectors added by a DLC; the core sectors will have none, or very few. So if you can't find any in a core sector, and your rep is not too low, and the sector isn’t neutral, then go to a DLC‌ sector and try again.
RainerPrem
Posts: 4612
Joined: Wed, 18. Jan 06, 07:39
x4

Re: Black markets (sparkles and data leaks in general)

Post by RainerPrem »

db48x wrote: Fri, 6. Sep 24, 22:14
Malloy_at wrote: Wed, 4. Sep 24, 11:32 […] lately I actually noticed that im not getting ANY sparkles or data leaks on stations atm.
Be aware also that if you have low rep with a faction then their stations won’t have many leaks at all. Most leaks are only useful if you can dock, so below −10 they mostly disappear.
I don't think this is correct. After the Split plot supporting ZYA I was at -30 with the Cabal. Even when their stations were firing at me, there were data leaks.
Alan Phipps
Moderator (English)
Moderator (English)
Posts: 31834
Joined: Fri, 16. Apr 04, 19:21
x4

Re: Black markets (sparkles and data leaks in general)

Post by Alan Phipps »

Yes the leaks are still there even with hostile stations. Where, I think, rep makes a difference is with data leaks; having negative rep with the station makes it less likely (if even possible at all) for you to get module blueprints that you don't own but have researched from scanning those data leaks.
A dog has a master; a cat has domestic staff.

Return to “X4: Foundations”