Jun 07 16:02:22.489146 ip-10-0-130-133 systemd[1]: Starting Kubernetes Kubelet... Jun 07 16:02:22.845596 ip-10-0-130-133 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 16:02:22.845596 ip-10-0-130-133 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 07 16:02:22.845596 ip-10-0-130-133 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 16:02:22.845596 ip-10-0-130-133 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 07 16:02:22.845596 ip-10-0-130-133 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 16:02:22.847725 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.847627 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 07 16:02:22.852107 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852087 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:02:22.852107 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852108 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:02:22.852185 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852112 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:02:22.852185 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852115 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:02:22.852185 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852117 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:02:22.852185 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852120 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:02:22.852185 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852123 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:02:22.852185 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852125 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:02:22.852185 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852128 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:02:22.852185 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852130 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:02:22.852185 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852133 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:02:22.852185 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852136 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:02:22.852185 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852138 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:02:22.852185 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852141 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:02:22.852185 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852145 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:02:22.852185 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852148 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:02:22.852185 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852151 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:02:22.852185 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852154 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:02:22.852185 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852158 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:02:22.852185 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852161 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:02:22.852185 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852163 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:02:22.852185 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852165 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:02:22.852654 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852168 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:02:22.852654 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852171 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:02:22.852654 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852174 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:02:22.852654 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852176 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:02:22.852654 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852179 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:02:22.852654 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852183 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:02:22.852654 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852187 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:02:22.852654 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852191 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:02:22.852654 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852193 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:02:22.852654 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852198 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:02:22.852654 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852201 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:02:22.852654 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852205 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:02:22.852654 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852208 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:02:22.852654 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852210 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:02:22.852654 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852214 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:02:22.852654 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852221 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:02:22.852654 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852225 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:02:22.852654 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852227 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:02:22.852654 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852230 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:02:22.853114 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852233 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:02:22.853114 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852235 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:02:22.853114 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852238 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:02:22.853114 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852240 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:02:22.853114 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852243 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:02:22.853114 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852247 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:02:22.853114 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852250 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:02:22.853114 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852253 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:02:22.853114 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852255 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:02:22.853114 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852258 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:02:22.853114 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852260 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:02:22.853114 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852263 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:02:22.853114 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852265 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:02:22.853114 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852271 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:02:22.853114 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852275 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:02:22.853114 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852278 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:02:22.853114 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852281 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:02:22.853114 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852283 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:02:22.853114 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852286 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:02:22.853114 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852289 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:02:22.853600 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852291 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:02:22.853600 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852294 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:02:22.853600 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852296 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:02:22.853600 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852299 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:02:22.853600 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852301 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:02:22.853600 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852304 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:02:22.853600 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852307 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:02:22.853600 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852309 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:02:22.853600 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852312 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:02:22.853600 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852315 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:02:22.853600 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852318 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:02:22.853600 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852320 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:02:22.853600 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852323 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:02:22.853600 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852325 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:02:22.853600 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852328 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:02:22.853600 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852330 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:02:22.853600 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852333 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:02:22.853600 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852335 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:02:22.853600 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852338 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:02:22.853600 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852340 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:02:22.854318 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852342 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:02:22.854318 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852345 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:02:22.854318 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852348 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:02:22.854318 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852350 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:02:22.854318 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852353 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:02:22.854318 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852355 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:02:22.854318 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852359 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:02:22.854318 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852362 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:02:22.854318 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852364 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:02:22.854318 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852367 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:02:22.854318 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852370 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:02:22.854318 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852372 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:02:22.854318 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852375 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:02:22.854318 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852379 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:02:22.854318 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852381 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:02:22.854318 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852384 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:02:22.854318 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852387 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:02:22.854318 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.852389 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:02:22.855036 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.854992 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:02:22.855036 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855013 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:02:22.855036 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855018 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:02:22.855036 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855024 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:02:22.855036 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855029 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:02:22.855036 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855034 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:02:22.855036 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855039 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:02:22.855036 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855043 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:02:22.855383 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855047 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:02:22.855383 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855051 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:02:22.855383 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855056 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:02:22.855383 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855061 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:02:22.855383 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855065 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:02:22.855383 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855069 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:02:22.855383 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855074 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:02:22.855383 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855078 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:02:22.855383 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855082 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:02:22.855383 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855087 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:02:22.855383 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855091 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:02:22.855383 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855095 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:02:22.855383 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855099 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:02:22.855383 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855103 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:02:22.855383 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855108 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:02:22.855383 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855115 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:02:22.855383 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855121 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:02:22.855383 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855125 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:02:22.855383 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855129 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:02:22.855383 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855136 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:02:22.856282 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855141 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:02:22.856282 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855145 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:02:22.856282 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855149 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:02:22.856282 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855153 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:02:22.856282 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855162 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:02:22.856282 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855166 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:02:22.856282 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855170 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:02:22.856282 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855174 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:02:22.856282 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855178 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:02:22.856282 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855183 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:02:22.856282 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855187 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:02:22.856282 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855193 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:02:22.856282 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855198 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:02:22.856282 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855203 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:02:22.856282 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855208 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:02:22.856282 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855212 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:02:22.856282 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855217 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:02:22.856282 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855221 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:02:22.856282 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855225 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:02:22.857253 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855230 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:02:22.857253 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855234 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:02:22.857253 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855238 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:02:22.857253 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855243 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:02:22.857253 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855247 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:02:22.857253 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855251 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:02:22.857253 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855255 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:02:22.857253 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855259 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:02:22.857253 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855263 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:02:22.857253 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855267 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:02:22.857253 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855271 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:02:22.857253 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855276 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:02:22.857253 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855280 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:02:22.857253 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855284 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:02:22.857253 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855289 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:02:22.857253 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855293 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:02:22.857253 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855297 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:02:22.857253 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855304 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:02:22.857253 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855311 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:02:22.857253 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855316 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:02:22.858140 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855321 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:02:22.858140 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855325 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:02:22.858140 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855333 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:02:22.858140 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855338 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:02:22.858140 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855342 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:02:22.858140 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855347 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:02:22.858140 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855352 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:02:22.858140 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855357 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:02:22.858140 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855361 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:02:22.858140 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855365 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:02:22.858140 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855370 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:02:22.858140 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855374 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:02:22.858140 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855378 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:02:22.858140 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855382 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:02:22.858140 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855386 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:02:22.858140 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855390 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:02:22.858140 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855407 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:02:22.858140 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855412 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:02:22.858140 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855416 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:02:22.858140 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855420 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:02:22.858779 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855425 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:02:22.858779 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855430 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:02:22.858779 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855434 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:02:22.858779 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855438 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:02:22.858779 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855442 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:02:22.858779 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855446 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:02:22.858779 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855450 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:02:22.858779 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855454 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:02:22.858779 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855459 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:02:22.858779 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855463 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:02:22.858779 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855467 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:02:22.858779 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.855471 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:02:22.858779 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856159 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:02:22.858779 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856169 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:02:22.858779 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856174 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:02:22.858779 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856178 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:02:22.858779 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856183 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:02:22.858779 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856187 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:02:22.858779 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856193 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:02:22.858779 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856200 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:02:22.859357 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856206 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:02:22.859357 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856211 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:02:22.859357 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856216 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:02:22.859357 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856220 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:02:22.859357 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856225 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:02:22.859357 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856229 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:02:22.859357 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856233 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:02:22.859357 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856237 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:02:22.859357 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856250 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:02:22.859357 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856255 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:02:22.859357 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856259 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:02:22.859357 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856263 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:02:22.859357 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856267 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:02:22.859357 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856271 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:02:22.859357 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856275 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:02:22.859357 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856280 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:02:22.859357 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856283 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:02:22.859357 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856287 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:02:22.859357 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856296 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:02:22.859357 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856300 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:02:22.860100 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856304 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:02:22.860100 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856308 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:02:22.860100 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856313 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:02:22.860100 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856317 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:02:22.860100 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856322 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:02:22.860100 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856327 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:02:22.860100 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856332 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:02:22.860100 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856336 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:02:22.860100 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856340 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:02:22.860100 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856344 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:02:22.860100 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856348 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:02:22.860100 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856352 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:02:22.860100 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856356 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:02:22.860100 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856360 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:02:22.860100 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856365 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:02:22.860100 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856369 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:02:22.860100 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856373 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:02:22.860100 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856377 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:02:22.860100 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856381 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:02:22.860577 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856385 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:02:22.860577 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856389 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:02:22.860577 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856404 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:02:22.860577 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856410 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:02:22.860577 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856414 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:02:22.860577 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856418 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:02:22.860577 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856423 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:02:22.860577 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856427 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:02:22.860577 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856431 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:02:22.860577 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856435 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:02:22.860577 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856439 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:02:22.860577 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856443 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:02:22.860577 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856447 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:02:22.860577 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856451 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:02:22.860577 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856456 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:02:22.860577 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856461 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:02:22.860577 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856466 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:02:22.860577 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856470 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:02:22.860577 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856474 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:02:22.860577 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856480 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:02:22.861149 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856485 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:02:22.861149 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856490 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:02:22.861149 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856493 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:02:22.861149 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856497 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:02:22.861149 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856501 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:02:22.861149 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856505 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:02:22.861149 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856509 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:02:22.861149 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856513 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:02:22.861149 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856517 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:02:22.861149 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856521 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:02:22.861149 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856525 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:02:22.861149 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856528 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:02:22.861149 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856533 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:02:22.861149 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856536 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:02:22.861149 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856540 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:02:22.861149 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856552 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:02:22.861149 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856556 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:02:22.861149 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856561 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:02:22.861149 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856565 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:02:22.861149 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856569 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:02:22.861669 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856573 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:02:22.861669 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856577 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:02:22.861669 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856581 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:02:22.861669 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856585 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:02:22.861669 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856590 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:02:22.861669 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856593 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:02:22.861669 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856597 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:02:22.861669 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856602 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:02:22.861669 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856607 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:02:22.861669 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856611 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:02:22.861669 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856616 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:02:22.861669 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.856620 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:02:22.861669 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856734 2579 flags.go:64] FLAG: --address="0.0.0.0" Jun 07 16:02:22.861669 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856746 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 07 16:02:22.861669 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856790 2579 flags.go:64] FLAG: --anonymous-auth="true" Jun 07 16:02:22.861669 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856797 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 07 16:02:22.861669 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856804 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 07 16:02:22.861669 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856809 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 07 16:02:22.861669 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856816 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 07 16:02:22.861669 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856823 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 07 16:02:22.861669 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856827 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856834 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856840 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856845 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856850 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856855 2579 flags.go:64] FLAG: --cgroup-root="" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856860 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856864 2579 flags.go:64] FLAG: --client-ca-file="" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856878 2579 flags.go:64] FLAG: --cloud-provider="external" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856884 2579 flags.go:64] FLAG: --cluster-dns="[]" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856895 2579 flags.go:64] FLAG: --cluster-domain="" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856900 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856905 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856910 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856915 2579 flags.go:64] FLAG: --container-log-max-files="5" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856922 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856927 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856932 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856937 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856942 2579 flags.go:64] FLAG: --contention-profiling="false" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856947 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856951 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856956 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856960 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 07 16:02:22.862212 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856968 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856972 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856977 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856982 2579 flags.go:64] FLAG: --enable-load-reader="false" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856987 2579 flags.go:64] FLAG: --enable-server="true" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.856991 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857001 2579 flags.go:64] FLAG: --event-burst="100" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857006 2579 flags.go:64] FLAG: --event-qps="50" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857011 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857016 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857020 2579 flags.go:64] FLAG: --eviction-hard="" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857027 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857031 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857036 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857040 2579 flags.go:64] FLAG: --eviction-soft="" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857045 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857049 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857062 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857067 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857072 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857077 2579 flags.go:64] FLAG: --fail-swap-on="true" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857081 2579 flags.go:64] FLAG: --feature-gates="" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857087 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857093 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857098 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 07 16:02:22.862815 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857103 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857108 2579 flags.go:64] FLAG: --healthz-port="10248" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857113 2579 flags.go:64] FLAG: --help="false" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857118 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-130-133.ec2.internal" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857123 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857128 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857132 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857138 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857144 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857149 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857154 2579 flags.go:64] FLAG: --image-service-endpoint="" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857158 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857163 2579 flags.go:64] FLAG: --kube-api-burst="100" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857168 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857173 2579 flags.go:64] FLAG: --kube-api-qps="50" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857177 2579 flags.go:64] FLAG: --kube-reserved="" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857183 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857188 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857193 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857197 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857202 2579 flags.go:64] FLAG: --lock-file="" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857206 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857211 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857216 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 07 16:02:22.863455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857225 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857238 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857243 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857248 2579 flags.go:64] FLAG: --logging-format="text" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857252 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857257 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857264 2579 flags.go:64] FLAG: --manifest-url="" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857269 2579 flags.go:64] FLAG: --manifest-url-header="" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857275 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857280 2579 flags.go:64] FLAG: --max-open-files="1000000" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857287 2579 flags.go:64] FLAG: --max-pods="110" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857292 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857297 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857301 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857306 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857312 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857316 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857321 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857333 2579 flags.go:64] FLAG: --node-status-max-images="50" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857339 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857343 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857348 2579 flags.go:64] FLAG: --pod-cidr="" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857353 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857361 2579 flags.go:64] FLAG: --pod-manifest-path="" Jun 07 16:02:22.864066 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857366 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857371 2579 flags.go:64] FLAG: --pods-per-core="0" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857375 2579 flags.go:64] FLAG: --port="10250" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857380 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857385 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f63942a7665aabe1" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857391 2579 flags.go:64] FLAG: --qos-reserved="" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857395 2579 flags.go:64] FLAG: --read-only-port="10255" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857400 2579 flags.go:64] FLAG: --register-node="true" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857405 2579 flags.go:64] FLAG: --register-with-taints="" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857410 2579 flags.go:64] FLAG: --registry-burst="10" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857424 2579 flags.go:64] FLAG: --registry-qps="5" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857429 2579 flags.go:64] FLAG: --reserved-cpus="" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857434 2579 flags.go:64] FLAG: --reserved-memory="" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857440 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857445 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857452 2579 flags.go:64] FLAG: --rotate-certificates="false" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857457 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857462 2579 flags.go:64] FLAG: --runonce="false" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857467 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857478 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857483 2579 flags.go:64] FLAG: --seccomp-default="false" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857488 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857492 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857497 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857502 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857507 2579 flags.go:64] FLAG: --storage-driver-password="root" Jun 07 16:02:22.864727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857512 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857516 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857521 2579 flags.go:64] FLAG: --storage-driver-user="root" Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857525 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857530 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857535 2579 flags.go:64] FLAG: --system-cgroups="" Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857539 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857548 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857553 2579 flags.go:64] FLAG: --tls-cert-file="" Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857557 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857568 2579 flags.go:64] FLAG: --tls-min-version="" Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857574 2579 flags.go:64] FLAG: --tls-private-key-file="" Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857579 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857583 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857588 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857593 2579 flags.go:64] FLAG: --v="2" Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857599 2579 flags.go:64] FLAG: --version="false" Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857613 2579 flags.go:64] FLAG: --vmodule="" Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857619 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.857625 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857867 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857878 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857882 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857887 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:02:22.865424 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857891 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:02:22.866027 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857897 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:02:22.866027 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857901 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:02:22.866027 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857906 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:02:22.866027 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857910 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:02:22.866027 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857914 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:02:22.866027 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857918 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:02:22.866027 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857925 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:02:22.866027 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857930 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:02:22.866027 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857936 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:02:22.866027 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857940 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:02:22.866027 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857945 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:02:22.866027 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857949 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:02:22.866027 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857953 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:02:22.866027 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857958 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:02:22.866027 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857962 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:02:22.866027 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857966 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:02:22.866027 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857970 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:02:22.866027 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857974 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:02:22.866027 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857980 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:02:22.866027 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857985 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:02:22.866545 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857989 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:02:22.866545 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857993 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:02:22.866545 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.857997 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:02:22.866545 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858002 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:02:22.866545 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858006 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:02:22.866545 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858018 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:02:22.866545 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858023 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:02:22.866545 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858027 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:02:22.866545 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858034 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:02:22.866545 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858038 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:02:22.866545 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858042 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:02:22.866545 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858046 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:02:22.866545 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858050 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:02:22.866545 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858054 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:02:22.866545 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858058 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:02:22.866545 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858063 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:02:22.866545 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858067 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:02:22.866545 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858071 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:02:22.866545 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858076 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:02:22.866545 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858080 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:02:22.867074 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858084 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:02:22.867074 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858088 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:02:22.867074 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858092 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:02:22.867074 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858096 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:02:22.867074 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858100 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:02:22.867074 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858104 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:02:22.867074 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858109 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:02:22.867074 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858113 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:02:22.867074 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858118 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:02:22.867074 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858121 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:02:22.867074 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858128 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:02:22.867074 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858132 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:02:22.867074 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858136 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:02:22.867074 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858139 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:02:22.867074 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858144 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:02:22.867074 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858147 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:02:22.867074 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858151 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:02:22.867074 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858155 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:02:22.867074 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858167 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:02:22.867074 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858171 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:02:22.867556 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858177 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:02:22.867556 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858181 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:02:22.867556 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858186 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:02:22.867556 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858192 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:02:22.867556 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858198 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:02:22.867556 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858203 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:02:22.867556 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858207 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:02:22.867556 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858213 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:02:22.867556 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858219 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:02:22.867556 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858225 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:02:22.867556 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858230 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:02:22.867556 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858235 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:02:22.867556 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858240 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:02:22.867556 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858244 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:02:22.867556 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858248 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:02:22.867556 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858252 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:02:22.867556 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858256 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:02:22.867556 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858260 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:02:22.867556 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858264 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:02:22.867556 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858269 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:02:22.868054 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858273 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:02:22.868054 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858277 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:02:22.868054 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858284 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:02:22.868054 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858288 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:02:22.868054 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858292 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:02:22.868054 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858297 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:02:22.868054 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858301 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:02:22.868054 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858305 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:02:22.868054 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858309 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:02:22.868054 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858313 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:02:22.868054 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858318 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:02:22.868054 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858332 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:02:22.868054 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858339 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:02:22.868054 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.858343 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:02:22.868054 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.858816 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 16:02:22.868427 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.865811 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 07 16:02:22.868427 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.865827 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 07 16:02:22.868427 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.865851 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 07 16:02:22.868427 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.865858 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 07 16:02:22.868427 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865922 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:02:22.868427 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865928 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:02:22.868427 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865932 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:02:22.868427 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865936 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:02:22.868427 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865939 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:02:22.868427 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865942 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:02:22.868427 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865944 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:02:22.868427 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865948 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:02:22.868427 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865953 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:02:22.868427 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865955 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:02:22.868427 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865958 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:02:22.868427 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865961 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:02:22.868427 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865963 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:02:22.868427 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865966 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:02:22.868427 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865968 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:02:22.868900 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865971 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:02:22.868900 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865974 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:02:22.868900 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865977 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:02:22.868900 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865979 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:02:22.868900 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865982 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:02:22.868900 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865984 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:02:22.868900 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865987 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:02:22.868900 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865990 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:02:22.868900 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865993 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:02:22.868900 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865996 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:02:22.868900 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.865998 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:02:22.868900 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866001 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:02:22.868900 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866004 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:02:22.868900 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866007 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:02:22.868900 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866012 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:02:22.868900 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866015 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:02:22.868900 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866019 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:02:22.868900 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866022 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:02:22.868900 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866025 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:02:22.868900 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866028 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:02:22.869385 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866031 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:02:22.869385 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866034 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:02:22.869385 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866037 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:02:22.869385 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866039 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:02:22.869385 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866042 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:02:22.869385 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866045 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:02:22.869385 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866048 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:02:22.869385 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866050 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:02:22.869385 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866053 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:02:22.869385 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866055 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:02:22.869385 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866058 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:02:22.869385 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866060 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:02:22.869385 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866063 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:02:22.869385 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866067 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:02:22.869385 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866070 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:02:22.869385 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866073 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:02:22.869385 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866076 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:02:22.869385 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866078 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:02:22.869385 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866081 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:02:22.869958 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866084 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:02:22.869958 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866086 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:02:22.869958 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866089 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:02:22.869958 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866091 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:02:22.869958 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866093 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:02:22.869958 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866096 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:02:22.869958 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866098 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:02:22.869958 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866102 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:02:22.869958 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866106 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:02:22.869958 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866108 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:02:22.869958 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866111 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:02:22.869958 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866113 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:02:22.869958 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866116 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:02:22.869958 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866118 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:02:22.869958 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866121 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:02:22.869958 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866123 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:02:22.869958 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866126 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:02:22.869958 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866128 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:02:22.869958 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866131 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:02:22.869958 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866133 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:02:22.870449 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866136 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:02:22.870449 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866138 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:02:22.870449 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866141 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:02:22.870449 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866143 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:02:22.870449 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866145 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:02:22.870449 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866148 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:02:22.870449 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866150 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:02:22.870449 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866153 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:02:22.870449 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866155 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:02:22.870449 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866157 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:02:22.870449 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866160 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:02:22.870449 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866162 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:02:22.870449 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866165 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:02:22.870449 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866167 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:02:22.870449 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866170 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:02:22.870449 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866172 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:02:22.870449 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866174 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:02:22.870449 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866177 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:02:22.870449 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866179 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:02:22.870449 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866184 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:02:22.870950 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866186 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:02:22.870950 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866189 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:02:22.870950 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866192 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:02:22.870950 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866194 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:02:22.870950 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866197 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:02:22.870950 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.866202 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 16:02:22.870950 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866328 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:02:22.870950 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866334 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:02:22.870950 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866337 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:02:22.870950 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866340 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:02:22.870950 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866343 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:02:22.870950 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866346 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:02:22.870950 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866349 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:02:22.870950 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866353 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:02:22.870950 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866356 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:02:22.871325 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866359 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:02:22.871325 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866362 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:02:22.871325 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866365 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:02:22.871325 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866367 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:02:22.871325 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866370 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:02:22.871325 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866372 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:02:22.871325 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866375 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:02:22.871325 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866377 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:02:22.871325 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866380 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:02:22.871325 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866382 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:02:22.871325 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866384 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:02:22.871325 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866387 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:02:22.871325 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866389 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:02:22.871325 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866392 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:02:22.871325 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866394 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:02:22.871325 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866397 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:02:22.871325 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866399 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:02:22.871325 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866402 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:02:22.871325 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866404 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:02:22.871325 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866407 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:02:22.871832 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866410 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:02:22.871832 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866413 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:02:22.871832 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866415 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:02:22.871832 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866417 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:02:22.871832 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866420 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:02:22.871832 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866422 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:02:22.871832 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866425 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:02:22.871832 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866427 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:02:22.871832 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866429 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:02:22.871832 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866432 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:02:22.871832 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866434 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:02:22.871832 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866437 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:02:22.871832 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866439 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:02:22.871832 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866442 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:02:22.871832 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866444 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:02:22.871832 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866447 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:02:22.871832 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866449 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:02:22.871832 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866452 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:02:22.871832 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866454 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:02:22.871832 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866456 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:02:22.872336 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866459 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:02:22.872336 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866461 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:02:22.872336 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866464 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:02:22.872336 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866466 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:02:22.872336 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866468 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:02:22.872336 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866471 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:02:22.872336 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866473 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:02:22.872336 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866476 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:02:22.872336 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866479 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:02:22.872336 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866481 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:02:22.872336 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866484 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:02:22.872336 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866486 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:02:22.872336 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866489 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:02:22.872336 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866493 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:02:22.872336 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866497 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:02:22.872336 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866500 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:02:22.872336 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866503 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:02:22.872336 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866505 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:02:22.872336 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866508 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:02:22.872336 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866510 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:02:22.872837 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866513 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:02:22.872837 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866515 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:02:22.872837 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866518 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:02:22.872837 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866520 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:02:22.872837 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866523 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:02:22.872837 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866525 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:02:22.872837 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866527 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:02:22.872837 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866530 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:02:22.872837 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866532 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:02:22.872837 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866535 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:02:22.872837 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866539 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:02:22.872837 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866542 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:02:22.872837 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866545 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:02:22.872837 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866548 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:02:22.872837 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866551 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:02:22.872837 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866554 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:02:22.872837 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866557 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:02:22.872837 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866560 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:02:22.872837 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866563 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:02:22.873287 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866566 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:02:22.873287 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866569 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:02:22.873287 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866571 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:02:22.873287 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866574 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:02:22.873287 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866576 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:02:22.873287 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866579 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:02:22.873287 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866585 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:02:22.873287 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866589 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:02:22.873287 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866592 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:02:22.873287 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866594 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:02:22.873287 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:22.866597 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:02:22.873287 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.866602 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 16:02:22.873287 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.866775 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jun 07 16:02:22.873287 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.869851 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 07 16:02:22.873629 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.870984 2579 server.go:1019] "Starting client certificate rotation" Jun 07 16:02:22.873629 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.871103 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 07 16:02:22.873629 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.871153 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 07 16:02:22.873629 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.873080 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 07 16:02:22.874917 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.874749 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 07 16:02:22.884916 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.884899 2579 log.go:25] "Validated CRI v1 runtime API" Jun 07 16:02:22.889247 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.888990 2579 log.go:25] "Validated CRI v1 image API" Jun 07 16:02:22.890972 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.890953 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 07 16:02:22.893046 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.893027 2579 fs.go:135] Filesystem UUIDs: map[06dbb454-d474-4bf1-8ca0-1df0d89157cb:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8ab958c9-7690-4e0e-aab4-ac334de2b85d:/dev/nvme0n1p4] Jun 07 16:02:22.893110 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.893046 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 07 16:02:22.898811 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.898665 2579 manager.go:216] Machine: {Timestamp:2026-06-07 16:02:22.896831046 +0000 UTC m=+0.294767980 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097288 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f228edb96c411ba3a1ddcf1aa5a49 SystemUUID:ec2f228e-db96-c411-ba3a-1ddcf1aa5a49 BootID:0ecf1f13-65e2-4933-9988-e01c0ae73ce0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:95:86:97:a7:37 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:95:86:97:a7:37 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:9c:59:d2:6e:88 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 07 16:02:22.898811 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.898794 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 07 16:02:22.898953 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.898886 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 07 16:02:22.900487 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.900468 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 07 16:02:22.901695 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.901667 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 07 16:02:22.901878 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.901699 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-133.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 07 16:02:22.902840 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.902829 2579 topology_manager.go:138] "Creating topology manager with none policy" Jun 07 16:02:22.902877 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.902842 2579 container_manager_linux.go:309] "Creating device plugin manager" Jun 07 16:02:22.902877 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.902851 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 07 16:02:22.903523 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.903513 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 07 16:02:22.904218 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.904208 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 07 16:02:22.907221 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.907210 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 07 16:02:22.907519 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.907509 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 07 16:02:22.907562 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.907542 2579 kubelet.go:486] "Attempting to sync node with API server" Jun 07 16:02:22.907562 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.907554 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 07 16:02:22.907631 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.907566 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 07 16:02:22.907631 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.907575 2579 kubelet.go:398] "Adding apiserver pod source" Jun 07 16:02:22.907631 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.907583 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 07 16:02:22.907987 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.907973 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 07 16:02:22.908160 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.908149 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 07 16:02:22.912560 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.912536 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 07 16:02:22.914627 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.914614 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 07 16:02:22.914687 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.914645 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 07 16:02:22.915625 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.915609 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 07 16:02:22.915683 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.915634 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 07 16:02:22.915683 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.915644 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 07 16:02:22.915683 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.915652 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 07 16:02:22.915683 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.915665 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 07 16:02:22.915683 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.915673 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 07 16:02:22.915828 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.915688 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 07 16:02:22.915828 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.915696 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 07 16:02:22.915828 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.915704 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 07 16:02:22.915828 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.915713 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 07 16:02:22.915828 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.915725 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 07 16:02:22.915828 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.915735 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 07 16:02:22.916986 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.916973 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 07 16:02:22.917020 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.916988 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 07 16:02:22.923078 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.923059 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-txv94" Jun 07 16:02:22.924425 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.924409 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-133.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 07 16:02:22.924831 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:22.924811 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 07 16:02:22.924870 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:22.924810 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 07 16:02:22.925820 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.925801 2579 server.go:1268] "Started kubelet" Jun 07 16:02:22.925950 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.925892 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 07 16:02:22.926009 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.925978 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 07 16:02:22.926118 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.926095 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 07 16:02:22.926857 ip-10-0-130-133 systemd[1]: Started Kubernetes Kubelet. Jun 07 16:02:22.927895 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.927796 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 07 16:02:22.928610 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.928596 2579 server.go:310] "Adding debug handlers to kubelet server" Jun 07 16:02:22.930135 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:22.929395 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-133.ec2.internal.18b6d7f35e00cf9a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-133.ec2.internal,UID:ip-10-0-130-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-133.ec2.internal,},FirstTimestamp:2026-06-07 16:02:22.925746074 +0000 UTC m=+0.323683007,LastTimestamp:2026-06-07 16:02:22.925746074 +0000 UTC m=+0.323683007,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-133.ec2.internal,}" Jun 07 16:02:22.930628 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.930614 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-txv94" Jun 07 16:02:22.932826 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:22.932800 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 07 16:02:22.934831 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.934813 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 07 16:02:22.934909 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.934808 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 07 16:02:22.935252 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:22.935179 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-133.ec2.internal\" not found" Jun 07 16:02:22.935399 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.935385 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 07 16:02:22.935480 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.935470 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 07 16:02:22.935649 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.935637 2579 reconstruct.go:97] "Volume reconstruction finished" Jun 07 16:02:22.935731 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.935722 2579 reconciler.go:29] "Reconciler: start to sync state" Jun 07 16:02:22.935956 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.935935 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 07 16:02:22.936722 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.936242 2579 factory.go:55] Registering systemd factory Jun 07 16:02:22.936722 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.936265 2579 factory.go:223] Registration of the systemd container factory successfully Jun 07 16:02:22.937913 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.937894 2579 factory.go:153] Registering CRI-O factory Jun 07 16:02:22.937913 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.937916 2579 factory.go:223] Registration of the crio container factory successfully Jun 07 16:02:22.938029 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.937967 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 07 16:02:22.938029 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.937993 2579 factory.go:103] Registering Raw factory Jun 07 16:02:22.938029 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.938009 2579 manager.go:1196] Started watching for new ooms in manager Jun 07 16:02:22.938417 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.938397 2579 manager.go:349] Starting recovery of all containers Jun 07 16:02:22.945426 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.945257 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:02:22.948157 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.948105 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 07 16:02:22.948998 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.948982 2579 manager.go:354] Recovery completed Jun 07 16:02:22.952000 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:22.951976 2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-133.ec2.internal\" not found" node="ip-10-0-130-133.ec2.internal" Jun 07 16:02:22.953278 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.953261 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:02:22.955353 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.955337 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:02:22.955423 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.955368 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:02:22.955423 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.955380 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:02:22.955882 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.955865 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 07 16:02:22.955882 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.955880 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 07 16:02:22.956011 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.955900 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 07 16:02:22.956011 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.955916 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:02:22.956581 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.956567 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:02:22.956637 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.956595 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:02:22.956637 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.956606 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:02:22.956970 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.956957 2579 policy_none.go:49] "None policy: Start" Jun 07 16:02:22.957028 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.956977 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 07 16:02:22.957028 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.956990 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 07 16:02:22.957924 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:22.957911 2579 policy_none.go:47] "Start" Jun 07 16:02:23.000979 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.000579 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 07 16:02:23.000979 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.000618 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 07 16:02:23.000979 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.000639 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jun 07 16:02:23.000979 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:23.000674 2579 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 07 16:02:23.001487 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.001473 2579 manager.go:337] "Starting Device Plugin manager" Jun 07 16:02:23.001579 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:23.001518 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 07 16:02:23.001579 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.001531 2579 server.go:87] "Starting device plugin registration server" Jun 07 16:02:23.001831 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.001819 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 07 16:02:23.001923 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.001833 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 07 16:02:23.002217 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.002026 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 07 16:02:23.002217 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.002106 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 07 16:02:23.002217 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.002115 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 07 16:02:23.002584 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:23.002564 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 07 16:02:23.002651 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:23.002608 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-133.ec2.internal\" not found" Jun 07 16:02:23.002687 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.002651 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:02:23.101234 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.101128 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-133.ec2.internal"] Jun 07 16:02:23.101234 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.101239 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:02:23.102565 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.102543 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:02:23.103265 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.103245 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:02:23.103397 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.103286 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:02:23.103397 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.103300 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:02:23.103397 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.103387 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:02:23.103536 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.103420 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:02:23.103536 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.103438 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:02:23.103536 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.103466 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-133.ec2.internal" Jun 07 16:02:23.104771 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.104739 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:02:23.104910 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.104896 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" Jun 07 16:02:23.104963 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.104925 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:02:23.105774 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.105735 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:02:23.105874 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.105779 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:02:23.105874 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.105738 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:02:23.105874 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.105795 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:02:23.105874 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.105812 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:02:23.105874 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.105823 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:02:23.106858 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.106842 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-133.ec2.internal" Jun 07 16:02:23.106945 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.106869 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:02:23.107475 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.107457 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:02:23.107564 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.107485 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:02:23.107564 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.107496 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:02:23.110851 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.110835 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-133.ec2.internal" Jun 07 16:02:23.110851 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:23.110853 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-133.ec2.internal\": node \"ip-10-0-130-133.ec2.internal\" not found" Jun 07 16:02:23.120323 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:23.120304 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-133.ec2.internal\" not found" node="ip-10-0-130-133.ec2.internal" Jun 07 16:02:23.123529 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:23.123508 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-133.ec2.internal\" not found" Jun 07 16:02:23.124263 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:23.124246 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-133.ec2.internal\" not found" node="ip-10-0-130-133.ec2.internal" Jun 07 16:02:23.224466 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:23.224429 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-133.ec2.internal\" not found" Jun 07 16:02:23.237832 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.237798 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/17d1772778b6e8d61f944dcb69222ce7-config\") pod \"kube-apiserver-proxy-ip-10-0-130-133.ec2.internal\" (UID: \"17d1772778b6e8d61f944dcb69222ce7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-133.ec2.internal" Jun 07 16:02:23.237936 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.237837 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fdf27da8f60994655d0d198c69001978-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal\" (UID: \"fdf27da8f60994655d0d198c69001978\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" Jun 07 16:02:23.237936 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.237860 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdf27da8f60994655d0d198c69001978-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal\" (UID: \"fdf27da8f60994655d0d198c69001978\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" Jun 07 16:02:23.324955 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:23.324912 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-133.ec2.internal\" not found" Jun 07 16:02:23.338238 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.338208 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/17d1772778b6e8d61f944dcb69222ce7-config\") pod \"kube-apiserver-proxy-ip-10-0-130-133.ec2.internal\" (UID: \"17d1772778b6e8d61f944dcb69222ce7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-133.ec2.internal" Jun 07 16:02:23.338336 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.338247 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fdf27da8f60994655d0d198c69001978-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal\" (UID: \"fdf27da8f60994655d0d198c69001978\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" Jun 07 16:02:23.338336 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.338271 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdf27da8f60994655d0d198c69001978-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal\" (UID: \"fdf27da8f60994655d0d198c69001978\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" Jun 07 16:02:23.338336 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.338326 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/17d1772778b6e8d61f944dcb69222ce7-config\") pod \"kube-apiserver-proxy-ip-10-0-130-133.ec2.internal\" (UID: \"17d1772778b6e8d61f944dcb69222ce7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-133.ec2.internal" Jun 07 16:02:23.338435 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.338328 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdf27da8f60994655d0d198c69001978-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal\" (UID: \"fdf27da8f60994655d0d198c69001978\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" Jun 07 16:02:23.338435 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.338330 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fdf27da8f60994655d0d198c69001978-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal\" (UID: \"fdf27da8f60994655d0d198c69001978\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" Jun 07 16:02:23.424698 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.424623 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" Jun 07 16:02:23.425715 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:23.425696 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-133.ec2.internal\" not found" Jun 07 16:02:23.428564 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.427463 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-133.ec2.internal" Jun 07 16:02:23.526181 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:23.526129 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-133.ec2.internal\" not found" Jun 07 16:02:23.626616 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:23.626577 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-133.ec2.internal\" not found" Jun 07 16:02:23.727195 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:23.727163 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-133.ec2.internal\" not found" Jun 07 16:02:23.827661 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:23.827624 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-133.ec2.internal\" not found" Jun 07 16:02:23.871132 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.871105 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 07 16:02:23.871578 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.871254 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 07 16:02:23.871578 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.871295 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 07 16:02:23.917017 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.916993 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:02:23.928000 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:23.927968 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-133.ec2.internal\" not found" Jun 07 16:02:23.936023 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.935971 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-06 15:57:22 +0000 UTC" deadline="2028-02-08 06:33:26.689876848 +0000 UTC" Jun 07 16:02:23.936023 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:23.936020 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14654h31m2.753859748s" Jun 07 16:02:24.028654 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:24.028585 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-133.ec2.internal\" not found" Jun 07 16:02:24.053286 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:24.053255 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdf27da8f60994655d0d198c69001978.slice/crio-0487418b8820c6398d0e38613cb5ff356d897ddcfb02ff496fe09922c4bb6eaf WatchSource:0}: Error finding container 0487418b8820c6398d0e38613cb5ff356d897ddcfb02ff496fe09922c4bb6eaf: Status 404 returned error can't find the container with id 0487418b8820c6398d0e38613cb5ff356d897ddcfb02ff496fe09922c4bb6eaf Jun 07 16:02:24.053707 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:24.053685 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17d1772778b6e8d61f944dcb69222ce7.slice/crio-a523ad889682c104f97e686aa458034441a72829d82f477b32166df056c7cc22 WatchSource:0}: Error finding container a523ad889682c104f97e686aa458034441a72829d82f477b32166df056c7cc22: Status 404 returned error can't find the container with id a523ad889682c104f97e686aa458034441a72829d82f477b32166df056c7cc22 Jun 07 16:02:24.060473 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.060457 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 16:02:24.129377 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:24.129340 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-133.ec2.internal\" not found" Jun 07 16:02:24.229898 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:24.229872 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-133.ec2.internal\" not found" Jun 07 16:02:24.267125 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.267105 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:02:24.336107 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.336040 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" Jun 07 16:02:24.347661 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.347643 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 07 16:02:24.348841 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.348826 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-133.ec2.internal" Jun 07 16:02:24.354414 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.354391 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 07 16:02:24.740284 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.740252 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:02:24.909080 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.909049 2579 apiserver.go:52] "Watching apiserver" Jun 07 16:02:24.914918 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.914897 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 07 16:02:24.915282 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.915259 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-wlrgs","openshift-multus/multus-additional-cni-plugins-hdls5","openshift-network-operator/iptables-alerter-gdjlh","openshift-ovn-kubernetes/ovnkube-node-826vv","kube-system/konnectivity-agent-mj7mp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp","openshift-dns/node-resolver-wfs76","openshift-image-registry/node-ca-sh4jr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal","openshift-multus/multus-4r4mr","openshift-multus/network-metrics-daemon-c9g56","openshift-network-diagnostics/network-check-target-jsqrs","kube-system/global-pull-secret-syncer-lg8vx","kube-system/kube-apiserver-proxy-ip-10-0-130-133.ec2.internal"] Jun 07 16:02:24.917771 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.917735 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wfs76" Jun 07 16:02:24.919972 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.919951 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 07 16:02:24.920171 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.920155 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pxff5\"" Jun 07 16:02:24.920254 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.920227 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:24.920324 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:24.920298 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg8vx" podUID="9885b2fd-1551-4bfc-9e75-18c6b4ff31aa" Jun 07 16:02:24.920380 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.920156 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 07 16:02:24.922231 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.922212 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gdjlh" Jun 07 16:02:24.924121 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.924102 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:02:24.924385 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.924366 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jwwmx\"" Jun 07 16:02:24.924668 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.924648 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 07 16:02:24.924878 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.924862 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 07 16:02:24.924963 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.924864 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:24.926728 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.926710 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4fn4f\"" Jun 07 16:02:24.926873 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.926854 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 07 16:02:24.930646 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.927921 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 07 16:02:24.930646 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.927937 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 07 16:02:24.930646 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.928380 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 07 16:02:24.930646 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.928673 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 07 16:02:24.930646 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.928860 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mj7mp" Jun 07 16:02:24.930646 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.929128 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 07 16:02:24.930930 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.930834 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 07 16:02:24.931003 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.930986 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qdpkw\"" Jun 07 16:02:24.931048 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.931005 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 07 16:02:24.932071 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.932037 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" Jun 07 16:02:24.933896 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.933871 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 07 16:02:24.933896 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.933898 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 07 16:02:24.934071 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.933992 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 07 16:02:24.934317 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.934300 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pzbl9\"" Jun 07 16:02:24.934560 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.934541 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sh4jr" Jun 07 16:02:24.935020 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.935004 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 07 16:02:24.936545 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.936404 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 07 16:02:24.936545 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.936495 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 07 16:02:24.936718 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.936691 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 07 16:02:24.936787 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.936728 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:24.936834 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.936810 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-btzl6\"" Jun 07 16:02:24.938515 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.938495 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vmpq4\"" Jun 07 16:02:24.938742 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.938706 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:02:24.939045 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.939023 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 07 16:02:24.939350 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.939332 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:24.941093 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.941074 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 07 16:02:24.941249 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.941227 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 07 16:02:24.941249 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.941234 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 07 16:02:24.941410 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.941375 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qlsqc\"" Jun 07 16:02:24.941608 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.941468 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 07 16:02:24.941608 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.941479 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4r4mr" Jun 07 16:02:24.941608 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.941509 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 07 16:02:24.943603 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.943490 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5hczk\"" Jun 07 16:02:24.943603 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.943502 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 07 16:02:24.944831 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.944808 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:24.944928 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:24.944902 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9g56" podUID="ec607386-1984-4a48-8b69-eb23b7525b9f" Jun 07 16:02:24.946124 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.946100 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 07 16:02:24.946204 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.946187 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:24.946258 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:24.946237 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsqrs" podUID="b9b1b9ac-e584-4249-aece-b6dc05d9bec6" Jun 07 16:02:24.948838 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.948817 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0c49c912-24d0-4c26-9a89-46f6e3cec1b2-agent-certs\") pod \"konnectivity-agent-mj7mp\" (UID: \"0c49c912-24d0-4c26-9a89-46f6e3cec1b2\") " pod="kube-system/konnectivity-agent-mj7mp" Jun 07 16:02:24.948935 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.948849 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-host\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:24.948935 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.948869 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-etc-sysctl-d\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:24.948935 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.948883 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f217cd29-4c36-4393-93b0-74f66d9c4b64-tmp\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:24.948935 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.948902 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-kubelet-config\") pod \"global-pull-secret-syncer-lg8vx\" (UID: \"9885b2fd-1551-4bfc-9e75-18c6b4ff31aa\") " pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:24.948935 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.948922 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-host-run-netns\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:24.949170 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.948937 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-run-ovn\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:24.949170 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.948972 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-log-socket\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:24.949170 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949001 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:24.949170 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949026 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ac34f759-ee32-402b-8ba7-b99a4983eb62-serviceca\") pod \"node-ca-sh4jr\" (UID: \"ac34f759-ee32-402b-8ba7-b99a4983eb62\") " pod="openshift-image-registry/node-ca-sh4jr" Jun 07 16:02:24.949170 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949050 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2gvk\" (UniqueName: \"kubernetes.io/projected/6a7766ae-5bce-436a-ba5d-40bf36fc0d7c-kube-api-access-n2gvk\") pod \"node-resolver-wfs76\" (UID: \"6a7766ae-5bce-436a-ba5d-40bf36fc0d7c\") " pod="openshift-dns/node-resolver-wfs76" Jun 07 16:02:24.949170 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949120 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7734bfb1-0434-4329-b54a-0069b78b45b1-ovn-node-metrics-cert\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:24.949170 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949141 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34644d4d-1eda-4b1c-a925-e246163f9252-registration-dir\") pod \"aws-ebs-csi-driver-node-xpkpp\" (UID: \"34644d4d-1eda-4b1c-a925-e246163f9252\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" Jun 07 16:02:24.949170 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34644d4d-1eda-4b1c-a925-e246163f9252-device-dir\") pod \"aws-ebs-csi-driver-node-xpkpp\" (UID: \"34644d4d-1eda-4b1c-a925-e246163f9252\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" Jun 07 16:02:24.949546 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a7766ae-5bce-436a-ba5d-40bf36fc0d7c-tmp-dir\") pod \"node-resolver-wfs76\" (UID: \"6a7766ae-5bce-436a-ba5d-40bf36fc0d7c\") " pod="openshift-dns/node-resolver-wfs76" Jun 07 16:02:24.949546 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949226 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/059fd790-5e62-46cf-912c-5770926fce96-host-slash\") pod \"iptables-alerter-gdjlh\" (UID: \"059fd790-5e62-46cf-912c-5770926fce96\") " pod="openshift-network-operator/iptables-alerter-gdjlh" Jun 07 16:02:24.949546 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949276 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-lib-modules\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:24.949546 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949306 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6a7766ae-5bce-436a-ba5d-40bf36fc0d7c-hosts-file\") pod \"node-resolver-wfs76\" (UID: \"6a7766ae-5bce-436a-ba5d-40bf36fc0d7c\") " pod="openshift-dns/node-resolver-wfs76" Jun 07 16:02:24.949546 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949330 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-host-slash\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:24.949546 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949351 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-node-log\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:24.949546 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949413 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34644d4d-1eda-4b1c-a925-e246163f9252-sys-fs\") pod \"aws-ebs-csi-driver-node-xpkpp\" (UID: \"34644d4d-1eda-4b1c-a925-e246163f9252\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" Jun 07 16:02:24.949546 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949459 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f217cd29-4c36-4393-93b0-74f66d9c4b64-etc-tuned\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:24.949546 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949485 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/059fd790-5e62-46cf-912c-5770926fce96-iptables-alerter-script\") pod \"iptables-alerter-gdjlh\" (UID: \"059fd790-5e62-46cf-912c-5770926fce96\") " pod="openshift-network-operator/iptables-alerter-gdjlh" Jun 07 16:02:24.949546 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949510 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-run-systemd\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:24.949546 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949525 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7734bfb1-0434-4329-b54a-0069b78b45b1-ovnkube-script-lib\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:24.949546 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949542 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8xgv\" (UniqueName: \"kubernetes.io/projected/7734bfb1-0434-4329-b54a-0069b78b45b1-kube-api-access-t8xgv\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:24.950005 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949577 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34644d4d-1eda-4b1c-a925-e246163f9252-socket-dir\") pod \"aws-ebs-csi-driver-node-xpkpp\" (UID: \"34644d4d-1eda-4b1c-a925-e246163f9252\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" Jun 07 16:02:24.950005 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949625 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-etc-systemd\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:24.950005 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949674 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34644d4d-1eda-4b1c-a925-e246163f9252-etc-selinux\") pod \"aws-ebs-csi-driver-node-xpkpp\" (UID: \"34644d4d-1eda-4b1c-a925-e246163f9252\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" Jun 07 16:02:24.950005 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949701 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-dbus\") pod \"global-pull-secret-syncer-lg8vx\" (UID: \"9885b2fd-1551-4bfc-9e75-18c6b4ff31aa\") " pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:24.950005 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949717 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-host-kubelet\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:24.950005 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949744 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crrpt\" (UniqueName: \"kubernetes.io/projected/059fd790-5e62-46cf-912c-5770926fce96-kube-api-access-crrpt\") pod \"iptables-alerter-gdjlh\" (UID: \"059fd790-5e62-46cf-912c-5770926fce96\") " pod="openshift-network-operator/iptables-alerter-gdjlh" Jun 07 16:02:24.950005 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949814 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-etc-kubernetes\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:24.950005 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949845 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-run\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:24.950005 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949870 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-sys\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:24.950005 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949892 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-systemd-units\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:24.950005 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949915 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret\") pod \"global-pull-secret-syncer-lg8vx\" (UID: \"9885b2fd-1551-4bfc-9e75-18c6b4ff31aa\") " pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:24.950005 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949942 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac34f759-ee32-402b-8ba7-b99a4983eb62-host\") pod \"node-ca-sh4jr\" (UID: \"ac34f759-ee32-402b-8ba7-b99a4983eb62\") " pod="openshift-image-registry/node-ca-sh4jr" Jun 07 16:02:24.950005 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949967 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-etc-sysctl-conf\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:24.950005 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.949991 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbxfl\" (UniqueName: \"kubernetes.io/projected/f217cd29-4c36-4393-93b0-74f66d9c4b64-kube-api-access-gbxfl\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:24.950634 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.950017 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7734bfb1-0434-4329-b54a-0069b78b45b1-env-overrides\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:24.950634 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.950042 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-var-lib-openvswitch\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:24.950634 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.950107 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-host-cni-bin\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:24.950634 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.950143 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x2r8\" (UniqueName: \"kubernetes.io/projected/ac34f759-ee32-402b-8ba7-b99a4983eb62-kube-api-access-4x2r8\") pod \"node-ca-sh4jr\" (UID: \"ac34f759-ee32-402b-8ba7-b99a4983eb62\") " pod="openshift-image-registry/node-ca-sh4jr" Jun 07 16:02:24.950634 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.950188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-var-lib-kubelet\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:24.950634 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.950214 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0c49c912-24d0-4c26-9a89-46f6e3cec1b2-konnectivity-ca\") pod \"konnectivity-agent-mj7mp\" (UID: \"0c49c912-24d0-4c26-9a89-46f6e3cec1b2\") " pod="kube-system/konnectivity-agent-mj7mp" Jun 07 16:02:24.950634 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.950239 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-etc-openvswitch\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:24.950634 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.950285 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:24.950634 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.950309 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34644d4d-1eda-4b1c-a925-e246163f9252-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xpkpp\" (UID: \"34644d4d-1eda-4b1c-a925-e246163f9252\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" Jun 07 16:02:24.950634 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.950351 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-etc-sysconfig\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:24.950634 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.950380 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-run-openvswitch\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:24.950634 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.950443 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-host-cni-netd\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:24.950634 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.950474 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4m4s\" (UniqueName: \"kubernetes.io/projected/34644d4d-1eda-4b1c-a925-e246163f9252-kube-api-access-d4m4s\") pod \"aws-ebs-csi-driver-node-xpkpp\" (UID: \"34644d4d-1eda-4b1c-a925-e246163f9252\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" Jun 07 16:02:24.950634 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.950513 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-etc-modprobe-d\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:24.950634 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.950541 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7734bfb1-0434-4329-b54a-0069b78b45b1-ovnkube-config\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:24.963872 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.963852 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-66l5l" Jun 07 16:02:24.970921 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:24.970901 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-66l5l" Jun 07 16:02:25.005884 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.005784 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-133.ec2.internal" event={"ID":"17d1772778b6e8d61f944dcb69222ce7","Type":"ContainerStarted","Data":"a523ad889682c104f97e686aa458034441a72829d82f477b32166df056c7cc22"} Jun 07 16:02:25.007053 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.007023 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" event={"ID":"fdf27da8f60994655d0d198c69001978","Type":"ContainerStarted","Data":"0487418b8820c6398d0e38613cb5ff356d897ddcfb02ff496fe09922c4bb6eaf"} Jun 07 16:02:25.037525 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.037496 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 07 16:02:25.050882 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.050850 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-var-lib-openvswitch\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.050882 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.050887 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-host-cni-bin\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.051108 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.050903 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x2r8\" (UniqueName: \"kubernetes.io/projected/ac34f759-ee32-402b-8ba7-b99a4983eb62-kube-api-access-4x2r8\") pod \"node-ca-sh4jr\" (UID: \"ac34f759-ee32-402b-8ba7-b99a4983eb62\") " pod="openshift-image-registry/node-ca-sh4jr" Jun 07 16:02:25.051108 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.050923 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-multus-cni-dir\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.051108 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.050948 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-var-lib-kubelet\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.051108 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.050972 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-host-cni-bin\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.051108 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051006 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-var-lib-kubelet\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.051108 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.050973 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-var-lib-openvswitch\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.051108 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051059 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0c49c912-24d0-4c26-9a89-46f6e3cec1b2-konnectivity-ca\") pod \"konnectivity-agent-mj7mp\" (UID: \"0c49c912-24d0-4c26-9a89-46f6e3cec1b2\") " pod="kube-system/konnectivity-agent-mj7mp" Jun 07 16:02:25.051108 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051111 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-etc-openvswitch\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.051396 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051140 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.051396 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051163 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34644d4d-1eda-4b1c-a925-e246163f9252-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xpkpp\" (UID: \"34644d4d-1eda-4b1c-a925-e246163f9252\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" Jun 07 16:02:25.051396 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051189 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d71a3072-92cb-4580-9260-0579a591a6a5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.051396 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051218 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-etc-sysconfig\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.051396 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051242 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-run-openvswitch\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.051396 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051253 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.051396 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051266 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-host-cni-netd\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.051396 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051291 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4m4s\" (UniqueName: \"kubernetes.io/projected/34644d4d-1eda-4b1c-a925-e246163f9252-kube-api-access-d4m4s\") pod \"aws-ebs-csi-driver-node-xpkpp\" (UID: \"34644d4d-1eda-4b1c-a925-e246163f9252\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" Jun 07 16:02:25.051396 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051298 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-etc-openvswitch\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.051396 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051313 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-etc-modprobe-d\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.051396 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051355 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7734bfb1-0434-4329-b54a-0069b78b45b1-ovnkube-config\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.051396 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051381 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-hostroot\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.051715 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051402 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-multus-conf-dir\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.051715 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051420 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-etc-kubernetes\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.051715 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051439 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d71a3072-92cb-4580-9260-0579a591a6a5-cnibin\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.051715 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051463 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0c49c912-24d0-4c26-9a89-46f6e3cec1b2-agent-certs\") pod \"konnectivity-agent-mj7mp\" (UID: \"0c49c912-24d0-4c26-9a89-46f6e3cec1b2\") " pod="kube-system/konnectivity-agent-mj7mp" Jun 07 16:02:25.051715 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051477 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-etc-modprobe-d\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.051715 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051489 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-host\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.051715 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051513 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwb78\" (UniqueName: \"kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78\") pod \"network-check-target-jsqrs\" (UID: \"b9b1b9ac-e584-4249-aece-b6dc05d9bec6\") " pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:25.051715 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051518 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-run-openvswitch\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.051715 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051539 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d71a3072-92cb-4580-9260-0579a591a6a5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.051715 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051559 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0c49c912-24d0-4c26-9a89-46f6e3cec1b2-konnectivity-ca\") pod \"konnectivity-agent-mj7mp\" (UID: \"0c49c912-24d0-4c26-9a89-46f6e3cec1b2\") " pod="kube-system/konnectivity-agent-mj7mp" Jun 07 16:02:25.051715 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051568 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-etc-sysctl-d\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.051715 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051573 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-host-cni-netd\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.051715 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051601 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f217cd29-4c36-4393-93b0-74f66d9c4b64-tmp\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.051715 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051624 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-kubelet-config\") pod \"global-pull-secret-syncer-lg8vx\" (UID: \"9885b2fd-1551-4bfc-9e75-18c6b4ff31aa\") " pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:25.051715 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051645 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-host-run-netns\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.051715 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051667 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-etc-sysctl-d\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.051715 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051669 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-run-ovn\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.052198 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051696 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-run-ovn\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.052198 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051700 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-log-socket\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.052198 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051727 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.052198 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051791 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-host-var-lib-cni-multus\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.052198 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051815 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ac34f759-ee32-402b-8ba7-b99a4983eb62-serviceca\") pod \"node-ca-sh4jr\" (UID: \"ac34f759-ee32-402b-8ba7-b99a4983eb62\") " pod="openshift-image-registry/node-ca-sh4jr" Jun 07 16:02:25.052198 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051837 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-host-run-k8s-cni-cncf-io\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.052198 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051863 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2gvk\" (UniqueName: \"kubernetes.io/projected/6a7766ae-5bce-436a-ba5d-40bf36fc0d7c-kube-api-access-n2gvk\") pod \"node-resolver-wfs76\" (UID: \"6a7766ae-5bce-436a-ba5d-40bf36fc0d7c\") " pod="openshift-dns/node-resolver-wfs76" Jun 07 16:02:25.052198 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051886 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7734bfb1-0434-4329-b54a-0069b78b45b1-ovn-node-metrics-cert\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.052198 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051925 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34644d4d-1eda-4b1c-a925-e246163f9252-registration-dir\") pod \"aws-ebs-csi-driver-node-xpkpp\" (UID: \"34644d4d-1eda-4b1c-a925-e246163f9252\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" Jun 07 16:02:25.052198 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051949 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34644d4d-1eda-4b1c-a925-e246163f9252-device-dir\") pod \"aws-ebs-csi-driver-node-xpkpp\" (UID: \"34644d4d-1eda-4b1c-a925-e246163f9252\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" Jun 07 16:02:25.052198 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051974 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4f808007-b5eb-4a1a-a186-0a90489f7102-multus-daemon-config\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.052198 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051979 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-kubelet-config\") pod \"global-pull-secret-syncer-lg8vx\" (UID: \"9885b2fd-1551-4bfc-9e75-18c6b4ff31aa\") " pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:25.052198 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051994 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7734bfb1-0434-4329-b54a-0069b78b45b1-ovnkube-config\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.052198 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052012 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d71a3072-92cb-4580-9260-0579a591a6a5-system-cni-dir\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.052198 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052024 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-host-run-netns\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.052198 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052038 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fslx\" (UniqueName: \"kubernetes.io/projected/ec607386-1984-4a48-8b69-eb23b7525b9f-kube-api-access-6fslx\") pod \"network-metrics-daemon-c9g56\" (UID: \"ec607386-1984-4a48-8b69-eb23b7525b9f\") " pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:25.052198 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052042 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34644d4d-1eda-4b1c-a925-e246163f9252-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xpkpp\" (UID: \"34644d4d-1eda-4b1c-a925-e246163f9252\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" Jun 07 16:02:25.052682 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052289 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34644d4d-1eda-4b1c-a925-e246163f9252-registration-dir\") pod \"aws-ebs-csi-driver-node-xpkpp\" (UID: \"34644d4d-1eda-4b1c-a925-e246163f9252\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" Jun 07 16:02:25.052682 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052303 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-log-socket\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.052682 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052327 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 07 16:02:25.052682 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.051355 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-etc-sysconfig\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.052682 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052339 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.052682 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052391 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-host\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.052682 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052457 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ac34f759-ee32-402b-8ba7-b99a4983eb62-serviceca\") pod \"node-ca-sh4jr\" (UID: \"ac34f759-ee32-402b-8ba7-b99a4983eb62\") " pod="openshift-image-registry/node-ca-sh4jr" Jun 07 16:02:25.052682 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052490 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a7766ae-5bce-436a-ba5d-40bf36fc0d7c-tmp-dir\") pod \"node-resolver-wfs76\" (UID: \"6a7766ae-5bce-436a-ba5d-40bf36fc0d7c\") " pod="openshift-dns/node-resolver-wfs76" Jun 07 16:02:25.052682 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052520 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/059fd790-5e62-46cf-912c-5770926fce96-host-slash\") pod \"iptables-alerter-gdjlh\" (UID: \"059fd790-5e62-46cf-912c-5770926fce96\") " pod="openshift-network-operator/iptables-alerter-gdjlh" Jun 07 16:02:25.052682 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052600 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34644d4d-1eda-4b1c-a925-e246163f9252-device-dir\") pod \"aws-ebs-csi-driver-node-xpkpp\" (UID: \"34644d4d-1eda-4b1c-a925-e246163f9252\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" Jun 07 16:02:25.052682 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052609 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-lib-modules\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.052682 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052631 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/059fd790-5e62-46cf-912c-5770926fce96-host-slash\") pod \"iptables-alerter-gdjlh\" (UID: \"059fd790-5e62-46cf-912c-5770926fce96\") " pod="openshift-network-operator/iptables-alerter-gdjlh" Jun 07 16:02:25.052682 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052635 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6a7766ae-5bce-436a-ba5d-40bf36fc0d7c-hosts-file\") pod \"node-resolver-wfs76\" (UID: \"6a7766ae-5bce-436a-ba5d-40bf36fc0d7c\") " pod="openshift-dns/node-resolver-wfs76" Jun 07 16:02:25.052682 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052659 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-host-slash\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.053370 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052686 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-node-log\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.053370 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052707 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-lib-modules\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.053370 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052714 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-multus-socket-dir-parent\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.053370 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052740 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34644d4d-1eda-4b1c-a925-e246163f9252-sys-fs\") pod \"aws-ebs-csi-driver-node-xpkpp\" (UID: \"34644d4d-1eda-4b1c-a925-e246163f9252\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" Jun 07 16:02:25.053370 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052743 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-host-slash\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.053370 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052787 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-node-log\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.053370 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052794 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f217cd29-4c36-4393-93b0-74f66d9c4b64-etc-tuned\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.053370 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052827 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34644d4d-1eda-4b1c-a925-e246163f9252-sys-fs\") pod \"aws-ebs-csi-driver-node-xpkpp\" (UID: \"34644d4d-1eda-4b1c-a925-e246163f9252\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" Jun 07 16:02:25.053370 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052826 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6a7766ae-5bce-436a-ba5d-40bf36fc0d7c-hosts-file\") pod \"node-resolver-wfs76\" (UID: \"6a7766ae-5bce-436a-ba5d-40bf36fc0d7c\") " pod="openshift-dns/node-resolver-wfs76" Jun 07 16:02:25.053370 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052839 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/059fd790-5e62-46cf-912c-5770926fce96-iptables-alerter-script\") pod \"iptables-alerter-gdjlh\" (UID: \"059fd790-5e62-46cf-912c-5770926fce96\") " pod="openshift-network-operator/iptables-alerter-gdjlh" Jun 07 16:02:25.053370 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052865 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-run-systemd\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.053370 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052892 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7734bfb1-0434-4329-b54a-0069b78b45b1-ovnkube-script-lib\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.053370 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052917 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8xgv\" (UniqueName: \"kubernetes.io/projected/7734bfb1-0434-4329-b54a-0069b78b45b1-kube-api-access-t8xgv\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.053370 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052942 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34644d4d-1eda-4b1c-a925-e246163f9252-socket-dir\") pod \"aws-ebs-csi-driver-node-xpkpp\" (UID: \"34644d4d-1eda-4b1c-a925-e246163f9252\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" Jun 07 16:02:25.053370 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052949 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-run-systemd\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.053370 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.052970 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-etc-systemd\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.053370 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053002 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34644d4d-1eda-4b1c-a925-e246163f9252-etc-selinux\") pod \"aws-ebs-csi-driver-node-xpkpp\" (UID: \"34644d4d-1eda-4b1c-a925-e246163f9252\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" Jun 07 16:02:25.054167 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053015 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-etc-systemd\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.054167 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053026 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-host-run-netns\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.054167 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053050 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh5rq\" (UniqueName: \"kubernetes.io/projected/d71a3072-92cb-4580-9260-0579a591a6a5-kube-api-access-qh5rq\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.054167 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053071 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-dbus\") pod \"global-pull-secret-syncer-lg8vx\" (UID: \"9885b2fd-1551-4bfc-9e75-18c6b4ff31aa\") " pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:25.054167 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-host-kubelet\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.054167 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053112 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-cnibin\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.054167 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053131 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-host-var-lib-cni-bin\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.054167 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053151 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-host-var-lib-kubelet\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.054167 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053170 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d71a3072-92cb-4580-9260-0579a591a6a5-cni-binary-copy\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.054167 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053193 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crrpt\" (UniqueName: \"kubernetes.io/projected/059fd790-5e62-46cf-912c-5770926fce96-kube-api-access-crrpt\") pod \"iptables-alerter-gdjlh\" (UID: \"059fd790-5e62-46cf-912c-5770926fce96\") " pod="openshift-network-operator/iptables-alerter-gdjlh" Jun 07 16:02:25.054167 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053225 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-etc-kubernetes\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.054167 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053249 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-run\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.054167 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053313 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-sys\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.054167 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053414 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/059fd790-5e62-46cf-912c-5770926fce96-iptables-alerter-script\") pod \"iptables-alerter-gdjlh\" (UID: \"059fd790-5e62-46cf-912c-5770926fce96\") " pod="openshift-network-operator/iptables-alerter-gdjlh" Jun 07 16:02:25.054167 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053457 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d71a3072-92cb-4580-9260-0579a591a6a5-os-release\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.054167 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053484 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-systemd-units\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.054167 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053509 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-system-cni-dir\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.054977 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053525 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34644d4d-1eda-4b1c-a925-e246163f9252-socket-dir\") pod \"aws-ebs-csi-driver-node-xpkpp\" (UID: \"34644d4d-1eda-4b1c-a925-e246163f9252\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" Jun 07 16:02:25.054977 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053541 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34644d4d-1eda-4b1c-a925-e246163f9252-etc-selinux\") pod \"aws-ebs-csi-driver-node-xpkpp\" (UID: \"34644d4d-1eda-4b1c-a925-e246163f9252\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" Jun 07 16:02:25.054977 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053557 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a7766ae-5bce-436a-ba5d-40bf36fc0d7c-tmp-dir\") pod \"node-resolver-wfs76\" (UID: \"6a7766ae-5bce-436a-ba5d-40bf36fc0d7c\") " pod="openshift-dns/node-resolver-wfs76" Jun 07 16:02:25.054977 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053593 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-systemd-units\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.054977 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053660 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-dbus\") pod \"global-pull-secret-syncer-lg8vx\" (UID: \"9885b2fd-1551-4bfc-9e75-18c6b4ff31aa\") " pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:25.054977 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053671 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-run\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.054977 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053531 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-host-run-multus-certs\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.054977 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053705 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-sys\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.054977 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053745 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7734bfb1-0434-4329-b54a-0069b78b45b1-host-kubelet\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.054977 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053793 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp2m8\" (UniqueName: \"kubernetes.io/projected/4f808007-b5eb-4a1a-a186-0a90489f7102-kube-api-access-sp2m8\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.054977 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053812 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-etc-kubernetes\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.054977 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053827 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d71a3072-92cb-4580-9260-0579a591a6a5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.054977 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053868 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs\") pod \"network-metrics-daemon-c9g56\" (UID: \"ec607386-1984-4a48-8b69-eb23b7525b9f\") " pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:25.054977 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053919 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret\") pod \"global-pull-secret-syncer-lg8vx\" (UID: \"9885b2fd-1551-4bfc-9e75-18c6b4ff31aa\") " pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:25.054977 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053956 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f808007-b5eb-4a1a-a186-0a90489f7102-cni-binary-copy\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.054977 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.053988 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac34f759-ee32-402b-8ba7-b99a4983eb62-host\") pod \"node-ca-sh4jr\" (UID: \"ac34f759-ee32-402b-8ba7-b99a4983eb62\") " pod="openshift-image-registry/node-ca-sh4jr" Jun 07 16:02:25.054977 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:25.054001 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:25.054977 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.054012 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-etc-sysctl-conf\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.055880 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.054037 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbxfl\" (UniqueName: \"kubernetes.io/projected/f217cd29-4c36-4393-93b0-74f66d9c4b64-kube-api-access-gbxfl\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.055880 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.054060 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ac34f759-ee32-402b-8ba7-b99a4983eb62-host\") pod \"node-ca-sh4jr\" (UID: \"ac34f759-ee32-402b-8ba7-b99a4983eb62\") " pod="openshift-image-registry/node-ca-sh4jr" Jun 07 16:02:25.055880 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.054072 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7734bfb1-0434-4329-b54a-0069b78b45b1-ovnkube-script-lib\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.055880 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:25.054096 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret podName:9885b2fd-1551-4bfc-9e75-18c6b4ff31aa nodeName:}" failed. No retries permitted until 2026-06-07 16:02:25.55406062 +0000 UTC m=+2.951997557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret") pod "global-pull-secret-syncer-lg8vx" (UID: "9885b2fd-1551-4bfc-9e75-18c6b4ff31aa") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:25.055880 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.054120 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7734bfb1-0434-4329-b54a-0069b78b45b1-env-overrides\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.055880 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.054153 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-os-release\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.055880 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.054187 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f217cd29-4c36-4393-93b0-74f66d9c4b64-etc-sysctl-conf\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.055880 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.054492 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7734bfb1-0434-4329-b54a-0069b78b45b1-env-overrides\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.056230 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.056044 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f217cd29-4c36-4393-93b0-74f66d9c4b64-tmp\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.056230 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.056191 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f217cd29-4c36-4393-93b0-74f66d9c4b64-etc-tuned\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.056405 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.056384 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0c49c912-24d0-4c26-9a89-46f6e3cec1b2-agent-certs\") pod \"konnectivity-agent-mj7mp\" (UID: \"0c49c912-24d0-4c26-9a89-46f6e3cec1b2\") " pod="kube-system/konnectivity-agent-mj7mp" Jun 07 16:02:25.058015 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.057984 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7734bfb1-0434-4329-b54a-0069b78b45b1-ovn-node-metrics-cert\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.060892 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.060869 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x2r8\" (UniqueName: \"kubernetes.io/projected/ac34f759-ee32-402b-8ba7-b99a4983eb62-kube-api-access-4x2r8\") pod \"node-ca-sh4jr\" (UID: \"ac34f759-ee32-402b-8ba7-b99a4983eb62\") " pod="openshift-image-registry/node-ca-sh4jr" Jun 07 16:02:25.061013 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.060942 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2gvk\" (UniqueName: \"kubernetes.io/projected/6a7766ae-5bce-436a-ba5d-40bf36fc0d7c-kube-api-access-n2gvk\") pod \"node-resolver-wfs76\" (UID: \"6a7766ae-5bce-436a-ba5d-40bf36fc0d7c\") " pod="openshift-dns/node-resolver-wfs76" Jun 07 16:02:25.061268 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.061246 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4m4s\" (UniqueName: \"kubernetes.io/projected/34644d4d-1eda-4b1c-a925-e246163f9252-kube-api-access-d4m4s\") pod \"aws-ebs-csi-driver-node-xpkpp\" (UID: \"34644d4d-1eda-4b1c-a925-e246163f9252\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" Jun 07 16:02:25.062683 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.062664 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8xgv\" (UniqueName: \"kubernetes.io/projected/7734bfb1-0434-4329-b54a-0069b78b45b1-kube-api-access-t8xgv\") pod \"ovnkube-node-826vv\" (UID: \"7734bfb1-0434-4329-b54a-0069b78b45b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.063787 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.063748 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crrpt\" (UniqueName: \"kubernetes.io/projected/059fd790-5e62-46cf-912c-5770926fce96-kube-api-access-crrpt\") pod \"iptables-alerter-gdjlh\" (UID: \"059fd790-5e62-46cf-912c-5770926fce96\") " pod="openshift-network-operator/iptables-alerter-gdjlh" Jun 07 16:02:25.064599 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.064579 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbxfl\" (UniqueName: \"kubernetes.io/projected/f217cd29-4c36-4393-93b0-74f66d9c4b64-kube-api-access-gbxfl\") pod \"tuned-wlrgs\" (UID: \"f217cd29-4c36-4393-93b0-74f66d9c4b64\") " pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.155319 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-hostroot\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.155319 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155322 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-multus-conf-dir\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.155538 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155341 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-etc-kubernetes\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.155538 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155365 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d71a3072-92cb-4580-9260-0579a591a6a5-cnibin\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.155538 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155394 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-hostroot\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.155538 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155389 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwb78\" (UniqueName: \"kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78\") pod \"network-check-target-jsqrs\" (UID: \"b9b1b9ac-e584-4249-aece-b6dc05d9bec6\") " pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:25.155538 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155407 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-multus-conf-dir\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.155538 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155421 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-etc-kubernetes\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.155538 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155443 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d71a3072-92cb-4580-9260-0579a591a6a5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.155538 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155437 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d71a3072-92cb-4580-9260-0579a591a6a5-cnibin\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.155538 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155476 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-host-var-lib-cni-multus\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.155538 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155501 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-host-run-k8s-cni-cncf-io\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.155538 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155524 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4f808007-b5eb-4a1a-a186-0a90489f7102-multus-daemon-config\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.156175 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155551 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-host-var-lib-cni-multus\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.156175 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155563 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d71a3072-92cb-4580-9260-0579a591a6a5-system-cni-dir\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.156175 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155576 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-host-run-k8s-cni-cncf-io\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.156175 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155586 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fslx\" (UniqueName: \"kubernetes.io/projected/ec607386-1984-4a48-8b69-eb23b7525b9f-kube-api-access-6fslx\") pod \"network-metrics-daemon-c9g56\" (UID: \"ec607386-1984-4a48-8b69-eb23b7525b9f\") " pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:25.156175 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155630 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-multus-socket-dir-parent\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.156175 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155666 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-host-run-netns\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.156175 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155687 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh5rq\" (UniqueName: \"kubernetes.io/projected/d71a3072-92cb-4580-9260-0579a591a6a5-kube-api-access-qh5rq\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.156175 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155714 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-cnibin\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.156175 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155717 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-multus-socket-dir-parent\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.156175 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155728 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-host-var-lib-cni-bin\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.156175 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155773 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-host-var-lib-cni-bin\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.156175 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155780 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-host-var-lib-kubelet\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.156175 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155792 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d71a3072-92cb-4580-9260-0579a591a6a5-system-cni-dir\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.156175 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155809 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d71a3072-92cb-4580-9260-0579a591a6a5-cni-binary-copy\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.156175 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155839 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d71a3072-92cb-4580-9260-0579a591a6a5-os-release\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.156175 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155845 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-cnibin\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.156175 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155862 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-system-cni-dir\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.156925 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155885 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-host-run-multus-certs\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.156925 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155908 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp2m8\" (UniqueName: \"kubernetes.io/projected/4f808007-b5eb-4a1a-a186-0a90489f7102-kube-api-access-sp2m8\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.156925 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155932 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d71a3072-92cb-4580-9260-0579a591a6a5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.156925 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155956 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs\") pod \"network-metrics-daemon-c9g56\" (UID: \"ec607386-1984-4a48-8b69-eb23b7525b9f\") " pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:25.156925 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155995 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f808007-b5eb-4a1a-a186-0a90489f7102-cni-binary-copy\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.156925 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.156018 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-system-cni-dir\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.156925 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.156022 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-os-release\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.156925 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.156051 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d71a3072-92cb-4580-9260-0579a591a6a5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.156925 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.156054 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-multus-cni-dir\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.156925 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.156083 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-os-release\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.156925 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.156096 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-multus-cni-dir\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.156925 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.156098 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d71a3072-92cb-4580-9260-0579a591a6a5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.156925 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.156127 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-host-run-multus-certs\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.156925 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.155811 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-host-run-netns\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.156925 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.156156 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4f808007-b5eb-4a1a-a186-0a90489f7102-multus-daemon-config\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.156925 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.156184 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d71a3072-92cb-4580-9260-0579a591a6a5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.156925 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.156186 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d71a3072-92cb-4580-9260-0579a591a6a5-os-release\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.156925 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.156216 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f808007-b5eb-4a1a-a186-0a90489f7102-host-var-lib-kubelet\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.157474 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.156245 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d71a3072-92cb-4580-9260-0579a591a6a5-cni-binary-copy\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.157474 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:25.156250 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:25.157474 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:25.156319 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs podName:ec607386-1984-4a48-8b69-eb23b7525b9f nodeName:}" failed. No retries permitted until 2026-06-07 16:02:25.656304973 +0000 UTC m=+3.054241894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs") pod "network-metrics-daemon-c9g56" (UID: "ec607386-1984-4a48-8b69-eb23b7525b9f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:25.157474 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.156626 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f808007-b5eb-4a1a-a186-0a90489f7102-cni-binary-copy\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.157474 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.156677 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d71a3072-92cb-4580-9260-0579a591a6a5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.162068 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:25.162039 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:02:25.162185 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:25.162073 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:02:25.162185 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:25.162086 2579 projected.go:196] Error preparing data for projected volume kube-api-access-kwb78 for pod openshift-network-diagnostics/network-check-target-jsqrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:25.162185 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:25.162139 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78 podName:b9b1b9ac-e584-4249-aece-b6dc05d9bec6 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:25.662122824 +0000 UTC m=+3.060059761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kwb78" (UniqueName: "kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78") pod "network-check-target-jsqrs" (UID: "b9b1b9ac-e584-4249-aece-b6dc05d9bec6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:25.164078 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.164051 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fslx\" (UniqueName: \"kubernetes.io/projected/ec607386-1984-4a48-8b69-eb23b7525b9f-kube-api-access-6fslx\") pod \"network-metrics-daemon-c9g56\" (UID: \"ec607386-1984-4a48-8b69-eb23b7525b9f\") " pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:25.164292 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.164271 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh5rq\" (UniqueName: \"kubernetes.io/projected/d71a3072-92cb-4580-9260-0579a591a6a5-kube-api-access-qh5rq\") pod \"multus-additional-cni-plugins-hdls5\" (UID: \"d71a3072-92cb-4580-9260-0579a591a6a5\") " pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.164642 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.164626 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp2m8\" (UniqueName: \"kubernetes.io/projected/4f808007-b5eb-4a1a-a186-0a90489f7102-kube-api-access-sp2m8\") pod \"multus-4r4mr\" (UID: \"4f808007-b5eb-4a1a-a186-0a90489f7102\") " pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.195655 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.195622 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:02:25.230571 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.230523 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wfs76" Jun 07 16:02:25.240077 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.240055 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gdjlh" Jun 07 16:02:25.249932 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.249900 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:25.254134 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.254096 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mj7mp" Jun 07 16:02:25.260809 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.260788 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" Jun 07 16:02:25.267468 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.267443 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sh4jr" Jun 07 16:02:25.276439 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.276416 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" Jun 07 16:02:25.283466 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.283446 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hdls5" Jun 07 16:02:25.290447 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.290427 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4r4mr" Jun 07 16:02:25.558849 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.558750 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret\") pod \"global-pull-secret-syncer-lg8vx\" (UID: \"9885b2fd-1551-4bfc-9e75-18c6b4ff31aa\") " pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:25.559009 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:25.558957 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:25.559071 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:25.559018 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret podName:9885b2fd-1551-4bfc-9e75-18c6b4ff31aa nodeName:}" failed. No retries permitted until 2026-06-07 16:02:26.558998917 +0000 UTC m=+3.956935850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret") pod "global-pull-secret-syncer-lg8vx" (UID: "9885b2fd-1551-4bfc-9e75-18c6b4ff31aa") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:25.659790 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.659743 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs\") pod \"network-metrics-daemon-c9g56\" (UID: \"ec607386-1984-4a48-8b69-eb23b7525b9f\") " pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:25.659958 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:25.659906 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:25.660011 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:25.659970 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs podName:ec607386-1984-4a48-8b69-eb23b7525b9f nodeName:}" failed. No retries permitted until 2026-06-07 16:02:26.659954458 +0000 UTC m=+4.057891381 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs") pod "network-metrics-daemon-c9g56" (UID: "ec607386-1984-4a48-8b69-eb23b7525b9f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:25.760776 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.760731 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwb78\" (UniqueName: \"kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78\") pod \"network-check-target-jsqrs\" (UID: \"b9b1b9ac-e584-4249-aece-b6dc05d9bec6\") " pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:25.760954 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:25.760899 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:02:25.760954 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:25.760916 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:02:25.760954 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:25.760926 2579 projected.go:196] Error preparing data for projected volume kube-api-access-kwb78 for pod openshift-network-diagnostics/network-check-target-jsqrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:25.761105 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:25.760991 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78 podName:b9b1b9ac-e584-4249-aece-b6dc05d9bec6 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:26.76097114 +0000 UTC m=+4.158908080 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwb78" (UniqueName: "kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78") pod "network-check-target-jsqrs" (UID: "b9b1b9ac-e584-4249-aece-b6dc05d9bec6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:25.947027 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:25.946998 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod059fd790_5e62_46cf_912c_5770926fce96.slice/crio-78af5ee90d3bf393b2c2809b491ac036fffb3dade131569674ed4dd1b7036806 WatchSource:0}: Error finding container 78af5ee90d3bf393b2c2809b491ac036fffb3dade131569674ed4dd1b7036806: Status 404 returned error can't find the container with id 78af5ee90d3bf393b2c2809b491ac036fffb3dade131569674ed4dd1b7036806 Jun 07 16:02:25.948295 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:25.948272 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7734bfb1_0434_4329_b54a_0069b78b45b1.slice/crio-17c95993d481493f27672e225deb8a9ebfe16d840e61deeef40c783bd057be1f WatchSource:0}: Error finding container 17c95993d481493f27672e225deb8a9ebfe16d840e61deeef40c783bd057be1f: Status 404 returned error can't find the container with id 17c95993d481493f27672e225deb8a9ebfe16d840e61deeef40c783bd057be1f Jun 07 16:02:25.949081 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:25.949007 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f808007_b5eb_4a1a_a186_0a90489f7102.slice/crio-31f62c4525d9c4b251ba8c8e9543db5444f6b6fa83eb5bb1155e3367c0243b13 WatchSource:0}: Error finding container 31f62c4525d9c4b251ba8c8e9543db5444f6b6fa83eb5bb1155e3367c0243b13: Status 404 returned error can't find the container with id 31f62c4525d9c4b251ba8c8e9543db5444f6b6fa83eb5bb1155e3367c0243b13 Jun 07 16:02:25.949985 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:25.949948 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac34f759_ee32_402b_8ba7_b99a4983eb62.slice/crio-59b1de512b6d0235ca8e046825fee60b80901dfac49660d0b7ea3d1ec9c46bf2 WatchSource:0}: Error finding container 59b1de512b6d0235ca8e046825fee60b80901dfac49660d0b7ea3d1ec9c46bf2: Status 404 returned error can't find the container with id 59b1de512b6d0235ca8e046825fee60b80901dfac49660d0b7ea3d1ec9c46bf2 Jun 07 16:02:25.950803 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:25.950746 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c49c912_24d0_4c26_9a89_46f6e3cec1b2.slice/crio-449b759c4fbc966799cd3232e0d7cc0d89699a6b617764995f4ee8e0ffdede56 WatchSource:0}: Error finding container 449b759c4fbc966799cd3232e0d7cc0d89699a6b617764995f4ee8e0ffdede56: Status 404 returned error can't find the container with id 449b759c4fbc966799cd3232e0d7cc0d89699a6b617764995f4ee8e0ffdede56 Jun 07 16:02:25.953800 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:25.953734 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34644d4d_1eda_4b1c_a925_e246163f9252.slice/crio-427afef1cf6d5e9dda20bf593bb21e6f4e2a5fd7279495657fdc45ba2d1c9ec1 WatchSource:0}: Error finding container 427afef1cf6d5e9dda20bf593bb21e6f4e2a5fd7279495657fdc45ba2d1c9ec1: Status 404 returned error can't find the container with id 427afef1cf6d5e9dda20bf593bb21e6f4e2a5fd7279495657fdc45ba2d1c9ec1 Jun 07 16:02:25.955739 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:25.955440 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd71a3072_92cb_4580_9260_0579a591a6a5.slice/crio-223c4486717026e148e620f2d4928a2623a34eb4814d327fcace87d10f88c95b WatchSource:0}: Error finding container 223c4486717026e148e620f2d4928a2623a34eb4814d327fcace87d10f88c95b: Status 404 returned error can't find the container with id 223c4486717026e148e620f2d4928a2623a34eb4814d327fcace87d10f88c95b Jun 07 16:02:25.956944 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:25.956848 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a7766ae_5bce_436a_ba5d_40bf36fc0d7c.slice/crio-77e01ab3d417730810e1e528b88f41eba126f445fc43f9ca8590bebed428ac96 WatchSource:0}: Error finding container 77e01ab3d417730810e1e528b88f41eba126f445fc43f9ca8590bebed428ac96: Status 404 returned error can't find the container with id 77e01ab3d417730810e1e528b88f41eba126f445fc43f9ca8590bebed428ac96 Jun 07 16:02:25.958221 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:25.958190 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf217cd29_4c36_4393_93b0_74f66d9c4b64.slice/crio-5673daedfb9db1f6c57c49d5e032ed19839e1e86fc7d50f9e8561973e97d6169 WatchSource:0}: Error finding container 5673daedfb9db1f6c57c49d5e032ed19839e1e86fc7d50f9e8561973e97d6169: Status 404 returned error can't find the container with id 5673daedfb9db1f6c57c49d5e032ed19839e1e86fc7d50f9e8561973e97d6169 Jun 07 16:02:25.974440 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.974388 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-06 15:57:24 +0000 UTC" deadline="2028-03-13 17:06:55.22691455 +0000 UTC" Jun 07 16:02:25.974522 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:25.974440 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15481h4m29.252478332s" Jun 07 16:02:26.000950 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:26.000814 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:26.001087 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:26.001061 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9g56" podUID="ec607386-1984-4a48-8b69-eb23b7525b9f" Jun 07 16:02:26.014474 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:26.014448 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" event={"ID":"f217cd29-4c36-4393-93b0-74f66d9c4b64","Type":"ContainerStarted","Data":"5673daedfb9db1f6c57c49d5e032ed19839e1e86fc7d50f9e8561973e97d6169"} Jun 07 16:02:26.016411 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:26.016378 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wfs76" event={"ID":"6a7766ae-5bce-436a-ba5d-40bf36fc0d7c","Type":"ContainerStarted","Data":"77e01ab3d417730810e1e528b88f41eba126f445fc43f9ca8590bebed428ac96"} Jun 07 16:02:26.017427 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:26.017406 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" event={"ID":"34644d4d-1eda-4b1c-a925-e246163f9252","Type":"ContainerStarted","Data":"427afef1cf6d5e9dda20bf593bb21e6f4e2a5fd7279495657fdc45ba2d1c9ec1"} Jun 07 16:02:26.018494 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:26.018455 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sh4jr" event={"ID":"ac34f759-ee32-402b-8ba7-b99a4983eb62","Type":"ContainerStarted","Data":"59b1de512b6d0235ca8e046825fee60b80901dfac49660d0b7ea3d1ec9c46bf2"} Jun 07 16:02:26.019464 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:26.019448 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4r4mr" event={"ID":"4f808007-b5eb-4a1a-a186-0a90489f7102","Type":"ContainerStarted","Data":"31f62c4525d9c4b251ba8c8e9543db5444f6b6fa83eb5bb1155e3367c0243b13"} Jun 07 16:02:26.020665 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:26.020645 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-826vv" event={"ID":"7734bfb1-0434-4329-b54a-0069b78b45b1","Type":"ContainerStarted","Data":"17c95993d481493f27672e225deb8a9ebfe16d840e61deeef40c783bd057be1f"} Jun 07 16:02:26.021788 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:26.021747 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdls5" event={"ID":"d71a3072-92cb-4580-9260-0579a591a6a5","Type":"ContainerStarted","Data":"223c4486717026e148e620f2d4928a2623a34eb4814d327fcace87d10f88c95b"} Jun 07 16:02:26.022693 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:26.022667 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mj7mp" event={"ID":"0c49c912-24d0-4c26-9a89-46f6e3cec1b2","Type":"ContainerStarted","Data":"449b759c4fbc966799cd3232e0d7cc0d89699a6b617764995f4ee8e0ffdede56"} Jun 07 16:02:26.023739 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:26.023720 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gdjlh" event={"ID":"059fd790-5e62-46cf-912c-5770926fce96","Type":"ContainerStarted","Data":"78af5ee90d3bf393b2c2809b491ac036fffb3dade131569674ed4dd1b7036806"} Jun 07 16:02:26.568115 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:26.567389 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret\") pod \"global-pull-secret-syncer-lg8vx\" (UID: \"9885b2fd-1551-4bfc-9e75-18c6b4ff31aa\") " pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:26.568115 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:26.567592 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:26.568115 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:26.567664 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret podName:9885b2fd-1551-4bfc-9e75-18c6b4ff31aa nodeName:}" failed. No retries permitted until 2026-06-07 16:02:28.567644297 +0000 UTC m=+5.965581236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret") pod "global-pull-secret-syncer-lg8vx" (UID: "9885b2fd-1551-4bfc-9e75-18c6b4ff31aa") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:26.668817 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:26.668187 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs\") pod \"network-metrics-daemon-c9g56\" (UID: \"ec607386-1984-4a48-8b69-eb23b7525b9f\") " pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:26.668817 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:26.668381 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:26.668817 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:26.668446 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs podName:ec607386-1984-4a48-8b69-eb23b7525b9f nodeName:}" failed. No retries permitted until 2026-06-07 16:02:28.66842612 +0000 UTC m=+6.066363060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs") pod "network-metrics-daemon-c9g56" (UID: "ec607386-1984-4a48-8b69-eb23b7525b9f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:26.769407 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:26.768712 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwb78\" (UniqueName: \"kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78\") pod \"network-check-target-jsqrs\" (UID: \"b9b1b9ac-e584-4249-aece-b6dc05d9bec6\") " pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:26.769407 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:26.768953 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:02:26.769407 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:26.768974 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:02:26.769407 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:26.768987 2579 projected.go:196] Error preparing data for projected volume kube-api-access-kwb78 for pod openshift-network-diagnostics/network-check-target-jsqrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:26.769407 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:26.769044 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78 podName:b9b1b9ac-e584-4249-aece-b6dc05d9bec6 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:28.769025888 +0000 UTC m=+6.166962813 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwb78" (UniqueName: "kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78") pod "network-check-target-jsqrs" (UID: "b9b1b9ac-e584-4249-aece-b6dc05d9bec6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:26.974580 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:26.974534 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-06 15:57:24 +0000 UTC" deadline="2027-11-25 07:12:58.165795762 +0000 UTC" Jun 07 16:02:26.974580 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:26.974578 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12855h10m31.191223095s" Jun 07 16:02:27.000931 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:27.000898 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:27.001116 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:27.001028 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsqrs" podUID="b9b1b9ac-e584-4249-aece-b6dc05d9bec6" Jun 07 16:02:27.001440 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:27.001413 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:27.001570 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:27.001518 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg8vx" podUID="9885b2fd-1551-4bfc-9e75-18c6b4ff31aa" Jun 07 16:02:27.052612 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:27.051926 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-133.ec2.internal" event={"ID":"17d1772778b6e8d61f944dcb69222ce7","Type":"ContainerStarted","Data":"94ac72a1d7fa53222748c81646e25098319ce3e93013ae75c814f0d92300ade1"} Jun 07 16:02:27.068041 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:27.068002 2579 generic.go:356] "Generic (PLEG): container finished" podID="fdf27da8f60994655d0d198c69001978" containerID="d4041e7a0b9591d5c6fb9278d8f2dbeef4a6756f64b5b83524e82285b851a2e9" exitCode=0 Jun 07 16:02:27.068199 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:27.068059 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" event={"ID":"fdf27da8f60994655d0d198c69001978","Type":"ContainerDied","Data":"d4041e7a0b9591d5c6fb9278d8f2dbeef4a6756f64b5b83524e82285b851a2e9"} Jun 07 16:02:27.094777 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:27.090629 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-133.ec2.internal" podStartSLOduration=3.090607796 podStartE2EDuration="3.090607796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:02:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:27.065383835 +0000 UTC m=+4.463320777" watchObservedRunningTime="2026-06-07 16:02:27.090607796 +0000 UTC m=+4.488544739" Jun 07 16:02:28.001406 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:28.000886 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:28.001406 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:28.001030 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9g56" podUID="ec607386-1984-4a48-8b69-eb23b7525b9f" Jun 07 16:02:28.074847 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:28.074811 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" event={"ID":"fdf27da8f60994655d0d198c69001978","Type":"ContainerStarted","Data":"0a35e1b7fbe3bd300554fe47c9213dcd27becfd0a60079a4d3d177a15f64dc72"} Jun 07 16:02:28.089113 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:28.088557 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-133.ec2.internal" podStartSLOduration=4.088535269 podStartE2EDuration="4.088535269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:02:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:28.087817188 +0000 UTC m=+5.485754128" watchObservedRunningTime="2026-06-07 16:02:28.088535269 +0000 UTC m=+5.486472225" Jun 07 16:02:28.583660 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:28.583003 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret\") pod \"global-pull-secret-syncer-lg8vx\" (UID: \"9885b2fd-1551-4bfc-9e75-18c6b4ff31aa\") " pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:28.583660 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:28.583178 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:28.583660 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:28.583264 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret podName:9885b2fd-1551-4bfc-9e75-18c6b4ff31aa nodeName:}" failed. No retries permitted until 2026-06-07 16:02:32.583245902 +0000 UTC m=+9.981182836 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret") pod "global-pull-secret-syncer-lg8vx" (UID: "9885b2fd-1551-4bfc-9e75-18c6b4ff31aa") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:28.684867 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:28.684254 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs\") pod \"network-metrics-daemon-c9g56\" (UID: \"ec607386-1984-4a48-8b69-eb23b7525b9f\") " pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:28.684867 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:28.684449 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:28.684867 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:28.684514 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs podName:ec607386-1984-4a48-8b69-eb23b7525b9f nodeName:}" failed. No retries permitted until 2026-06-07 16:02:32.684494918 +0000 UTC m=+10.082431850 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs") pod "network-metrics-daemon-c9g56" (UID: "ec607386-1984-4a48-8b69-eb23b7525b9f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:28.786109 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:28.785423 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwb78\" (UniqueName: \"kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78\") pod \"network-check-target-jsqrs\" (UID: \"b9b1b9ac-e584-4249-aece-b6dc05d9bec6\") " pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:28.786109 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:28.785645 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:02:28.786109 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:28.785666 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:02:28.786109 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:28.785681 2579 projected.go:196] Error preparing data for projected volume kube-api-access-kwb78 for pod openshift-network-diagnostics/network-check-target-jsqrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:28.786109 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:28.785742 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78 podName:b9b1b9ac-e584-4249-aece-b6dc05d9bec6 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:32.785722047 +0000 UTC m=+10.183658982 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwb78" (UniqueName: "kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78") pod "network-check-target-jsqrs" (UID: "b9b1b9ac-e584-4249-aece-b6dc05d9bec6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:29.005785 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:29.005423 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:29.005785 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:29.005549 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg8vx" podUID="9885b2fd-1551-4bfc-9e75-18c6b4ff31aa" Jun 07 16:02:29.006725 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:29.006583 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:29.006725 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:29.006682 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsqrs" podUID="b9b1b9ac-e584-4249-aece-b6dc05d9bec6" Jun 07 16:02:30.001415 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:30.001381 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:30.001603 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:30.001525 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9g56" podUID="ec607386-1984-4a48-8b69-eb23b7525b9f" Jun 07 16:02:31.001233 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:31.001193 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:31.001650 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:31.001336 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsqrs" podUID="b9b1b9ac-e584-4249-aece-b6dc05d9bec6" Jun 07 16:02:31.001650 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:31.001392 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:31.001650 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:31.001506 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg8vx" podUID="9885b2fd-1551-4bfc-9e75-18c6b4ff31aa" Jun 07 16:02:32.002287 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:32.001780 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:32.002287 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:32.001913 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9g56" podUID="ec607386-1984-4a48-8b69-eb23b7525b9f" Jun 07 16:02:32.618733 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:32.618688 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret\") pod \"global-pull-secret-syncer-lg8vx\" (UID: \"9885b2fd-1551-4bfc-9e75-18c6b4ff31aa\") " pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:32.618936 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:32.618870 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:32.619002 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:32.618943 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret podName:9885b2fd-1551-4bfc-9e75-18c6b4ff31aa nodeName:}" failed. No retries permitted until 2026-06-07 16:02:40.618923608 +0000 UTC m=+18.016860543 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret") pod "global-pull-secret-syncer-lg8vx" (UID: "9885b2fd-1551-4bfc-9e75-18c6b4ff31aa") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:32.719686 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:32.719644 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs\") pod \"network-metrics-daemon-c9g56\" (UID: \"ec607386-1984-4a48-8b69-eb23b7525b9f\") " pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:32.719870 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:32.719809 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:32.719934 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:32.719896 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs podName:ec607386-1984-4a48-8b69-eb23b7525b9f nodeName:}" failed. No retries permitted until 2026-06-07 16:02:40.719872762 +0000 UTC m=+18.117809706 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs") pod "network-metrics-daemon-c9g56" (UID: "ec607386-1984-4a48-8b69-eb23b7525b9f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:32.820015 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:32.819983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwb78\" (UniqueName: \"kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78\") pod \"network-check-target-jsqrs\" (UID: \"b9b1b9ac-e584-4249-aece-b6dc05d9bec6\") " pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:32.820170 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:32.820120 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:02:32.820170 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:32.820137 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:02:32.820170 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:32.820146 2579 projected.go:196] Error preparing data for projected volume kube-api-access-kwb78 for pod openshift-network-diagnostics/network-check-target-jsqrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:32.820302 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:32.820200 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78 podName:b9b1b9ac-e584-4249-aece-b6dc05d9bec6 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:40.820186033 +0000 UTC m=+18.218122966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwb78" (UniqueName: "kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78") pod "network-check-target-jsqrs" (UID: "b9b1b9ac-e584-4249-aece-b6dc05d9bec6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:33.001954 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:33.001922 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:33.002161 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:33.002013 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:33.002161 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:33.002028 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsqrs" podUID="b9b1b9ac-e584-4249-aece-b6dc05d9bec6" Jun 07 16:02:33.002161 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:33.002138 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg8vx" podUID="9885b2fd-1551-4bfc-9e75-18c6b4ff31aa" Jun 07 16:02:34.001095 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:34.001057 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:34.001529 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:34.001209 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9g56" podUID="ec607386-1984-4a48-8b69-eb23b7525b9f" Jun 07 16:02:35.001889 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:35.001857 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:35.002281 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:35.001971 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsqrs" podUID="b9b1b9ac-e584-4249-aece-b6dc05d9bec6" Jun 07 16:02:35.002411 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:35.002382 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:35.002543 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:35.002492 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg8vx" podUID="9885b2fd-1551-4bfc-9e75-18c6b4ff31aa" Jun 07 16:02:36.001917 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:36.001882 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:36.002349 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:36.002059 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9g56" podUID="ec607386-1984-4a48-8b69-eb23b7525b9f" Jun 07 16:02:37.001371 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:37.001323 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:37.001564 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:37.001327 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:37.001564 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:37.001471 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsqrs" podUID="b9b1b9ac-e584-4249-aece-b6dc05d9bec6" Jun 07 16:02:37.001564 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:37.001538 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg8vx" podUID="9885b2fd-1551-4bfc-9e75-18c6b4ff31aa" Jun 07 16:02:38.001108 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:38.001073 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:38.001524 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:38.001241 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9g56" podUID="ec607386-1984-4a48-8b69-eb23b7525b9f" Jun 07 16:02:39.001847 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:39.001810 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:39.002317 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:39.001810 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:39.002317 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:39.001935 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsqrs" podUID="b9b1b9ac-e584-4249-aece-b6dc05d9bec6" Jun 07 16:02:39.002317 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:39.001989 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg8vx" podUID="9885b2fd-1551-4bfc-9e75-18c6b4ff31aa" Jun 07 16:02:40.001247 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:40.001211 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:40.001463 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:40.001331 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9g56" podUID="ec607386-1984-4a48-8b69-eb23b7525b9f" Jun 07 16:02:40.679863 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:40.679676 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret\") pod \"global-pull-secret-syncer-lg8vx\" (UID: \"9885b2fd-1551-4bfc-9e75-18c6b4ff31aa\") " pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:40.679863 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:40.679804 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:40.680327 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:40.679871 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret podName:9885b2fd-1551-4bfc-9e75-18c6b4ff31aa nodeName:}" failed. No retries permitted until 2026-06-07 16:02:56.679849999 +0000 UTC m=+34.077786932 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret") pod "global-pull-secret-syncer-lg8vx" (UID: "9885b2fd-1551-4bfc-9e75-18c6b4ff31aa") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:40.780203 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:40.780161 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs\") pod \"network-metrics-daemon-c9g56\" (UID: \"ec607386-1984-4a48-8b69-eb23b7525b9f\") " pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:40.780387 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:40.780344 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:40.780457 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:40.780448 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs podName:ec607386-1984-4a48-8b69-eb23b7525b9f nodeName:}" failed. No retries permitted until 2026-06-07 16:02:56.780423082 +0000 UTC m=+34.178360018 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs") pod "network-metrics-daemon-c9g56" (UID: "ec607386-1984-4a48-8b69-eb23b7525b9f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:40.881187 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:40.881148 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwb78\" (UniqueName: \"kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78\") pod \"network-check-target-jsqrs\" (UID: \"b9b1b9ac-e584-4249-aece-b6dc05d9bec6\") " pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:40.881358 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:40.881343 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:02:40.881419 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:40.881365 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:02:40.881419 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:40.881378 2579 projected.go:196] Error preparing data for projected volume kube-api-access-kwb78 for pod openshift-network-diagnostics/network-check-target-jsqrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:40.881511 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:40.881453 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78 podName:b9b1b9ac-e584-4249-aece-b6dc05d9bec6 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:56.881434012 +0000 UTC m=+34.279370944 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwb78" (UniqueName: "kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78") pod "network-check-target-jsqrs" (UID: "b9b1b9ac-e584-4249-aece-b6dc05d9bec6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:41.001168 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:41.001134 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:41.001345 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:41.001134 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:41.001345 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:41.001288 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsqrs" podUID="b9b1b9ac-e584-4249-aece-b6dc05d9bec6" Jun 07 16:02:41.001453 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:41.001345 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg8vx" podUID="9885b2fd-1551-4bfc-9e75-18c6b4ff31aa" Jun 07 16:02:42.001440 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:42.001409 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:42.001880 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:42.001552 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9g56" podUID="ec607386-1984-4a48-8b69-eb23b7525b9f" Jun 07 16:02:43.002528 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:43.002490 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:43.002995 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:43.002612 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsqrs" podUID="b9b1b9ac-e584-4249-aece-b6dc05d9bec6" Jun 07 16:02:43.002995 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:43.002671 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:43.002995 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:43.002785 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg8vx" podUID="9885b2fd-1551-4bfc-9e75-18c6b4ff31aa" Jun 07 16:02:44.001852 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:44.001816 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:44.002030 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:44.001941 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9g56" podUID="ec607386-1984-4a48-8b69-eb23b7525b9f" Jun 07 16:02:45.002129 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:45.001813 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:45.002129 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:45.001858 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:45.002129 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:45.001936 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsqrs" podUID="b9b1b9ac-e584-4249-aece-b6dc05d9bec6" Jun 07 16:02:45.002517 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:45.002188 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg8vx" podUID="9885b2fd-1551-4bfc-9e75-18c6b4ff31aa" Jun 07 16:02:45.119825 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:45.119563 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mj7mp" event={"ID":"0c49c912-24d0-4c26-9a89-46f6e3cec1b2","Type":"ContainerStarted","Data":"d03e0996808aade51d5e9eef53e5e6561ab783c70ef09eadcd6cb0a815defa45"} Jun 07 16:02:46.001336 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:46.001137 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:46.001511 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:46.001425 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9g56" podUID="ec607386-1984-4a48-8b69-eb23b7525b9f" Jun 07 16:02:46.123186 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:46.123149 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" event={"ID":"f217cd29-4c36-4393-93b0-74f66d9c4b64","Type":"ContainerStarted","Data":"35871966420fa41fb1d6b4b2e00c74816300cdd48343d339092df361c0f8aae9"} Jun 07 16:02:46.124796 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:46.124745 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wfs76" event={"ID":"6a7766ae-5bce-436a-ba5d-40bf36fc0d7c","Type":"ContainerStarted","Data":"3296b0c3a86b5cc2ecd9dfb32867e778b7022101faa90a6fcf72a3414aa25b72"} Jun 07 16:02:46.127115 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:46.127088 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" event={"ID":"34644d4d-1eda-4b1c-a925-e246163f9252","Type":"ContainerStarted","Data":"8d8b7b399e797915671c24204423225189f12cf4002902bda57b6ed57bbe832e"} Jun 07 16:02:46.128845 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:46.128817 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sh4jr" event={"ID":"ac34f759-ee32-402b-8ba7-b99a4983eb62","Type":"ContainerStarted","Data":"f5eef4ef3af1e2512f98220a583ec08556f735fa21d7f7b14288ebf8f8fb8a4f"} Jun 07 16:02:46.130911 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:46.130882 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4r4mr" event={"ID":"4f808007-b5eb-4a1a-a186-0a90489f7102","Type":"ContainerStarted","Data":"36bb2a0f7a39863ffc03f821d3e3e152bf18fd98bb2a4eca281a479d94204334"} Jun 07 16:02:46.133696 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:46.133678 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-826vv_7734bfb1-0434-4329-b54a-0069b78b45b1/ovn-acl-logging/0.log" Jun 07 16:02:46.134016 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:46.133990 2579 generic.go:356] "Generic (PLEG): container finished" podID="7734bfb1-0434-4329-b54a-0069b78b45b1" containerID="c1521da2b3c5f7d45efa3f93a6a37bba897a498ac5fdd961bbabba42639c313e" exitCode=1 Jun 07 16:02:46.134078 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:46.134056 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-826vv" event={"ID":"7734bfb1-0434-4329-b54a-0069b78b45b1","Type":"ContainerStarted","Data":"7e5f711b587afbc4ee23af1613dc38aced4a48b7eac79bb79d3edca01363730d"} Jun 07 16:02:46.134150 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:46.134134 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-826vv" event={"ID":"7734bfb1-0434-4329-b54a-0069b78b45b1","Type":"ContainerStarted","Data":"863c5e17dd13bab48f1c0354f7430e2b041da6dff9a5f213929cbe317763d992"} Jun 07 16:02:46.134205 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:46.134192 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-826vv" event={"ID":"7734bfb1-0434-4329-b54a-0069b78b45b1","Type":"ContainerStarted","Data":"f962a995016bca6fcce25d7d2315eff23f0fed08eddf0a881c1f492ef7a094db"} Jun 07 16:02:46.134254 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:46.134243 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-826vv" event={"ID":"7734bfb1-0434-4329-b54a-0069b78b45b1","Type":"ContainerStarted","Data":"d03b06ff1cd81f307d3cbac65bfe4b4d8328841e92ce38ce3d7fc84ad00f101e"} Jun 07 16:02:46.134303 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:46.134278 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-826vv" event={"ID":"7734bfb1-0434-4329-b54a-0069b78b45b1","Type":"ContainerDied","Data":"c1521da2b3c5f7d45efa3f93a6a37bba897a498ac5fdd961bbabba42639c313e"} Jun 07 16:02:46.134463 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:46.134319 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-826vv" event={"ID":"7734bfb1-0434-4329-b54a-0069b78b45b1","Type":"ContainerStarted","Data":"522eaed21ab9c4b7b80354afe835725ce964d9245ec61c105a19709f8e0c69c1"} Jun 07 16:02:46.135662 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:46.135639 2579 generic.go:356] "Generic (PLEG): container finished" podID="d71a3072-92cb-4580-9260-0579a591a6a5" containerID="1c4caaec3f473881b53adbb7777a059029432498e316a13586199d145c2bd9b3" exitCode=0 Jun 07 16:02:46.135740 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:46.135712 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdls5" event={"ID":"d71a3072-92cb-4580-9260-0579a591a6a5","Type":"ContainerDied","Data":"1c4caaec3f473881b53adbb7777a059029432498e316a13586199d145c2bd9b3"} Jun 07 16:02:46.139222 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:46.139189 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wlrgs" podStartSLOduration=4.148220946 podStartE2EDuration="23.139178892s" totalImagesPullingTime="18.990957946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:46.139044872 +0000 UTC m=+23.536981813" watchObservedRunningTime="2026-06-07 16:02:46.139178892 +0000 UTC m=+23.537115830" Jun 07 16:02:46.167398 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:46.167361 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mj7mp" podStartSLOduration=8.866587804 podStartE2EDuration="23.167347198s" totalImagesPullingTime="14.300759394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:46.153936091 +0000 UTC m=+23.551873032" watchObservedRunningTime="2026-06-07 16:02:46.167347198 +0000 UTC m=+23.565284170" Jun 07 16:02:46.167524 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:46.167507 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sh4jr" podStartSLOduration=4.223055764 podStartE2EDuration="23.167503169s" totalImagesPullingTime="18.944447405s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:46.167177969 +0000 UTC m=+23.565114911" watchObservedRunningTime="2026-06-07 16:02:46.167503169 +0000 UTC m=+23.565440110" Jun 07 16:02:46.201495 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:46.201439 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4r4mr" podStartSLOduration=4.172141904 podStartE2EDuration="23.20141878s" totalImagesPullingTime="19.029276876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:46.201019014 +0000 UTC m=+23.598955956" watchObservedRunningTime="2026-06-07 16:02:46.20141878 +0000 UTC m=+23.599355723" Jun 07 16:02:46.201692 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:46.201676 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 07 16:02:46.227973 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:46.227902 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wfs76" podStartSLOduration=4.286549432 podStartE2EDuration="23.227888103s" totalImagesPullingTime="18.941338671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:46.227560824 +0000 UTC m=+23.625497765" watchObservedRunningTime="2026-06-07 16:02:46.227888103 +0000 UTC m=+23.625825044" Jun 07 16:02:47.002231 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:47.001799 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:47.002231 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:47.001804 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:47.002231 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:47.001932 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsqrs" podUID="b9b1b9ac-e584-4249-aece-b6dc05d9bec6" Jun 07 16:02:47.002231 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:47.002015 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg8vx" podUID="9885b2fd-1551-4bfc-9e75-18c6b4ff31aa" Jun 07 16:02:47.014302 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:47.014208 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-07T16:02:46.201691495Z","UUID":"b9f3917e-fe62-4481-8f3f-03b2bd8d6e72","Handler":null,"Name":"","Endpoint":""} Jun 07 16:02:47.016044 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:47.015999 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 07 16:02:47.016044 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:47.016042 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 07 16:02:47.139692 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:47.139650 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gdjlh" event={"ID":"059fd790-5e62-46cf-912c-5770926fce96","Type":"ContainerStarted","Data":"25eb32cf1a82ccc2f82c9a8b8b5bb1f190eac79062dd8fa89bd37f500686bb2f"} Jun 07 16:02:47.141800 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:47.141751 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" event={"ID":"34644d4d-1eda-4b1c-a925-e246163f9252","Type":"ContainerStarted","Data":"6125a1e68da3a49e926d893865ea53763bf358a864c69a08f1702696fbe06ebf"} Jun 07 16:02:47.154699 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:47.154661 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gdjlh" podStartSLOduration=5.152067275 podStartE2EDuration="24.154648615s" totalImagesPullingTime="19.00258134s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:47.154101494 +0000 UTC m=+24.552038436" watchObservedRunningTime="2026-06-07 16:02:47.154648615 +0000 UTC m=+24.552585558" Jun 07 16:02:47.637834 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:47.637739 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mj7mp" Jun 07 16:02:47.638391 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:47.638367 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mj7mp" Jun 07 16:02:48.001814 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:48.001778 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:48.001964 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:48.001920 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9g56" podUID="ec607386-1984-4a48-8b69-eb23b7525b9f" Jun 07 16:02:48.149376 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:48.149339 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" event={"ID":"34644d4d-1eda-4b1c-a925-e246163f9252","Type":"ContainerStarted","Data":"f8f7c8e982743dca048a68bf919644ce4037ba68060a36751f5271ca6be421df"} Jun 07 16:02:48.153806 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:48.153719 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-826vv_7734bfb1-0434-4329-b54a-0069b78b45b1/ovn-acl-logging/0.log" Jun 07 16:02:48.154196 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:48.154170 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-826vv" event={"ID":"7734bfb1-0434-4329-b54a-0069b78b45b1","Type":"ContainerStarted","Data":"cdf7e013265d90418e5e77666893031adb2127fdfcbda1a4710a436a6dae7af1"} Jun 07 16:02:48.154349 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:48.154331 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mj7mp" Jun 07 16:02:48.154896 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:48.154882 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mj7mp" Jun 07 16:02:48.165641 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:48.165595 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpkpp" podStartSLOduration=4.224249146 podStartE2EDuration="25.165581373s" totalImagesPullingTime="20.941332227s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:02:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:48.164998853 +0000 UTC m=+25.562935807" watchObservedRunningTime="2026-06-07 16:02:48.165581373 +0000 UTC m=+25.563518314" Jun 07 16:02:49.001509 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:49.001300 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:49.001684 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:49.001355 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:49.001684 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:49.001603 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsqrs" podUID="b9b1b9ac-e584-4249-aece-b6dc05d9bec6" Jun 07 16:02:49.001785 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:49.001713 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg8vx" podUID="9885b2fd-1551-4bfc-9e75-18c6b4ff31aa" Jun 07 16:02:50.001708 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:50.001665 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:50.002115 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:50.001823 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9g56" podUID="ec607386-1984-4a48-8b69-eb23b7525b9f" Jun 07 16:02:51.002057 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:51.001794 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:51.002831 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:51.001806 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:51.002831 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:51.002168 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg8vx" podUID="9885b2fd-1551-4bfc-9e75-18c6b4ff31aa" Jun 07 16:02:51.002831 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:51.002225 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsqrs" podUID="b9b1b9ac-e584-4249-aece-b6dc05d9bec6" Jun 07 16:02:51.164524 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:51.164495 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-826vv_7734bfb1-0434-4329-b54a-0069b78b45b1/ovn-acl-logging/0.log" Jun 07 16:02:51.164928 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:51.164895 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-826vv" event={"ID":"7734bfb1-0434-4329-b54a-0069b78b45b1","Type":"ContainerStarted","Data":"d2d25c1ad030b789db57f8cbe08aeaa3049fe96749a91936b3c9f32f4aa06a33"} Jun 07 16:02:51.165133 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:51.165111 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:51.165306 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:51.165288 2579 scope.go:117] "RemoveContainer" containerID="c1521da2b3c5f7d45efa3f93a6a37bba897a498ac5fdd961bbabba42639c313e" Jun 07 16:02:51.167243 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:51.167217 2579 generic.go:356] "Generic (PLEG): container finished" podID="d71a3072-92cb-4580-9260-0579a591a6a5" containerID="7e77316ab6d513892445771ebb8b8d5e8406493ac4a2e461afefac9ba2384302" exitCode=0 Jun 07 16:02:51.167330 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:51.167262 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdls5" event={"ID":"d71a3072-92cb-4580-9260-0579a591a6a5","Type":"ContainerDied","Data":"7e77316ab6d513892445771ebb8b8d5e8406493ac4a2e461afefac9ba2384302"} Jun 07 16:02:51.182720 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:51.182700 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:52.000874 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:52.000837 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:52.001085 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:52.000957 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9g56" podUID="ec607386-1984-4a48-8b69-eb23b7525b9f" Jun 07 16:02:52.172824 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:52.172802 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-826vv_7734bfb1-0434-4329-b54a-0069b78b45b1/ovn-acl-logging/0.log" Jun 07 16:02:52.173272 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:52.173135 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-826vv" event={"ID":"7734bfb1-0434-4329-b54a-0069b78b45b1","Type":"ContainerStarted","Data":"734dc4b1e8be805d0c66263438ab6ca2fe2a873ffd5aacef1849ccf38479a5cc"} Jun 07 16:02:52.173368 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:52.173344 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:52.173426 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:52.173414 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:52.188831 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:52.188809 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:02:52.199300 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:52.199254 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-826vv" podStartSLOduration=10.116657922 podStartE2EDuration="29.199239577s" totalImagesPullingTime="19.082581655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:02:52.198078334 +0000 UTC m=+29.596015276" watchObservedRunningTime="2026-06-07 16:02:52.199239577 +0000 UTC m=+29.597176519" Jun 07 16:02:52.321643 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:52.321610 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lg8vx"] Jun 07 16:02:52.321884 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:52.321864 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:52.322028 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:52.321985 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg8vx" podUID="9885b2fd-1551-4bfc-9e75-18c6b4ff31aa" Jun 07 16:02:52.322741 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:52.322717 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jsqrs"] Jun 07 16:02:52.322868 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:52.322839 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:52.322960 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:52.322937 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsqrs" podUID="b9b1b9ac-e584-4249-aece-b6dc05d9bec6" Jun 07 16:02:52.323607 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:52.323580 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c9g56"] Jun 07 16:02:52.323700 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:52.323682 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:52.323832 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:52.323808 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9g56" podUID="ec607386-1984-4a48-8b69-eb23b7525b9f" Jun 07 16:02:53.177675 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:53.177632 2579 generic.go:356] "Generic (PLEG): container finished" podID="d71a3072-92cb-4580-9260-0579a591a6a5" containerID="ff020040645eeec664fd998fdbd9b3acb7190d9c6f677b891b06385b23882ff2" exitCode=0 Jun 07 16:02:53.178102 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:53.177723 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdls5" event={"ID":"d71a3072-92cb-4580-9260-0579a591a6a5","Type":"ContainerDied","Data":"ff020040645eeec664fd998fdbd9b3acb7190d9c6f677b891b06385b23882ff2"} Jun 07 16:02:54.001625 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:54.001595 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:54.001818 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:54.001603 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:54.001818 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:54.001704 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsqrs" podUID="b9b1b9ac-e584-4249-aece-b6dc05d9bec6" Jun 07 16:02:54.001818 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:54.001719 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:54.002042 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:54.001853 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9g56" podUID="ec607386-1984-4a48-8b69-eb23b7525b9f" Jun 07 16:02:54.002042 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:54.002009 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg8vx" podUID="9885b2fd-1551-4bfc-9e75-18c6b4ff31aa" Jun 07 16:02:55.184838 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:55.184553 2579 generic.go:356] "Generic (PLEG): container finished" podID="d71a3072-92cb-4580-9260-0579a591a6a5" containerID="7c10144657c12f8628cc502a7f8e32d2123dade6ac4c01c15ce42da2a3f1f18e" exitCode=0 Jun 07 16:02:55.184838 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:55.184640 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdls5" event={"ID":"d71a3072-92cb-4580-9260-0579a591a6a5","Type":"ContainerDied","Data":"7c10144657c12f8628cc502a7f8e32d2123dade6ac4c01c15ce42da2a3f1f18e"} Jun 07 16:02:56.001376 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:56.001338 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:56.001563 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:56.001457 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:56.001563 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:56.001496 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:56.001691 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:56.001469 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jsqrs" podUID="b9b1b9ac-e584-4249-aece-b6dc05d9bec6" Jun 07 16:02:56.001691 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:56.001613 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9g56" podUID="ec607386-1984-4a48-8b69-eb23b7525b9f" Jun 07 16:02:56.001821 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:56.001699 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lg8vx" podUID="9885b2fd-1551-4bfc-9e75-18c6b4ff31aa" Jun 07 16:02:56.701027 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:56.700996 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret\") pod \"global-pull-secret-syncer-lg8vx\" (UID: \"9885b2fd-1551-4bfc-9e75-18c6b4ff31aa\") " pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:56.701533 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:56.701174 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:56.701533 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:56.701259 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret podName:9885b2fd-1551-4bfc-9e75-18c6b4ff31aa nodeName:}" failed. No retries permitted until 2026-06-07 16:03:28.701238479 +0000 UTC m=+66.099175427 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret") pod "global-pull-secret-syncer-lg8vx" (UID: "9885b2fd-1551-4bfc-9e75-18c6b4ff31aa") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:02:56.802304 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:56.802269 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs\") pod \"network-metrics-daemon-c9g56\" (UID: \"ec607386-1984-4a48-8b69-eb23b7525b9f\") " pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:56.802479 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:56.802397 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:56.802479 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:56.802460 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs podName:ec607386-1984-4a48-8b69-eb23b7525b9f nodeName:}" failed. No retries permitted until 2026-06-07 16:03:28.802438353 +0000 UTC m=+66.200375276 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs") pod "network-metrics-daemon-c9g56" (UID: "ec607386-1984-4a48-8b69-eb23b7525b9f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:02:56.902999 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:56.902968 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwb78\" (UniqueName: \"kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78\") pod \"network-check-target-jsqrs\" (UID: \"b9b1b9ac-e584-4249-aece-b6dc05d9bec6\") " pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:56.903202 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:56.903181 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:02:56.903255 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:56.903222 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:02:56.903255 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:56.903238 2579 projected.go:196] Error preparing data for projected volume kube-api-access-kwb78 for pod openshift-network-diagnostics/network-check-target-jsqrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:56.903317 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:56.903302 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78 podName:b9b1b9ac-e584-4249-aece-b6dc05d9bec6 nodeName:}" failed. No retries permitted until 2026-06-07 16:03:28.903282137 +0000 UTC m=+66.301219070 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kwb78" (UniqueName: "kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78") pod "network-check-target-jsqrs" (UID: "b9b1b9ac-e584-4249-aece-b6dc05d9bec6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:02:57.962636 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:57.962606 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-133.ec2.internal" event="NodeReady" Jun 07 16:02:57.963336 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:57.962792 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 07 16:02:58.001695 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.001655 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:02:58.001892 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.001802 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:02:58.001962 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.001892 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:02:58.004693 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.004670 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8hch6\"" Jun 07 16:02:58.005145 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.004974 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 07 16:02:58.005145 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.005022 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 07 16:02:58.005145 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.005025 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 07 16:02:58.005145 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.005041 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k5ngp\"" Jun 07 16:02:58.005145 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.005026 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 07 16:02:58.026207 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.026182 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5qvz9"] Jun 07 16:02:58.048115 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.048081 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-v6l9d"] Jun 07 16:02:58.048244 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.048209 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5qvz9" Jun 07 16:02:58.050360 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.050340 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g7mpp\"" Jun 07 16:02:58.050480 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.050404 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 07 16:02:58.050480 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.050340 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 07 16:02:58.062803 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.062779 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5qvz9"] Jun 07 16:02:58.062923 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.062825 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v6l9d"] Jun 07 16:02:58.062923 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.062832 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v6l9d" Jun 07 16:02:58.064848 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.064827 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 07 16:02:58.064848 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.064846 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-h275w\"" Jun 07 16:02:58.065005 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.064859 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 07 16:02:58.065005 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.064950 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 07 16:02:58.212045 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.212012 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/843ede38-3aaa-4002-843e-ae71fca510a5-tmp-dir\") pod \"dns-default-5qvz9\" (UID: \"843ede38-3aaa-4002-843e-ae71fca510a5\") " pod="openshift-dns/dns-default-5qvz9" Jun 07 16:02:58.212045 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.212051 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqlwt\" (UniqueName: \"kubernetes.io/projected/39d00b6b-37cc-4de8-ab5d-037a5080ecd0-kube-api-access-sqlwt\") pod \"ingress-canary-v6l9d\" (UID: \"39d00b6b-37cc-4de8-ab5d-037a5080ecd0\") " pod="openshift-ingress-canary/ingress-canary-v6l9d" Jun 07 16:02:58.212303 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.212092 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39d00b6b-37cc-4de8-ab5d-037a5080ecd0-cert\") pod \"ingress-canary-v6l9d\" (UID: \"39d00b6b-37cc-4de8-ab5d-037a5080ecd0\") " pod="openshift-ingress-canary/ingress-canary-v6l9d" Jun 07 16:02:58.212303 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.212161 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls\") pod \"dns-default-5qvz9\" (UID: \"843ede38-3aaa-4002-843e-ae71fca510a5\") " pod="openshift-dns/dns-default-5qvz9" Jun 07 16:02:58.212303 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.212204 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ds49\" (UniqueName: \"kubernetes.io/projected/843ede38-3aaa-4002-843e-ae71fca510a5-kube-api-access-5ds49\") pod \"dns-default-5qvz9\" (UID: \"843ede38-3aaa-4002-843e-ae71fca510a5\") " pod="openshift-dns/dns-default-5qvz9" Jun 07 16:02:58.212303 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.212232 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/843ede38-3aaa-4002-843e-ae71fca510a5-config-volume\") pod \"dns-default-5qvz9\" (UID: \"843ede38-3aaa-4002-843e-ae71fca510a5\") " pod="openshift-dns/dns-default-5qvz9" Jun 07 16:02:58.313314 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.313219 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/843ede38-3aaa-4002-843e-ae71fca510a5-tmp-dir\") pod \"dns-default-5qvz9\" (UID: \"843ede38-3aaa-4002-843e-ae71fca510a5\") " pod="openshift-dns/dns-default-5qvz9" Jun 07 16:02:58.313314 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.313275 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqlwt\" (UniqueName: \"kubernetes.io/projected/39d00b6b-37cc-4de8-ab5d-037a5080ecd0-kube-api-access-sqlwt\") pod \"ingress-canary-v6l9d\" (UID: \"39d00b6b-37cc-4de8-ab5d-037a5080ecd0\") " pod="openshift-ingress-canary/ingress-canary-v6l9d" Jun 07 16:02:58.313534 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.313325 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39d00b6b-37cc-4de8-ab5d-037a5080ecd0-cert\") pod \"ingress-canary-v6l9d\" (UID: \"39d00b6b-37cc-4de8-ab5d-037a5080ecd0\") " pod="openshift-ingress-canary/ingress-canary-v6l9d" Jun 07 16:02:58.313534 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.313363 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls\") pod \"dns-default-5qvz9\" (UID: \"843ede38-3aaa-4002-843e-ae71fca510a5\") " pod="openshift-dns/dns-default-5qvz9" Jun 07 16:02:58.313534 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.313387 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ds49\" (UniqueName: \"kubernetes.io/projected/843ede38-3aaa-4002-843e-ae71fca510a5-kube-api-access-5ds49\") pod \"dns-default-5qvz9\" (UID: \"843ede38-3aaa-4002-843e-ae71fca510a5\") " pod="openshift-dns/dns-default-5qvz9" Jun 07 16:02:58.313534 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.313413 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/843ede38-3aaa-4002-843e-ae71fca510a5-config-volume\") pod \"dns-default-5qvz9\" (UID: \"843ede38-3aaa-4002-843e-ae71fca510a5\") " pod="openshift-dns/dns-default-5qvz9" Jun 07 16:02:58.313680 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:58.313662 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:02:58.313712 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.313677 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/843ede38-3aaa-4002-843e-ae71fca510a5-tmp-dir\") pod \"dns-default-5qvz9\" (UID: \"843ede38-3aaa-4002-843e-ae71fca510a5\") " pod="openshift-dns/dns-default-5qvz9" Jun 07 16:02:58.313789 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:58.313752 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls podName:843ede38-3aaa-4002-843e-ae71fca510a5 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:58.813736536 +0000 UTC m=+36.211673459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls") pod "dns-default-5qvz9" (UID: "843ede38-3aaa-4002-843e-ae71fca510a5") : secret "dns-default-metrics-tls" not found Jun 07 16:02:58.313944 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.313930 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/843ede38-3aaa-4002-843e-ae71fca510a5-config-volume\") pod \"dns-default-5qvz9\" (UID: \"843ede38-3aaa-4002-843e-ae71fca510a5\") " pod="openshift-dns/dns-default-5qvz9" Jun 07 16:02:58.318366 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.318344 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39d00b6b-37cc-4de8-ab5d-037a5080ecd0-cert\") pod \"ingress-canary-v6l9d\" (UID: \"39d00b6b-37cc-4de8-ab5d-037a5080ecd0\") " pod="openshift-ingress-canary/ingress-canary-v6l9d" Jun 07 16:02:58.321258 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.321235 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqlwt\" (UniqueName: \"kubernetes.io/projected/39d00b6b-37cc-4de8-ab5d-037a5080ecd0-kube-api-access-sqlwt\") pod \"ingress-canary-v6l9d\" (UID: \"39d00b6b-37cc-4de8-ab5d-037a5080ecd0\") " pod="openshift-ingress-canary/ingress-canary-v6l9d" Jun 07 16:02:58.321344 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.321276 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ds49\" (UniqueName: \"kubernetes.io/projected/843ede38-3aaa-4002-843e-ae71fca510a5-kube-api-access-5ds49\") pod \"dns-default-5qvz9\" (UID: \"843ede38-3aaa-4002-843e-ae71fca510a5\") " pod="openshift-dns/dns-default-5qvz9" Jun 07 16:02:58.373641 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.373610 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v6l9d" Jun 07 16:02:58.817680 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:58.817640 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls\") pod \"dns-default-5qvz9\" (UID: \"843ede38-3aaa-4002-843e-ae71fca510a5\") " pod="openshift-dns/dns-default-5qvz9" Jun 07 16:02:58.817889 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:58.817819 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:02:58.817962 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:58.817897 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls podName:843ede38-3aaa-4002-843e-ae71fca510a5 nodeName:}" failed. No retries permitted until 2026-06-07 16:02:59.817875638 +0000 UTC m=+37.215812578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls") pod "dns-default-5qvz9" (UID: "843ede38-3aaa-4002-843e-ae71fca510a5") : secret "dns-default-metrics-tls" not found Jun 07 16:02:59.234496 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:59.234335 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v6l9d"] Jun 07 16:02:59.237699 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:02:59.237671 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d00b6b_37cc_4de8_ab5d_037a5080ecd0.slice/crio-152acdef9eb365b566ea860d6ab63a6e5ee9acad13c04d8995fcabd6733c1f0a WatchSource:0}: Error finding container 152acdef9eb365b566ea860d6ab63a6e5ee9acad13c04d8995fcabd6733c1f0a: Status 404 returned error can't find the container with id 152acdef9eb365b566ea860d6ab63a6e5ee9acad13c04d8995fcabd6733c1f0a Jun 07 16:02:59.823990 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:02:59.823949 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls\") pod \"dns-default-5qvz9\" (UID: \"843ede38-3aaa-4002-843e-ae71fca510a5\") " pod="openshift-dns/dns-default-5qvz9" Jun 07 16:02:59.824175 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:59.824129 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:02:59.824223 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:02:59.824210 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls podName:843ede38-3aaa-4002-843e-ae71fca510a5 nodeName:}" failed. No retries permitted until 2026-06-07 16:03:01.824191012 +0000 UTC m=+39.222127933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls") pod "dns-default-5qvz9" (UID: "843ede38-3aaa-4002-843e-ae71fca510a5") : secret "dns-default-metrics-tls" not found Jun 07 16:03:00.200672 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:00.200573 2579 generic.go:356] "Generic (PLEG): container finished" podID="d71a3072-92cb-4580-9260-0579a591a6a5" containerID="1e5cd2b22332aee42bff198d946f043d520be4cf38f5f11dc43707fbaa6988b9" exitCode=0 Jun 07 16:03:00.200843 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:00.200659 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdls5" event={"ID":"d71a3072-92cb-4580-9260-0579a591a6a5","Type":"ContainerDied","Data":"1e5cd2b22332aee42bff198d946f043d520be4cf38f5f11dc43707fbaa6988b9"} Jun 07 16:03:00.201984 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:00.201869 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v6l9d" event={"ID":"39d00b6b-37cc-4de8-ab5d-037a5080ecd0","Type":"ContainerStarted","Data":"152acdef9eb365b566ea860d6ab63a6e5ee9acad13c04d8995fcabd6733c1f0a"} Jun 07 16:03:01.207744 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:01.207706 2579 generic.go:356] "Generic (PLEG): container finished" podID="d71a3072-92cb-4580-9260-0579a591a6a5" containerID="45b85b94be339cc2e87385fa3880035d04183aa59d01d31035e60376b6f635db" exitCode=0 Jun 07 16:03:01.208299 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:01.207798 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdls5" event={"ID":"d71a3072-92cb-4580-9260-0579a591a6a5","Type":"ContainerDied","Data":"45b85b94be339cc2e87385fa3880035d04183aa59d01d31035e60376b6f635db"} Jun 07 16:03:01.209631 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:01.209603 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v6l9d" event={"ID":"39d00b6b-37cc-4de8-ab5d-037a5080ecd0","Type":"ContainerStarted","Data":"741dfd0f1bc1030f280b85569f22da1cd76377c2ace562d2e794eee06ec7d5a0"} Jun 07 16:03:01.245205 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:01.245107 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-v6l9d" podStartSLOduration=1.5055865609999999 podStartE2EDuration="3.245093048s" totalImagesPullingTime="1.739506487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:03:01.24336847 +0000 UTC m=+38.641305418" watchObservedRunningTime="2026-06-07 16:03:01.245093048 +0000 UTC m=+38.643029989" Jun 07 16:03:01.837378 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:01.837149 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls\") pod \"dns-default-5qvz9\" (UID: \"843ede38-3aaa-4002-843e-ae71fca510a5\") " pod="openshift-dns/dns-default-5qvz9" Jun 07 16:03:01.837576 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:03:01.837297 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:03:01.837576 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:03:01.837498 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls podName:843ede38-3aaa-4002-843e-ae71fca510a5 nodeName:}" failed. No retries permitted until 2026-06-07 16:03:05.837478401 +0000 UTC m=+43.235415334 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls") pod "dns-default-5qvz9" (UID: "843ede38-3aaa-4002-843e-ae71fca510a5") : secret "dns-default-metrics-tls" not found Jun 07 16:03:02.215603 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:02.215573 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdls5" event={"ID":"d71a3072-92cb-4580-9260-0579a591a6a5","Type":"ContainerStarted","Data":"ac7f441d970f6b04ccde6ce7f46ebf2ff16f3fb5051e0a5a948535d819de4fc9"} Jun 07 16:03:02.237060 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:02.237009 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hdls5" podStartSLOduration=9.85075569 podStartE2EDuration="39.23699263s" totalImagesPullingTime="29.38623694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:02:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:03:02.235842985 +0000 UTC m=+39.633779928" watchObservedRunningTime="2026-06-07 16:03:02.23699263 +0000 UTC m=+39.634929572" Jun 07 16:03:05.862967 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:05.862929 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls\") pod \"dns-default-5qvz9\" (UID: \"843ede38-3aaa-4002-843e-ae71fca510a5\") " pod="openshift-dns/dns-default-5qvz9" Jun 07 16:03:05.863361 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:03:05.863103 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:03:05.863361 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:03:05.863169 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls podName:843ede38-3aaa-4002-843e-ae71fca510a5 nodeName:}" failed. No retries permitted until 2026-06-07 16:03:13.863153128 +0000 UTC m=+51.261090049 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls") pod "dns-default-5qvz9" (UID: "843ede38-3aaa-4002-843e-ae71fca510a5") : secret "dns-default-metrics-tls" not found Jun 07 16:03:13.914695 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:13.914654 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls\") pod \"dns-default-5qvz9\" (UID: \"843ede38-3aaa-4002-843e-ae71fca510a5\") " pod="openshift-dns/dns-default-5qvz9" Jun 07 16:03:13.915233 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:03:13.914785 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:03:13.915233 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:03:13.914851 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls podName:843ede38-3aaa-4002-843e-ae71fca510a5 nodeName:}" failed. No retries permitted until 2026-06-07 16:03:29.914835642 +0000 UTC m=+67.312772565 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls") pod "dns-default-5qvz9" (UID: "843ede38-3aaa-4002-843e-ae71fca510a5") : secret "dns-default-metrics-tls" not found Jun 07 16:03:24.191483 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:24.191453 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-826vv" Jun 07 16:03:28.717305 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:28.717266 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret\") pod \"global-pull-secret-syncer-lg8vx\" (UID: \"9885b2fd-1551-4bfc-9e75-18c6b4ff31aa\") " pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:03:28.719419 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:28.719401 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 07 16:03:28.732122 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:28.732093 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9885b2fd-1551-4bfc-9e75-18c6b4ff31aa-original-pull-secret\") pod \"global-pull-secret-syncer-lg8vx\" (UID: \"9885b2fd-1551-4bfc-9e75-18c6b4ff31aa\") " pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:03:28.817981 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:28.817942 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs\") pod \"network-metrics-daemon-c9g56\" (UID: \"ec607386-1984-4a48-8b69-eb23b7525b9f\") " pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:03:28.820215 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:28.820197 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 07 16:03:28.828884 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:03:28.828863 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 07 16:03:28.828946 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:03:28.828936 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs podName:ec607386-1984-4a48-8b69-eb23b7525b9f nodeName:}" failed. No retries permitted until 2026-06-07 16:04:32.828917977 +0000 UTC m=+130.226854898 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs") pod "network-metrics-daemon-c9g56" (UID: "ec607386-1984-4a48-8b69-eb23b7525b9f") : secret "metrics-daemon-secret" not found Jun 07 16:03:28.918425 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:28.918390 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwb78\" (UniqueName: \"kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78\") pod \"network-check-target-jsqrs\" (UID: \"b9b1b9ac-e584-4249-aece-b6dc05d9bec6\") " pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:03:28.920796 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:28.920778 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 07 16:03:28.927423 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:28.927405 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lg8vx" Jun 07 16:03:28.930608 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:28.930584 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 07 16:03:28.942014 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:28.941992 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwb78\" (UniqueName: \"kubernetes.io/projected/b9b1b9ac-e584-4249-aece-b6dc05d9bec6-kube-api-access-kwb78\") pod \"network-check-target-jsqrs\" (UID: \"b9b1b9ac-e584-4249-aece-b6dc05d9bec6\") " pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:03:29.048015 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:29.047979 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lg8vx"] Jun 07 16:03:29.051799 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:03:29.051768 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9885b2fd_1551_4bfc_9e75_18c6b4ff31aa.slice/crio-a314538feae69ae00bc7a9c373b61769f698333cbaaca9d40eb057aab8cff5e6 WatchSource:0}: Error finding container a314538feae69ae00bc7a9c373b61769f698333cbaaca9d40eb057aab8cff5e6: Status 404 returned error can't find the container with id a314538feae69ae00bc7a9c373b61769f698333cbaaca9d40eb057aab8cff5e6 Jun 07 16:03:29.215296 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:29.215262 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k5ngp\"" Jun 07 16:03:29.223257 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:29.223231 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:03:29.279339 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:29.279303 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lg8vx" event={"ID":"9885b2fd-1551-4bfc-9e75-18c6b4ff31aa","Type":"ContainerStarted","Data":"a314538feae69ae00bc7a9c373b61769f698333cbaaca9d40eb057aab8cff5e6"} Jun 07 16:03:29.344157 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:29.344127 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jsqrs"] Jun 07 16:03:29.347400 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:03:29.347369 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9b1b9ac_e584_4249_aece_b6dc05d9bec6.slice/crio-f610d05a579e22dfb988880e8f372b539f3d5f8a9cabad459c297c4365132970 WatchSource:0}: Error finding container f610d05a579e22dfb988880e8f372b539f3d5f8a9cabad459c297c4365132970: Status 404 returned error can't find the container with id f610d05a579e22dfb988880e8f372b539f3d5f8a9cabad459c297c4365132970 Jun 07 16:03:29.925793 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:29.925696 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls\") pod \"dns-default-5qvz9\" (UID: \"843ede38-3aaa-4002-843e-ae71fca510a5\") " pod="openshift-dns/dns-default-5qvz9" Jun 07 16:03:29.926267 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:03:29.925872 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:03:29.926267 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:03:29.925961 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls podName:843ede38-3aaa-4002-843e-ae71fca510a5 nodeName:}" failed. No retries permitted until 2026-06-07 16:04:01.925939836 +0000 UTC m=+99.323876771 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls") pod "dns-default-5qvz9" (UID: "843ede38-3aaa-4002-843e-ae71fca510a5") : secret "dns-default-metrics-tls" not found Jun 07 16:03:30.284354 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:30.284317 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jsqrs" event={"ID":"b9b1b9ac-e584-4249-aece-b6dc05d9bec6","Type":"ContainerStarted","Data":"f610d05a579e22dfb988880e8f372b539f3d5f8a9cabad459c297c4365132970"} Jun 07 16:03:34.295827 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:34.295788 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lg8vx" event={"ID":"9885b2fd-1551-4bfc-9e75-18c6b4ff31aa","Type":"ContainerStarted","Data":"619d9cc9e3a79837941440c16a2d17b55596f49ca6fd0ba1404ca6bebbc88e0c"} Jun 07 16:03:34.297365 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:34.297340 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jsqrs" event={"ID":"b9b1b9ac-e584-4249-aece-b6dc05d9bec6","Type":"ContainerStarted","Data":"3bdbff06bfac1e5f3b137edb3caa697345720a65564c6e9c8ac239d0e0d1d791"} Jun 07 16:03:34.297481 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:34.297469 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:03:34.308424 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:34.308378 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lg8vx" podStartSLOduration=66.679101191 podStartE2EDuration="1m11.308363744s" totalImagesPullingTime="4.629262553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:03:34.307971004 +0000 UTC m=+71.705907947" watchObservedRunningTime="2026-06-07 16:03:34.308363744 +0000 UTC m=+71.706300663" Jun 07 16:03:34.321695 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:03:34.321639 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jsqrs" podStartSLOduration=66.992073901 podStartE2EDuration="1m11.321621227s" totalImagesPullingTime="4.329547326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:03:34.320886931 +0000 UTC m=+71.718823875" watchObservedRunningTime="2026-06-07 16:03:34.321621227 +0000 UTC m=+71.719558169" Jun 07 16:04:01.941029 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:04:01.940980 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls\") pod \"dns-default-5qvz9\" (UID: \"843ede38-3aaa-4002-843e-ae71fca510a5\") " pod="openshift-dns/dns-default-5qvz9" Jun 07 16:04:01.941422 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:04:01.941159 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:04:01.941422 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:04:01.941251 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls podName:843ede38-3aaa-4002-843e-ae71fca510a5 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:05.941232278 +0000 UTC m=+163.339169198 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls") pod "dns-default-5qvz9" (UID: "843ede38-3aaa-4002-843e-ae71fca510a5") : secret "dns-default-metrics-tls" not found Jun 07 16:04:05.302555 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:04:05.302519 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jsqrs" Jun 07 16:04:32.848023 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:04:32.847963 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs\") pod \"network-metrics-daemon-c9g56\" (UID: \"ec607386-1984-4a48-8b69-eb23b7525b9f\") " pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:04:32.848522 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:04:32.848089 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 07 16:04:32.848522 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:04:32.848173 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs podName:ec607386-1984-4a48-8b69-eb23b7525b9f nodeName:}" failed. No retries permitted until 2026-06-07 16:06:34.848156544 +0000 UTC m=+252.246093464 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs") pod "network-metrics-daemon-c9g56" (UID: "ec607386-1984-4a48-8b69-eb23b7525b9f") : secret "metrics-daemon-secret" not found Jun 07 16:05:01.020394 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:01.020313 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-c9g56" podUID="ec607386-1984-4a48-8b69-eb23b7525b9f" Jun 07 16:05:01.058619 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:01.058573 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5qvz9" podUID="843ede38-3aaa-4002-843e-ae71fca510a5" Jun 07 16:05:01.503041 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:01.503013 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5qvz9" Jun 07 16:05:05.973881 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:05.973841 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls\") pod \"dns-default-5qvz9\" (UID: \"843ede38-3aaa-4002-843e-ae71fca510a5\") " pod="openshift-dns/dns-default-5qvz9" Jun 07 16:05:05.974278 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:05.973962 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:05:05.974278 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:05.974037 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls podName:843ede38-3aaa-4002-843e-ae71fca510a5 nodeName:}" failed. No retries permitted until 2026-06-07 16:07:07.974022064 +0000 UTC m=+285.371959003 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls") pod "dns-default-5qvz9" (UID: "843ede38-3aaa-4002-843e-ae71fca510a5") : secret "dns-default-metrics-tls" not found Jun 07 16:05:12.001233 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:12.001195 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:05:34.039501 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.039460 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-bztmm"] Jun 07 16:05:34.041427 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.041409 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bztmm" Jun 07 16:05:34.043522 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.043495 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4m2pn\"" Jun 07 16:05:34.043665 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.043639 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w5mq2"] Jun 07 16:05:34.045190 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.045174 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w5mq2" Jun 07 16:05:34.046496 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.046474 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6786757f5-zfcl2"] Jun 07 16:05:34.047056 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.047032 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mcz4j\"" Jun 07 16:05:34.047056 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.047057 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:05:34.047251 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.047066 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 07 16:05:34.047930 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.047910 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 07 16:05:34.048247 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.048214 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.050301 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.050279 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 07 16:05:34.050398 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.050357 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 07 16:05:34.050398 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.050387 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 07 16:05:34.050964 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.050949 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2s77n\"" Jun 07 16:05:34.055897 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.055878 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 07 16:05:34.057010 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.056992 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-bztmm"] Jun 07 16:05:34.061845 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.061801 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jknbw\" (UniqueName: \"kubernetes.io/projected/76c58903-7159-40b6-87d3-8f3221acfa53-kube-api-access-jknbw\") pod \"network-check-source-dbd9cf844-bztmm\" (UID: \"76c58903-7159-40b6-87d3-8f3221acfa53\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bztmm" Jun 07 16:05:34.061920 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.061852 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbwvl\" (UniqueName: \"kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-kube-api-access-lbwvl\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.061920 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.061889 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-installation-pull-secrets\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.062689 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.061967 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-image-registry-private-configuration\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.062689 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.061994 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-ca-trust-extracted\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.062689 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.062033 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-bound-sa-token\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.062689 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.062058 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/deb2ae62-1445-49b9-8bfa-cdbfd4d1d256-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-w5mq2\" (UID: \"deb2ae62-1445-49b9-8bfa-cdbfd4d1d256\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w5mq2" Jun 07 16:05:34.062689 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.062186 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-certificates\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.062689 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.062287 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-trusted-ca\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.062689 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.062335 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-tls\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.062689 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.062361 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9qnn\" (UniqueName: \"kubernetes.io/projected/deb2ae62-1445-49b9-8bfa-cdbfd4d1d256-kube-api-access-q9qnn\") pod \"cluster-samples-operator-854f8b96b6-w5mq2\" (UID: \"deb2ae62-1445-49b9-8bfa-cdbfd4d1d256\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w5mq2" Jun 07 16:05:34.063527 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.063507 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w5mq2"] Jun 07 16:05:34.064325 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.064301 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6786757f5-zfcl2"] Jun 07 16:05:34.141851 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.141795 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-cbczx"] Jun 07 16:05:34.143770 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.143738 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" Jun 07 16:05:34.146116 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.146095 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:05:34.146244 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.146216 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-lwxxn\"" Jun 07 16:05:34.146402 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.146385 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 07 16:05:34.146458 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.146389 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 07 16:05:34.146975 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.146957 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 07 16:05:34.156092 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.156075 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 07 16:05:34.158971 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.158952 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-cbczx"] Jun 07 16:05:34.162674 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.162646 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-tls\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.162783 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.162685 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9qnn\" (UniqueName: \"kubernetes.io/projected/deb2ae62-1445-49b9-8bfa-cdbfd4d1d256-kube-api-access-q9qnn\") pod \"cluster-samples-operator-854f8b96b6-w5mq2\" (UID: \"deb2ae62-1445-49b9-8bfa-cdbfd4d1d256\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w5mq2" Jun 07 16:05:34.162842 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.162781 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c2fb280-4c43-451e-a2a0-3ad84cb1d977-trusted-ca\") pod \"console-operator-668fdbf85c-cbczx\" (UID: \"2c2fb280-4c43-451e-a2a0-3ad84cb1d977\") " pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" Jun 07 16:05:34.162842 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:34.162810 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:05:34.162842 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:34.162828 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6786757f5-zfcl2: secret "image-registry-tls" not found Jun 07 16:05:34.162982 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:34.162895 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-tls podName:fa72c8ed-e065-4e5c-9b92-df55d28c65c0 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:34.66287504 +0000 UTC m=+192.060811975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-tls") pod "image-registry-6786757f5-zfcl2" (UID: "fa72c8ed-e065-4e5c-9b92-df55d28c65c0") : secret "image-registry-tls" not found Jun 07 16:05:34.162982 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.162826 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jknbw\" (UniqueName: \"kubernetes.io/projected/76c58903-7159-40b6-87d3-8f3221acfa53-kube-api-access-jknbw\") pod \"network-check-source-dbd9cf844-bztmm\" (UID: \"76c58903-7159-40b6-87d3-8f3221acfa53\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bztmm" Jun 07 16:05:34.162982 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.162972 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbwvl\" (UniqueName: \"kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-kube-api-access-lbwvl\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.163140 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.163005 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c2fb280-4c43-451e-a2a0-3ad84cb1d977-serving-cert\") pod \"console-operator-668fdbf85c-cbczx\" (UID: \"2c2fb280-4c43-451e-a2a0-3ad84cb1d977\") " pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" Jun 07 16:05:34.163140 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.163041 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88f8h\" (UniqueName: \"kubernetes.io/projected/2c2fb280-4c43-451e-a2a0-3ad84cb1d977-kube-api-access-88f8h\") pod \"console-operator-668fdbf85c-cbczx\" (UID: \"2c2fb280-4c43-451e-a2a0-3ad84cb1d977\") " pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" Jun 07 16:05:34.163140 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.163076 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-installation-pull-secrets\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.163140 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.163111 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-image-registry-private-configuration\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.163395 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.163154 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-ca-trust-extracted\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.163395 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.163180 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-bound-sa-token\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.163395 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.163206 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/deb2ae62-1445-49b9-8bfa-cdbfd4d1d256-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-w5mq2\" (UID: \"deb2ae62-1445-49b9-8bfa-cdbfd4d1d256\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w5mq2" Jun 07 16:05:34.163395 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.163237 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-certificates\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.163395 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.163281 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-trusted-ca\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.163395 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.163304 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c2fb280-4c43-451e-a2a0-3ad84cb1d977-config\") pod \"console-operator-668fdbf85c-cbczx\" (UID: \"2c2fb280-4c43-451e-a2a0-3ad84cb1d977\") " pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" Jun 07 16:05:34.163686 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.163545 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-ca-trust-extracted\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.163686 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:34.163626 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 07 16:05:34.163818 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:34.163691 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deb2ae62-1445-49b9-8bfa-cdbfd4d1d256-samples-operator-tls podName:deb2ae62-1445-49b9-8bfa-cdbfd4d1d256 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:34.66367114 +0000 UTC m=+192.061608061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/deb2ae62-1445-49b9-8bfa-cdbfd4d1d256-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-w5mq2" (UID: "deb2ae62-1445-49b9-8bfa-cdbfd4d1d256") : secret "samples-operator-tls" not found Jun 07 16:05:34.163818 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.163799 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-certificates\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.164292 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.164267 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-trusted-ca\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.165673 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.165652 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-installation-pull-secrets\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.165808 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.165779 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-image-registry-private-configuration\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.176474 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.176448 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9qnn\" (UniqueName: \"kubernetes.io/projected/deb2ae62-1445-49b9-8bfa-cdbfd4d1d256-kube-api-access-q9qnn\") pod \"cluster-samples-operator-854f8b96b6-w5mq2\" (UID: \"deb2ae62-1445-49b9-8bfa-cdbfd4d1d256\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w5mq2" Jun 07 16:05:34.176474 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.176452 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jknbw\" (UniqueName: \"kubernetes.io/projected/76c58903-7159-40b6-87d3-8f3221acfa53-kube-api-access-jknbw\") pod \"network-check-source-dbd9cf844-bztmm\" (UID: \"76c58903-7159-40b6-87d3-8f3221acfa53\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bztmm" Jun 07 16:05:34.177180 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.177162 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbwvl\" (UniqueName: \"kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-kube-api-access-lbwvl\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.177526 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.177505 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-bound-sa-token\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.264155 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.264116 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c2fb280-4c43-451e-a2a0-3ad84cb1d977-config\") pod \"console-operator-668fdbf85c-cbczx\" (UID: \"2c2fb280-4c43-451e-a2a0-3ad84cb1d977\") " pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" Jun 07 16:05:34.264337 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.264188 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c2fb280-4c43-451e-a2a0-3ad84cb1d977-trusted-ca\") pod \"console-operator-668fdbf85c-cbczx\" (UID: \"2c2fb280-4c43-451e-a2a0-3ad84cb1d977\") " pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" Jun 07 16:05:34.264337 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.264240 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c2fb280-4c43-451e-a2a0-3ad84cb1d977-serving-cert\") pod \"console-operator-668fdbf85c-cbczx\" (UID: \"2c2fb280-4c43-451e-a2a0-3ad84cb1d977\") " pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" Jun 07 16:05:34.264337 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.264269 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88f8h\" (UniqueName: \"kubernetes.io/projected/2c2fb280-4c43-451e-a2a0-3ad84cb1d977-kube-api-access-88f8h\") pod \"console-operator-668fdbf85c-cbczx\" (UID: \"2c2fb280-4c43-451e-a2a0-3ad84cb1d977\") " pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" Jun 07 16:05:34.264852 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.264830 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c2fb280-4c43-451e-a2a0-3ad84cb1d977-config\") pod \"console-operator-668fdbf85c-cbczx\" (UID: \"2c2fb280-4c43-451e-a2a0-3ad84cb1d977\") " pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" Jun 07 16:05:34.265055 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.265000 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c2fb280-4c43-451e-a2a0-3ad84cb1d977-trusted-ca\") pod \"console-operator-668fdbf85c-cbczx\" (UID: \"2c2fb280-4c43-451e-a2a0-3ad84cb1d977\") " pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" Jun 07 16:05:34.266592 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.266575 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c2fb280-4c43-451e-a2a0-3ad84cb1d977-serving-cert\") pod \"console-operator-668fdbf85c-cbczx\" (UID: \"2c2fb280-4c43-451e-a2a0-3ad84cb1d977\") " pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" Jun 07 16:05:34.272027 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.272008 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88f8h\" (UniqueName: \"kubernetes.io/projected/2c2fb280-4c43-451e-a2a0-3ad84cb1d977-kube-api-access-88f8h\") pod \"console-operator-668fdbf85c-cbczx\" (UID: \"2c2fb280-4c43-451e-a2a0-3ad84cb1d977\") " pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" Jun 07 16:05:34.352980 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.352897 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bztmm" Jun 07 16:05:34.453134 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.453102 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" Jun 07 16:05:34.475304 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.475265 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-bztmm"] Jun 07 16:05:34.481557 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:05:34.481522 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76c58903_7159_40b6_87d3_8f3221acfa53.slice/crio-e863d7e7e012ad13600241f062ff030df68ed9aa3c6e9953c9a15d122065ce34 WatchSource:0}: Error finding container e863d7e7e012ad13600241f062ff030df68ed9aa3c6e9953c9a15d122065ce34: Status 404 returned error can't find the container with id e863d7e7e012ad13600241f062ff030df68ed9aa3c6e9953c9a15d122065ce34 Jun 07 16:05:34.579862 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.579835 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-cbczx"] Jun 07 16:05:34.581867 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.581839 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bztmm" event={"ID":"76c58903-7159-40b6-87d3-8f3221acfa53","Type":"ContainerStarted","Data":"0432e8792eb3b6037d4b4757f129555261ec352a91aa752bcc6bfb4bfaadbcc1"} Jun 07 16:05:34.581986 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.581888 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bztmm" event={"ID":"76c58903-7159-40b6-87d3-8f3221acfa53","Type":"ContainerStarted","Data":"e863d7e7e012ad13600241f062ff030df68ed9aa3c6e9953c9a15d122065ce34"} Jun 07 16:05:34.583103 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:05:34.583084 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c2fb280_4c43_451e_a2a0_3ad84cb1d977.slice/crio-6c2f3f7fdd3f714e9eb5662a7035a88e469a9e65d5828696fd841cb77fd910cb WatchSource:0}: Error finding container 6c2f3f7fdd3f714e9eb5662a7035a88e469a9e65d5828696fd841cb77fd910cb: Status 404 returned error can't find the container with id 6c2f3f7fdd3f714e9eb5662a7035a88e469a9e65d5828696fd841cb77fd910cb Jun 07 16:05:34.595965 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.595912 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-bztmm" podStartSLOduration=0.595892286 podStartE2EDuration="595.892286ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:05:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:05:34.595231964 +0000 UTC m=+191.993168899" watchObservedRunningTime="2026-06-07 16:05:34.595892286 +0000 UTC m=+191.993829230" Jun 07 16:05:34.666954 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.666859 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/deb2ae62-1445-49b9-8bfa-cdbfd4d1d256-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-w5mq2\" (UID: \"deb2ae62-1445-49b9-8bfa-cdbfd4d1d256\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w5mq2" Jun 07 16:05:34.666954 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:34.666927 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-tls\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:34.667184 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:34.667015 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 07 16:05:34.667184 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:34.667069 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:05:34.667184 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:34.667085 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6786757f5-zfcl2: secret "image-registry-tls" not found Jun 07 16:05:34.667184 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:34.667098 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deb2ae62-1445-49b9-8bfa-cdbfd4d1d256-samples-operator-tls podName:deb2ae62-1445-49b9-8bfa-cdbfd4d1d256 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:35.667076522 +0000 UTC m=+193.065013445 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/deb2ae62-1445-49b9-8bfa-cdbfd4d1d256-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-w5mq2" (UID: "deb2ae62-1445-49b9-8bfa-cdbfd4d1d256") : secret "samples-operator-tls" not found Jun 07 16:05:34.667184 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:34.667119 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-tls podName:fa72c8ed-e065-4e5c-9b92-df55d28c65c0 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:35.667108588 +0000 UTC m=+193.065045508 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-tls") pod "image-registry-6786757f5-zfcl2" (UID: "fa72c8ed-e065-4e5c-9b92-df55d28c65c0") : secret "image-registry-tls" not found Jun 07 16:05:35.586034 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:35.585992 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" event={"ID":"2c2fb280-4c43-451e-a2a0-3ad84cb1d977","Type":"ContainerStarted","Data":"6c2f3f7fdd3f714e9eb5662a7035a88e469a9e65d5828696fd841cb77fd910cb"} Jun 07 16:05:35.674278 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:35.674243 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-tls\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:35.674434 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:35.674346 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/deb2ae62-1445-49b9-8bfa-cdbfd4d1d256-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-w5mq2\" (UID: \"deb2ae62-1445-49b9-8bfa-cdbfd4d1d256\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w5mq2" Jun 07 16:05:35.674434 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:35.674401 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:05:35.674434 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:35.674425 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6786757f5-zfcl2: secret "image-registry-tls" not found Jun 07 16:05:35.674582 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:35.674464 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 07 16:05:35.674582 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:35.674493 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-tls podName:fa72c8ed-e065-4e5c-9b92-df55d28c65c0 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:37.674472784 +0000 UTC m=+195.072409704 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-tls") pod "image-registry-6786757f5-zfcl2" (UID: "fa72c8ed-e065-4e5c-9b92-df55d28c65c0") : secret "image-registry-tls" not found Jun 07 16:05:35.674582 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:35.674518 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deb2ae62-1445-49b9-8bfa-cdbfd4d1d256-samples-operator-tls podName:deb2ae62-1445-49b9-8bfa-cdbfd4d1d256 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:37.674501197 +0000 UTC m=+195.072438134 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/deb2ae62-1445-49b9-8bfa-cdbfd4d1d256-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-w5mq2" (UID: "deb2ae62-1445-49b9-8bfa-cdbfd4d1d256") : secret "samples-operator-tls" not found Jun 07 16:05:36.590073 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:36.590032 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" event={"ID":"2c2fb280-4c43-451e-a2a0-3ad84cb1d977","Type":"ContainerStarted","Data":"d5c504a5e838067b763970e2e8d5997f826ff7c5431cc639dc091f26f3b0582a"} Jun 07 16:05:36.590456 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:36.590206 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" Jun 07 16:05:36.591379 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:36.591355 2579 patch_prober.go:28] interesting pod/console-operator-668fdbf85c-cbczx container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.134.0.11:8443/readyz\": dial tcp 10.134.0.11:8443: connect: connection refused" start-of-body= Jun 07 16:05:36.591449 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:36.591405 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" podUID="2c2fb280-4c43-451e-a2a0-3ad84cb1d977" containerName="console-operator" probeResult="failure" output="Get \"https://10.134.0.11:8443/readyz\": dial tcp 10.134.0.11:8443: connect: connection refused" Jun 07 16:05:36.605135 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:36.605095 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" podStartSLOduration=0.70185993 podStartE2EDuration="2.60508037s" totalImagesPullingTime="1.90322044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:05:36.603695656 +0000 UTC m=+194.001632599" watchObservedRunningTime="2026-06-07 16:05:36.60508037 +0000 UTC m=+194.003017312" Jun 07 16:05:37.595044 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:37.595016 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cbczx_2c2fb280-4c43-451e-a2a0-3ad84cb1d977/console-operator/0.log" Jun 07 16:05:37.595418 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:37.595055 2579 generic.go:356] "Generic (PLEG): container finished" podID="2c2fb280-4c43-451e-a2a0-3ad84cb1d977" containerID="d5c504a5e838067b763970e2e8d5997f826ff7c5431cc639dc091f26f3b0582a" exitCode=255 Jun 07 16:05:37.595418 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:37.595102 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" event={"ID":"2c2fb280-4c43-451e-a2a0-3ad84cb1d977","Type":"ContainerDied","Data":"d5c504a5e838067b763970e2e8d5997f826ff7c5431cc639dc091f26f3b0582a"} Jun 07 16:05:37.595418 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:37.595336 2579 scope.go:117] "RemoveContainer" containerID="d5c504a5e838067b763970e2e8d5997f826ff7c5431cc639dc091f26f3b0582a" Jun 07 16:05:37.689101 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:37.689062 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/deb2ae62-1445-49b9-8bfa-cdbfd4d1d256-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-w5mq2\" (UID: \"deb2ae62-1445-49b9-8bfa-cdbfd4d1d256\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w5mq2" Jun 07 16:05:37.689293 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:37.689125 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-tls\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:37.689293 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:37.689231 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 07 16:05:37.689293 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:37.689247 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:05:37.689293 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:37.689266 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6786757f5-zfcl2: secret "image-registry-tls" not found Jun 07 16:05:37.689470 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:37.689305 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deb2ae62-1445-49b9-8bfa-cdbfd4d1d256-samples-operator-tls podName:deb2ae62-1445-49b9-8bfa-cdbfd4d1d256 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:41.68928454 +0000 UTC m=+199.087221462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/deb2ae62-1445-49b9-8bfa-cdbfd4d1d256-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-w5mq2" (UID: "deb2ae62-1445-49b9-8bfa-cdbfd4d1d256") : secret "samples-operator-tls" not found Jun 07 16:05:37.689470 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:37.689387 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-tls podName:fa72c8ed-e065-4e5c-9b92-df55d28c65c0 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:41.689361679 +0000 UTC m=+199.087298614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-tls") pod "image-registry-6786757f5-zfcl2" (UID: "fa72c8ed-e065-4e5c-9b92-df55d28c65c0") : secret "image-registry-tls" not found Jun 07 16:05:38.600044 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:38.600014 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cbczx_2c2fb280-4c43-451e-a2a0-3ad84cb1d977/console-operator/1.log" Jun 07 16:05:38.600480 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:38.600433 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cbczx_2c2fb280-4c43-451e-a2a0-3ad84cb1d977/console-operator/0.log" Jun 07 16:05:38.600551 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:38.600473 2579 generic.go:356] "Generic (PLEG): container finished" podID="2c2fb280-4c43-451e-a2a0-3ad84cb1d977" containerID="f7b4ebfb6cb2d4ca131e83781371f828a9a1054d4b995732a1e420c50c5451ed" exitCode=255 Jun 07 16:05:38.600551 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:38.600519 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" event={"ID":"2c2fb280-4c43-451e-a2a0-3ad84cb1d977","Type":"ContainerDied","Data":"f7b4ebfb6cb2d4ca131e83781371f828a9a1054d4b995732a1e420c50c5451ed"} Jun 07 16:05:38.600643 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:38.600574 2579 scope.go:117] "RemoveContainer" containerID="d5c504a5e838067b763970e2e8d5997f826ff7c5431cc639dc091f26f3b0582a" Jun 07 16:05:38.600818 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:38.600800 2579 scope.go:117] "RemoveContainer" containerID="f7b4ebfb6cb2d4ca131e83781371f828a9a1054d4b995732a1e420c50c5451ed" Jun 07 16:05:38.601006 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:38.600986 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-cbczx_openshift-console-operator(2c2fb280-4c43-451e-a2a0-3ad84cb1d977)\"" pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" podUID="2c2fb280-4c43-451e-a2a0-3ad84cb1d977" Jun 07 16:05:39.604438 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:39.604404 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cbczx_2c2fb280-4c43-451e-a2a0-3ad84cb1d977/console-operator/1.log" Jun 07 16:05:39.604908 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:39.604697 2579 scope.go:117] "RemoveContainer" containerID="f7b4ebfb6cb2d4ca131e83781371f828a9a1054d4b995732a1e420c50c5451ed" Jun 07 16:05:39.604908 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:39.604856 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-cbczx_openshift-console-operator(2c2fb280-4c43-451e-a2a0-3ad84cb1d977)\"" pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" podUID="2c2fb280-4c43-451e-a2a0-3ad84cb1d977" Jun 07 16:05:40.706232 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:40.706199 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-8856t"] Jun 07 16:05:40.709059 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:40.709043 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8856t" Jun 07 16:05:40.711181 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:40.711158 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5wr4n\"" Jun 07 16:05:40.711317 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:40.711199 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 07 16:05:40.711317 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:40.711203 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 07 16:05:40.715577 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:40.715166 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-8856t"] Jun 07 16:05:40.814152 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:40.814117 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb57m\" (UniqueName: \"kubernetes.io/projected/5472e974-3d92-48b3-abaf-e4405d0b6a36-kube-api-access-nb57m\") pod \"migrator-955ffdf5f-8856t\" (UID: \"5472e974-3d92-48b3-abaf-e4405d0b6a36\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8856t" Jun 07 16:05:40.915216 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:40.915183 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb57m\" (UniqueName: \"kubernetes.io/projected/5472e974-3d92-48b3-abaf-e4405d0b6a36-kube-api-access-nb57m\") pod \"migrator-955ffdf5f-8856t\" (UID: \"5472e974-3d92-48b3-abaf-e4405d0b6a36\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8856t" Jun 07 16:05:40.922718 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:40.922686 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb57m\" (UniqueName: \"kubernetes.io/projected/5472e974-3d92-48b3-abaf-e4405d0b6a36-kube-api-access-nb57m\") pod \"migrator-955ffdf5f-8856t\" (UID: \"5472e974-3d92-48b3-abaf-e4405d0b6a36\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8856t" Jun 07 16:05:41.017871 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:41.017795 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8856t" Jun 07 16:05:41.138189 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:41.138149 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-8856t"] Jun 07 16:05:41.141598 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:05:41.141566 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5472e974_3d92_48b3_abaf_e4405d0b6a36.slice/crio-e0e907806f519109aaf9cc4543ae510324cd5efcb9eba81e069d35160540511c WatchSource:0}: Error finding container e0e907806f519109aaf9cc4543ae510324cd5efcb9eba81e069d35160540511c: Status 404 returned error can't find the container with id e0e907806f519109aaf9cc4543ae510324cd5efcb9eba81e069d35160540511c Jun 07 16:05:41.253118 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:41.253092 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wfs76_6a7766ae-5bce-436a-ba5d-40bf36fc0d7c/dns-node-resolver/0.log" Jun 07 16:05:41.611722 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:41.611693 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8856t" event={"ID":"5472e974-3d92-48b3-abaf-e4405d0b6a36","Type":"ContainerStarted","Data":"e0e907806f519109aaf9cc4543ae510324cd5efcb9eba81e069d35160540511c"} Jun 07 16:05:41.699949 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:41.699908 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-4pr4d"] Jun 07 16:05:41.701839 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:41.701815 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-4pr4d" Jun 07 16:05:41.704205 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:41.704183 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 07 16:05:41.704307 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:41.704269 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pm545\"" Jun 07 16:05:41.705007 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:41.704988 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 07 16:05:41.705118 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:41.704987 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 07 16:05:41.705118 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:41.705014 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 07 16:05:41.709573 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:41.709548 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-4pr4d"] Jun 07 16:05:41.720738 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:41.720706 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/deb2ae62-1445-49b9-8bfa-cdbfd4d1d256-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-w5mq2\" (UID: \"deb2ae62-1445-49b9-8bfa-cdbfd4d1d256\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w5mq2" Jun 07 16:05:41.720859 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:41.720804 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-tls\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:41.720921 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:41.720859 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f9dd3ca2-d220-46fa-8219-c912e8b35608-signing-cabundle\") pod \"service-ca-7d74d578b8-4pr4d\" (UID: \"f9dd3ca2-d220-46fa-8219-c912e8b35608\") " pod="openshift-service-ca/service-ca-7d74d578b8-4pr4d" Jun 07 16:05:41.720921 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:41.720871 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 07 16:05:41.720921 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:41.720890 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f9dd3ca2-d220-46fa-8219-c912e8b35608-signing-key\") pod \"service-ca-7d74d578b8-4pr4d\" (UID: \"f9dd3ca2-d220-46fa-8219-c912e8b35608\") " pod="openshift-service-ca/service-ca-7d74d578b8-4pr4d" Jun 07 16:05:41.720921 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:41.720915 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfndm\" (UniqueName: \"kubernetes.io/projected/f9dd3ca2-d220-46fa-8219-c912e8b35608-kube-api-access-cfndm\") pod \"service-ca-7d74d578b8-4pr4d\" (UID: \"f9dd3ca2-d220-46fa-8219-c912e8b35608\") " pod="openshift-service-ca/service-ca-7d74d578b8-4pr4d" Jun 07 16:05:41.721105 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:41.720920 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:05:41.721105 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:41.720934 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deb2ae62-1445-49b9-8bfa-cdbfd4d1d256-samples-operator-tls podName:deb2ae62-1445-49b9-8bfa-cdbfd4d1d256 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:49.720914612 +0000 UTC m=+207.118851547 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/deb2ae62-1445-49b9-8bfa-cdbfd4d1d256-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-w5mq2" (UID: "deb2ae62-1445-49b9-8bfa-cdbfd4d1d256") : secret "samples-operator-tls" not found Jun 07 16:05:41.721105 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:41.720940 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6786757f5-zfcl2: secret "image-registry-tls" not found Jun 07 16:05:41.721105 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:41.720990 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-tls podName:fa72c8ed-e065-4e5c-9b92-df55d28c65c0 nodeName:}" failed. No retries permitted until 2026-06-07 16:05:49.720974153 +0000 UTC m=+207.118911094 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-tls") pod "image-registry-6786757f5-zfcl2" (UID: "fa72c8ed-e065-4e5c-9b92-df55d28c65c0") : secret "image-registry-tls" not found Jun 07 16:05:41.821941 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:41.821897 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f9dd3ca2-d220-46fa-8219-c912e8b35608-signing-cabundle\") pod \"service-ca-7d74d578b8-4pr4d\" (UID: \"f9dd3ca2-d220-46fa-8219-c912e8b35608\") " pod="openshift-service-ca/service-ca-7d74d578b8-4pr4d" Jun 07 16:05:41.821941 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:41.821940 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f9dd3ca2-d220-46fa-8219-c912e8b35608-signing-key\") pod \"service-ca-7d74d578b8-4pr4d\" (UID: \"f9dd3ca2-d220-46fa-8219-c912e8b35608\") " pod="openshift-service-ca/service-ca-7d74d578b8-4pr4d" Jun 07 16:05:41.822198 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:41.821962 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfndm\" (UniqueName: \"kubernetes.io/projected/f9dd3ca2-d220-46fa-8219-c912e8b35608-kube-api-access-cfndm\") pod \"service-ca-7d74d578b8-4pr4d\" (UID: \"f9dd3ca2-d220-46fa-8219-c912e8b35608\") " pod="openshift-service-ca/service-ca-7d74d578b8-4pr4d" Jun 07 16:05:41.822711 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:41.822677 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f9dd3ca2-d220-46fa-8219-c912e8b35608-signing-cabundle\") pod \"service-ca-7d74d578b8-4pr4d\" (UID: \"f9dd3ca2-d220-46fa-8219-c912e8b35608\") " pod="openshift-service-ca/service-ca-7d74d578b8-4pr4d" Jun 07 16:05:41.825161 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:41.825128 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f9dd3ca2-d220-46fa-8219-c912e8b35608-signing-key\") pod \"service-ca-7d74d578b8-4pr4d\" (UID: \"f9dd3ca2-d220-46fa-8219-c912e8b35608\") " pod="openshift-service-ca/service-ca-7d74d578b8-4pr4d" Jun 07 16:05:41.829427 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:41.829394 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfndm\" (UniqueName: \"kubernetes.io/projected/f9dd3ca2-d220-46fa-8219-c912e8b35608-kube-api-access-cfndm\") pod \"service-ca-7d74d578b8-4pr4d\" (UID: \"f9dd3ca2-d220-46fa-8219-c912e8b35608\") " pod="openshift-service-ca/service-ca-7d74d578b8-4pr4d" Jun 07 16:05:42.013181 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:42.013146 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-4pr4d" Jun 07 16:05:42.255137 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:42.255045 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sh4jr_ac34f759-ee32-402b-8ba7-b99a4983eb62/node-ca/0.log" Jun 07 16:05:42.334211 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:42.334181 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-4pr4d"] Jun 07 16:05:42.337278 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:05:42.337254 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9dd3ca2_d220_46fa_8219_c912e8b35608.slice/crio-f0e0498aee56f8fd6ff2f0108b50d683014132f2b1378315ecc88f1c0554f659 WatchSource:0}: Error finding container f0e0498aee56f8fd6ff2f0108b50d683014132f2b1378315ecc88f1c0554f659: Status 404 returned error can't find the container with id f0e0498aee56f8fd6ff2f0108b50d683014132f2b1378315ecc88f1c0554f659 Jun 07 16:05:42.616423 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:42.616334 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8856t" event={"ID":"5472e974-3d92-48b3-abaf-e4405d0b6a36","Type":"ContainerStarted","Data":"d87ff2ea347e1102f26881dd83ff1ec7c7a48efca4375f52ea9a8beb01510efe"} Jun 07 16:05:42.616423 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:42.616395 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8856t" event={"ID":"5472e974-3d92-48b3-abaf-e4405d0b6a36","Type":"ContainerStarted","Data":"66f171ec1fafab4bdfc16c0257c6a646502f08978f60fe5e06b7433cf9e5115e"} Jun 07 16:05:42.617387 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:42.617360 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-4pr4d" event={"ID":"f9dd3ca2-d220-46fa-8219-c912e8b35608","Type":"ContainerStarted","Data":"f0e0498aee56f8fd6ff2f0108b50d683014132f2b1378315ecc88f1c0554f659"} Jun 07 16:05:42.633038 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:42.632991 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-8856t" podStartSLOduration=1.547239066 podStartE2EDuration="2.632976947s" totalImagesPullingTime="1.085737881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:05:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:05:42.631901727 +0000 UTC m=+200.029838672" watchObservedRunningTime="2026-06-07 16:05:42.632976947 +0000 UTC m=+200.030913888" Jun 07 16:05:43.053798 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:43.053773 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v6l9d_39d00b6b-37cc-4de8-ab5d-037a5080ecd0/serve-healthcheck-canary/0.log" Jun 07 16:05:44.454090 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:44.454061 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" Jun 07 16:05:44.454427 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:44.454414 2579 scope.go:117] "RemoveContainer" containerID="f7b4ebfb6cb2d4ca131e83781371f828a9a1054d4b995732a1e420c50c5451ed" Jun 07 16:05:44.454571 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:44.454552 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-cbczx_openshift-console-operator(2c2fb280-4c43-451e-a2a0-3ad84cb1d977)\"" pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" podUID="2c2fb280-4c43-451e-a2a0-3ad84cb1d977" Jun 07 16:05:44.625019 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:44.624984 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-4pr4d" event={"ID":"f9dd3ca2-d220-46fa-8219-c912e8b35608","Type":"ContainerStarted","Data":"78b75d29eae339547f45043036dd3057a2d7b17d4cf4bd03c72665b8157ab818"} Jun 07 16:05:44.641745 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:44.641697 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-4pr4d" podStartSLOduration=1.58751482 podStartE2EDuration="3.641681785s" totalImagesPullingTime="2.054166965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:05:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:05:44.640922049 +0000 UTC m=+202.038858990" watchObservedRunningTime="2026-06-07 16:05:44.641681785 +0000 UTC m=+202.039618726" Jun 07 16:05:46.590524 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:46.590486 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" Jun 07 16:05:46.590975 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:46.590958 2579 scope.go:117] "RemoveContainer" containerID="f7b4ebfb6cb2d4ca131e83781371f828a9a1054d4b995732a1e420c50c5451ed" Jun 07 16:05:46.591167 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:05:46.591141 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-cbczx_openshift-console-operator(2c2fb280-4c43-451e-a2a0-3ad84cb1d977)\"" pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" podUID="2c2fb280-4c43-451e-a2a0-3ad84cb1d977" Jun 07 16:05:49.782845 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:49.782808 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-tls\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:49.783348 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:49.782895 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/deb2ae62-1445-49b9-8bfa-cdbfd4d1d256-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-w5mq2\" (UID: \"deb2ae62-1445-49b9-8bfa-cdbfd4d1d256\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w5mq2" Jun 07 16:05:49.785426 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:49.785405 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/deb2ae62-1445-49b9-8bfa-cdbfd4d1d256-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-w5mq2\" (UID: \"deb2ae62-1445-49b9-8bfa-cdbfd4d1d256\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w5mq2" Jun 07 16:05:49.785521 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:49.785465 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-tls\") pod \"image-registry-6786757f5-zfcl2\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:49.958868 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:49.958825 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w5mq2" Jun 07 16:05:49.966168 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:49.966134 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:50.099221 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:50.099180 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w5mq2"] Jun 07 16:05:50.114595 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:50.114565 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6786757f5-zfcl2"] Jun 07 16:05:50.120127 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:05:50.120100 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa72c8ed_e065_4e5c_9b92_df55d28c65c0.slice/crio-e2544fc4915547bcd0507a9e36c42db322793cccb20297dac9a7912a1e94da3a WatchSource:0}: Error finding container e2544fc4915547bcd0507a9e36c42db322793cccb20297dac9a7912a1e94da3a: Status 404 returned error can't find the container with id e2544fc4915547bcd0507a9e36c42db322793cccb20297dac9a7912a1e94da3a Jun 07 16:05:50.648651 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:50.648617 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6786757f5-zfcl2" event={"ID":"fa72c8ed-e065-4e5c-9b92-df55d28c65c0","Type":"ContainerStarted","Data":"cf20607297c45daf12c8902c724f7c13c22f80e9883304ac11bdd5ef26651cee"} Jun 07 16:05:50.648863 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:50.648664 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6786757f5-zfcl2" event={"ID":"fa72c8ed-e065-4e5c-9b92-df55d28c65c0","Type":"ContainerStarted","Data":"e2544fc4915547bcd0507a9e36c42db322793cccb20297dac9a7912a1e94da3a"} Jun 07 16:05:50.648863 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:50.648698 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:05:50.649816 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:50.649790 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w5mq2" event={"ID":"deb2ae62-1445-49b9-8bfa-cdbfd4d1d256","Type":"ContainerStarted","Data":"ff4e9237ffd8cbdef5d0a863a4ddf3c4d84c865f1c2cb895adbf8c3b7d3b5639"} Jun 07 16:05:50.666153 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:50.666111 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6786757f5-zfcl2" podStartSLOduration=16.666097525 podStartE2EDuration="16.666097525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:05:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:05:50.664853726 +0000 UTC m=+208.062790668" watchObservedRunningTime="2026-06-07 16:05:50.666097525 +0000 UTC m=+208.064034445" Jun 07 16:05:52.658653 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:52.658612 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w5mq2" event={"ID":"deb2ae62-1445-49b9-8bfa-cdbfd4d1d256","Type":"ContainerStarted","Data":"b06d2c5534c1628d8ac2a729ade8c0b21d2a598f60c0db41657d4684a4fcc0ce"} Jun 07 16:05:52.659129 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:52.658689 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w5mq2" event={"ID":"deb2ae62-1445-49b9-8bfa-cdbfd4d1d256","Type":"ContainerStarted","Data":"439cf0ce7c9e7cde7c9360d9e6365ab3c5eabccf21e5277fdcce74652500e76f"} Jun 07 16:05:52.675602 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:52.675535 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-w5mq2" podStartSLOduration=16.627166898 podStartE2EDuration="18.675520301s" totalImagesPullingTime="2.048353403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:05:52.675140576 +0000 UTC m=+210.073077514" watchObservedRunningTime="2026-06-07 16:05:52.675520301 +0000 UTC m=+210.073457221" Jun 07 16:05:58.001584 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:58.001542 2579 scope.go:117] "RemoveContainer" containerID="f7b4ebfb6cb2d4ca131e83781371f828a9a1054d4b995732a1e420c50c5451ed" Jun 07 16:05:58.678642 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:58.678611 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cbczx_2c2fb280-4c43-451e-a2a0-3ad84cb1d977/console-operator/1.log" Jun 07 16:05:58.678850 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:58.678672 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" event={"ID":"2c2fb280-4c43-451e-a2a0-3ad84cb1d977","Type":"ContainerStarted","Data":"d3cfd862002dc1fc8354921ebb99cefcad4387f7a7d4f9ca31a67f6ee5b22635"} Jun 07 16:05:58.678974 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:58.678953 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" Jun 07 16:05:58.683311 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:05:58.683288 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-cbczx" Jun 07 16:06:00.598191 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.598157 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ck9vn"] Jun 07 16:06:00.601487 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.601466 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ck9vn" Jun 07 16:06:00.604158 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.604131 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 07 16:06:00.604158 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.604131 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 07 16:06:00.604360 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.604132 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n8qbl\"" Jun 07 16:06:00.604360 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.604137 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 07 16:06:00.604360 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.604249 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 07 16:06:00.614840 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.614813 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ck9vn"] Jun 07 16:06:00.622255 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.622230 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6786757f5-zfcl2"] Jun 07 16:06:00.662640 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.662589 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d-crio-socket\") pod \"insights-runtime-extractor-ck9vn\" (UID: \"0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d\") " pod="openshift-insights/insights-runtime-extractor-ck9vn" Jun 07 16:06:00.662821 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.662656 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t8zz\" (UniqueName: \"kubernetes.io/projected/0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d-kube-api-access-7t8zz\") pod \"insights-runtime-extractor-ck9vn\" (UID: \"0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d\") " pod="openshift-insights/insights-runtime-extractor-ck9vn" Jun 07 16:06:00.662821 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.662683 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d-data-volume\") pod \"insights-runtime-extractor-ck9vn\" (UID: \"0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d\") " pod="openshift-insights/insights-runtime-extractor-ck9vn" Jun 07 16:06:00.662945 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.662821 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ck9vn\" (UID: \"0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d\") " pod="openshift-insights/insights-runtime-extractor-ck9vn" Jun 07 16:06:00.662945 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.662912 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ck9vn\" (UID: \"0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d\") " pod="openshift-insights/insights-runtime-extractor-ck9vn" Jun 07 16:06:00.764124 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.764088 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d-crio-socket\") pod \"insights-runtime-extractor-ck9vn\" (UID: \"0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d\") " pod="openshift-insights/insights-runtime-extractor-ck9vn" Jun 07 16:06:00.764262 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.764136 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t8zz\" (UniqueName: \"kubernetes.io/projected/0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d-kube-api-access-7t8zz\") pod \"insights-runtime-extractor-ck9vn\" (UID: \"0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d\") " pod="openshift-insights/insights-runtime-extractor-ck9vn" Jun 07 16:06:00.764262 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.764217 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d-crio-socket\") pod \"insights-runtime-extractor-ck9vn\" (UID: \"0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d\") " pod="openshift-insights/insights-runtime-extractor-ck9vn" Jun 07 16:06:00.764351 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.764260 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d-data-volume\") pod \"insights-runtime-extractor-ck9vn\" (UID: \"0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d\") " pod="openshift-insights/insights-runtime-extractor-ck9vn" Jun 07 16:06:00.764351 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.764302 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ck9vn\" (UID: \"0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d\") " pod="openshift-insights/insights-runtime-extractor-ck9vn" Jun 07 16:06:00.764411 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.764374 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ck9vn\" (UID: \"0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d\") " pod="openshift-insights/insights-runtime-extractor-ck9vn" Jun 07 16:06:00.764680 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.764642 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d-data-volume\") pod \"insights-runtime-extractor-ck9vn\" (UID: \"0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d\") " pod="openshift-insights/insights-runtime-extractor-ck9vn" Jun 07 16:06:00.764955 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.764934 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ck9vn\" (UID: \"0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d\") " pod="openshift-insights/insights-runtime-extractor-ck9vn" Jun 07 16:06:00.766819 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.766802 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ck9vn\" (UID: \"0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d\") " pod="openshift-insights/insights-runtime-extractor-ck9vn" Jun 07 16:06:00.774272 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.774249 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t8zz\" (UniqueName: \"kubernetes.io/projected/0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d-kube-api-access-7t8zz\") pod \"insights-runtime-extractor-ck9vn\" (UID: \"0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d\") " pod="openshift-insights/insights-runtime-extractor-ck9vn" Jun 07 16:06:00.910441 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:00.910357 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ck9vn" Jun 07 16:06:01.037959 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:01.037926 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ck9vn"] Jun 07 16:06:01.041369 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:06:01.041346 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a6ddf8a_77d5_4f17_b0b1_ed127abc3d8d.slice/crio-3592bd9d5470ee667084a1d6aee1d786de494488a38121753e9eed7eefc99468 WatchSource:0}: Error finding container 3592bd9d5470ee667084a1d6aee1d786de494488a38121753e9eed7eefc99468: Status 404 returned error can't find the container with id 3592bd9d5470ee667084a1d6aee1d786de494488a38121753e9eed7eefc99468 Jun 07 16:06:01.693846 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:01.693820 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ck9vn" event={"ID":"0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d","Type":"ContainerStarted","Data":"8c54af8b37a9d591b61db3a40ea168f5c853660511965a0d0cb51a871457f186"} Jun 07 16:06:01.694134 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:01.693872 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ck9vn" event={"ID":"0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d","Type":"ContainerStarted","Data":"3592bd9d5470ee667084a1d6aee1d786de494488a38121753e9eed7eefc99468"} Jun 07 16:06:02.699104 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:02.699067 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ck9vn" event={"ID":"0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d","Type":"ContainerStarted","Data":"53897b3d6521ce28989782ced74af10f14990e8f2cc023dd4f7189b8f194fe48"} Jun 07 16:06:03.704494 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:03.704450 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ck9vn" event={"ID":"0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d","Type":"ContainerStarted","Data":"bc15b3baee7572b4817cfdf94b5f2f231085118fb1f4fc39496b7f5113cdca00"} Jun 07 16:06:03.723334 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:03.723279 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ck9vn" podStartSLOduration=1.6540279450000002 podStartE2EDuration="3.723259539s" totalImagesPullingTime="2.069231594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:06:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:03.722608731 +0000 UTC m=+221.120545672" watchObservedRunningTime="2026-06-07 16:06:03.723259539 +0000 UTC m=+221.121196480" Jun 07 16:06:10.627466 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:10.627426 2579 patch_prober.go:28] interesting pod/image-registry-6786757f5-zfcl2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 16:06:10.627971 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:10.627478 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6786757f5-zfcl2" podUID="fa72c8ed-e065-4e5c-9b92-df55d28c65c0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:06:11.562917 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.562879 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-557d7f6d5f-qsftt"] Jun 07 16:06:11.566193 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.566175 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:11.568277 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.568247 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 07 16:06:11.568426 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.568250 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 07 16:06:11.568426 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.568324 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 07 16:06:11.569019 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.568995 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 07 16:06:11.569019 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.569012 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 07 16:06:11.569019 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.569000 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 07 16:06:11.569289 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.569055 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 07 16:06:11.569453 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.569387 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-48p8n\"" Jun 07 16:06:11.573183 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.573162 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 07 16:06:11.575734 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.575710 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-557d7f6d5f-qsftt"] Jun 07 16:06:11.650217 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.650175 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-console-config\") pod \"console-557d7f6d5f-qsftt\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:11.650660 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.650261 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8df98a65-04d2-4d7f-b68f-2c05afaf751e-console-serving-cert\") pod \"console-557d7f6d5f-qsftt\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:11.650660 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.650303 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8df98a65-04d2-4d7f-b68f-2c05afaf751e-console-oauth-config\") pod \"console-557d7f6d5f-qsftt\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:11.650660 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.650329 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndg5h\" (UniqueName: \"kubernetes.io/projected/8df98a65-04d2-4d7f-b68f-2c05afaf751e-kube-api-access-ndg5h\") pod \"console-557d7f6d5f-qsftt\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:11.650660 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.650395 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-service-ca\") pod \"console-557d7f6d5f-qsftt\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:11.650660 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.650435 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-oauth-serving-cert\") pod \"console-557d7f6d5f-qsftt\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:11.650660 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.650461 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-trusted-ca-bundle\") pod \"console-557d7f6d5f-qsftt\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:11.751379 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.751338 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8df98a65-04d2-4d7f-b68f-2c05afaf751e-console-serving-cert\") pod \"console-557d7f6d5f-qsftt\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:11.751583 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.751393 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8df98a65-04d2-4d7f-b68f-2c05afaf751e-console-oauth-config\") pod \"console-557d7f6d5f-qsftt\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:11.751583 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.751412 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndg5h\" (UniqueName: \"kubernetes.io/projected/8df98a65-04d2-4d7f-b68f-2c05afaf751e-kube-api-access-ndg5h\") pod \"console-557d7f6d5f-qsftt\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:11.751583 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.751433 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-service-ca\") pod \"console-557d7f6d5f-qsftt\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:11.751583 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.751459 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-oauth-serving-cert\") pod \"console-557d7f6d5f-qsftt\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:11.751583 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.751476 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-trusted-ca-bundle\") pod \"console-557d7f6d5f-qsftt\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:11.751583 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.751500 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-console-config\") pod \"console-557d7f6d5f-qsftt\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:11.752324 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.752302 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-console-config\") pod \"console-557d7f6d5f-qsftt\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:11.752367 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.752324 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-oauth-serving-cert\") pod \"console-557d7f6d5f-qsftt\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:11.752582 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.752559 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-service-ca\") pod \"console-557d7f6d5f-qsftt\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:11.752793 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.752742 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-trusted-ca-bundle\") pod \"console-557d7f6d5f-qsftt\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:11.754099 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.754065 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8df98a65-04d2-4d7f-b68f-2c05afaf751e-console-serving-cert\") pod \"console-557d7f6d5f-qsftt\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:11.754199 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.754122 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8df98a65-04d2-4d7f-b68f-2c05afaf751e-console-oauth-config\") pod \"console-557d7f6d5f-qsftt\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:11.758313 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.758290 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndg5h\" (UniqueName: \"kubernetes.io/projected/8df98a65-04d2-4d7f-b68f-2c05afaf751e-kube-api-access-ndg5h\") pod \"console-557d7f6d5f-qsftt\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:11.876558 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:11.876473 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:12.003518 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:12.003489 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-557d7f6d5f-qsftt"] Jun 07 16:06:12.006295 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:06:12.006267 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8df98a65_04d2_4d7f_b68f_2c05afaf751e.slice/crio-15d98ba04cee7b5e893ad2e5e8ed8219787a0fd8423c0fef006080237c54a25d WatchSource:0}: Error finding container 15d98ba04cee7b5e893ad2e5e8ed8219787a0fd8423c0fef006080237c54a25d: Status 404 returned error can't find the container with id 15d98ba04cee7b5e893ad2e5e8ed8219787a0fd8423c0fef006080237c54a25d Jun 07 16:06:12.735014 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:12.734975 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557d7f6d5f-qsftt" event={"ID":"8df98a65-04d2-4d7f-b68f-2c05afaf751e","Type":"ContainerStarted","Data":"15d98ba04cee7b5e893ad2e5e8ed8219787a0fd8423c0fef006080237c54a25d"} Jun 07 16:06:14.742971 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:14.742936 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557d7f6d5f-qsftt" event={"ID":"8df98a65-04d2-4d7f-b68f-2c05afaf751e","Type":"ContainerStarted","Data":"70bf9aa1725c0fb82a7d9921f085d4eccf4055b003574a49072218db1d3d6f7f"} Jun 07 16:06:14.758926 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:14.758881 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-557d7f6d5f-qsftt" podStartSLOduration=1.18608663 podStartE2EDuration="3.758865852s" totalImagesPullingTime="2.572779222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:06:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:14.758370062 +0000 UTC m=+232.156306997" watchObservedRunningTime="2026-06-07 16:06:14.758865852 +0000 UTC m=+232.156802794" Jun 07 16:06:20.626391 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:20.626356 2579 patch_prober.go:28] interesting pod/image-registry-6786757f5-zfcl2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 16:06:20.626772 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:20.626416 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6786757f5-zfcl2" podUID="fa72c8ed-e065-4e5c-9b92-df55d28c65c0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:06:21.876862 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:21.876829 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:21.877200 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:21.876917 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:21.878252 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:21.878227 2579 patch_prober.go:28] interesting pod/console-557d7f6d5f-qsftt container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" start-of-body= Jun 07 16:06:21.878360 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:21.878267 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-557d7f6d5f-qsftt" podUID="8df98a65-04d2-4d7f-b68f-2c05afaf751e" containerName="console" probeResult="failure" output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" Jun 07 16:06:24.251245 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.251200 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-nxx44"] Jun 07 16:06:24.257611 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.257583 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nxx44" Jun 07 16:06:24.260083 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.260063 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 07 16:06:24.260372 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.260114 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 07 16:06:24.260372 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.260160 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 07 16:06:24.260665 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.260648 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 07 16:06:24.260773 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.260736 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 07 16:06:24.260836 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.260650 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-nvx2f\"" Jun 07 16:06:24.263351 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.263329 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9"] Jun 07 16:06:24.267928 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.267908 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-nxx44"] Jun 07 16:06:24.268042 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.268021 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" Jun 07 16:06:24.270303 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.270281 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cz9hr"] Jun 07 16:06:24.270451 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.270431 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-982m6\"" Jun 07 16:06:24.270451 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.270444 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 07 16:06:24.270566 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.270360 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 07 16:06:24.271572 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.270295 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 07 16:06:24.275256 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.275237 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.278566 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.278490 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 07 16:06:24.278783 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.278723 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7s4zr\"" Jun 07 16:06:24.279337 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.278928 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 07 16:06:24.279337 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.279130 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 07 16:06:24.281332 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.281279 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9"] Jun 07 16:06:24.361018 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.360978 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6r2v\" (UniqueName: \"kubernetes.io/projected/d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7-kube-api-access-w6r2v\") pod \"openshift-state-metrics-65f78d5c66-nxx44\" (UID: \"d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nxx44" Jun 07 16:06:24.361018 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.361026 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c8c90aa8-cb2d-4d96-8b49-1900050f983e-node-exporter-wtmp\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.361255 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.361057 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8c90aa8-cb2d-4d96-8b49-1900050f983e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.361255 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.361084 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/55466313-41cc-4d9a-9ca1-132dc90dc5de-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-46pz9\" (UID: \"55466313-41cc-4d9a-9ca1-132dc90dc5de\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" Jun 07 16:06:24.361255 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.361130 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/55466313-41cc-4d9a-9ca1-132dc90dc5de-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-46pz9\" (UID: \"55466313-41cc-4d9a-9ca1-132dc90dc5de\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" Jun 07 16:06:24.361255 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.361163 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-nxx44\" (UID: \"d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nxx44" Jun 07 16:06:24.361255 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.361215 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqnc2\" (UniqueName: \"kubernetes.io/projected/c8c90aa8-cb2d-4d96-8b49-1900050f983e-kube-api-access-fqnc2\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.361255 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.361239 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-nxx44\" (UID: \"d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nxx44" Jun 07 16:06:24.361498 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.361278 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8c90aa8-cb2d-4d96-8b49-1900050f983e-sys\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.361498 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.361298 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c8c90aa8-cb2d-4d96-8b49-1900050f983e-root\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.361498 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.361321 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2dnf\" (UniqueName: \"kubernetes.io/projected/55466313-41cc-4d9a-9ca1-132dc90dc5de-kube-api-access-j2dnf\") pod \"kube-state-metrics-57bbf8bfb5-46pz9\" (UID: \"55466313-41cc-4d9a-9ca1-132dc90dc5de\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" Jun 07 16:06:24.361498 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.361345 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c8c90aa8-cb2d-4d96-8b49-1900050f983e-node-exporter-textfile\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.361498 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.361370 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c8c90aa8-cb2d-4d96-8b49-1900050f983e-node-exporter-accelerators-collector-config\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.361498 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.361395 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55466313-41cc-4d9a-9ca1-132dc90dc5de-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-46pz9\" (UID: \"55466313-41cc-4d9a-9ca1-132dc90dc5de\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" Jun 07 16:06:24.361498 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.361428 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-nxx44\" (UID: \"d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nxx44" Jun 07 16:06:24.361498 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.361457 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55466313-41cc-4d9a-9ca1-132dc90dc5de-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-46pz9\" (UID: \"55466313-41cc-4d9a-9ca1-132dc90dc5de\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" Jun 07 16:06:24.361498 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.361491 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/55466313-41cc-4d9a-9ca1-132dc90dc5de-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-46pz9\" (UID: \"55466313-41cc-4d9a-9ca1-132dc90dc5de\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" Jun 07 16:06:24.361846 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.361519 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c8c90aa8-cb2d-4d96-8b49-1900050f983e-node-exporter-tls\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.361846 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.361590 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8c90aa8-cb2d-4d96-8b49-1900050f983e-metrics-client-ca\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.462845 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.462810 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/55466313-41cc-4d9a-9ca1-132dc90dc5de-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-46pz9\" (UID: \"55466313-41cc-4d9a-9ca1-132dc90dc5de\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" Jun 07 16:06:24.462845 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.462859 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c8c90aa8-cb2d-4d96-8b49-1900050f983e-node-exporter-tls\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.463079 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:06:24.462968 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 07 16:06:24.463079 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:06:24.463029 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8c90aa8-cb2d-4d96-8b49-1900050f983e-node-exporter-tls podName:c8c90aa8-cb2d-4d96-8b49-1900050f983e nodeName:}" failed. No retries permitted until 2026-06-07 16:06:24.963007702 +0000 UTC m=+242.360944628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c8c90aa8-cb2d-4d96-8b49-1900050f983e-node-exporter-tls") pod "node-exporter-cz9hr" (UID: "c8c90aa8-cb2d-4d96-8b49-1900050f983e") : secret "node-exporter-tls" not found Jun 07 16:06:24.463079 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.463045 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8c90aa8-cb2d-4d96-8b49-1900050f983e-metrics-client-ca\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.463079 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.463077 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6r2v\" (UniqueName: \"kubernetes.io/projected/d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7-kube-api-access-w6r2v\") pod \"openshift-state-metrics-65f78d5c66-nxx44\" (UID: \"d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nxx44" Jun 07 16:06:24.463275 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.463100 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c8c90aa8-cb2d-4d96-8b49-1900050f983e-node-exporter-wtmp\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.463275 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.463126 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8c90aa8-cb2d-4d96-8b49-1900050f983e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.463275 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.463151 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/55466313-41cc-4d9a-9ca1-132dc90dc5de-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-46pz9\" (UID: \"55466313-41cc-4d9a-9ca1-132dc90dc5de\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" Jun 07 16:06:24.463275 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.463189 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/55466313-41cc-4d9a-9ca1-132dc90dc5de-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-46pz9\" (UID: \"55466313-41cc-4d9a-9ca1-132dc90dc5de\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" Jun 07 16:06:24.463275 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.463220 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-nxx44\" (UID: \"d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nxx44" Jun 07 16:06:24.463275 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.463236 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/55466313-41cc-4d9a-9ca1-132dc90dc5de-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-46pz9\" (UID: \"55466313-41cc-4d9a-9ca1-132dc90dc5de\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" Jun 07 16:06:24.463567 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.463284 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqnc2\" (UniqueName: \"kubernetes.io/projected/c8c90aa8-cb2d-4d96-8b49-1900050f983e-kube-api-access-fqnc2\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.463567 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.463527 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-nxx44\" (UID: \"d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nxx44" Jun 07 16:06:24.463670 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.463573 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8c90aa8-cb2d-4d96-8b49-1900050f983e-sys\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.463670 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.463597 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c8c90aa8-cb2d-4d96-8b49-1900050f983e-root\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.463670 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.463620 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2dnf\" (UniqueName: \"kubernetes.io/projected/55466313-41cc-4d9a-9ca1-132dc90dc5de-kube-api-access-j2dnf\") pod \"kube-state-metrics-57bbf8bfb5-46pz9\" (UID: \"55466313-41cc-4d9a-9ca1-132dc90dc5de\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" Jun 07 16:06:24.463670 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.463647 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c8c90aa8-cb2d-4d96-8b49-1900050f983e-node-exporter-textfile\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.463895 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.463671 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c8c90aa8-cb2d-4d96-8b49-1900050f983e-node-exporter-accelerators-collector-config\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.463895 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.463696 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55466313-41cc-4d9a-9ca1-132dc90dc5de-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-46pz9\" (UID: \"55466313-41cc-4d9a-9ca1-132dc90dc5de\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" Jun 07 16:06:24.463895 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.463736 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-nxx44\" (UID: \"d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nxx44" Jun 07 16:06:24.463895 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.463792 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55466313-41cc-4d9a-9ca1-132dc90dc5de-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-46pz9\" (UID: \"55466313-41cc-4d9a-9ca1-132dc90dc5de\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" Jun 07 16:06:24.464082 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.463974 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/55466313-41cc-4d9a-9ca1-132dc90dc5de-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-46pz9\" (UID: \"55466313-41cc-4d9a-9ca1-132dc90dc5de\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" Jun 07 16:06:24.464082 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.464046 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8c90aa8-cb2d-4d96-8b49-1900050f983e-sys\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.464187 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.464090 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c8c90aa8-cb2d-4d96-8b49-1900050f983e-root\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.464187 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:06:24.464117 2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 07 16:06:24.464187 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:06:24.464173 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7-openshift-state-metrics-tls podName:d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7 nodeName:}" failed. No retries permitted until 2026-06-07 16:06:24.96415697 +0000 UTC m=+242.362093905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-nxx44" (UID: "d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7") : secret "openshift-state-metrics-tls" not found Jun 07 16:06:24.465020 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.464530 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c8c90aa8-cb2d-4d96-8b49-1900050f983e-node-exporter-wtmp\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.465020 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.464627 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c8c90aa8-cb2d-4d96-8b49-1900050f983e-node-exporter-accelerators-collector-config\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.465020 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.464709 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55466313-41cc-4d9a-9ca1-132dc90dc5de-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-46pz9\" (UID: \"55466313-41cc-4d9a-9ca1-132dc90dc5de\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" Jun 07 16:06:24.465020 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.464896 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c8c90aa8-cb2d-4d96-8b49-1900050f983e-node-exporter-textfile\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.465020 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.464984 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8c90aa8-cb2d-4d96-8b49-1900050f983e-metrics-client-ca\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.465333 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.465297 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-nxx44\" (UID: \"d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nxx44" Jun 07 16:06:24.466447 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.466409 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-nxx44\" (UID: \"d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nxx44" Jun 07 16:06:24.466669 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.466647 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55466313-41cc-4d9a-9ca1-132dc90dc5de-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-46pz9\" (UID: \"55466313-41cc-4d9a-9ca1-132dc90dc5de\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" Jun 07 16:06:24.467661 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.467637 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8c90aa8-cb2d-4d96-8b49-1900050f983e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.468017 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.467998 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/55466313-41cc-4d9a-9ca1-132dc90dc5de-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-46pz9\" (UID: \"55466313-41cc-4d9a-9ca1-132dc90dc5de\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" Jun 07 16:06:24.472149 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.472116 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqnc2\" (UniqueName: \"kubernetes.io/projected/c8c90aa8-cb2d-4d96-8b49-1900050f983e-kube-api-access-fqnc2\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.472391 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.472366 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2dnf\" (UniqueName: \"kubernetes.io/projected/55466313-41cc-4d9a-9ca1-132dc90dc5de-kube-api-access-j2dnf\") pod \"kube-state-metrics-57bbf8bfb5-46pz9\" (UID: \"55466313-41cc-4d9a-9ca1-132dc90dc5de\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" Jun 07 16:06:24.473603 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.473580 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6r2v\" (UniqueName: \"kubernetes.io/projected/d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7-kube-api-access-w6r2v\") pod \"openshift-state-metrics-65f78d5c66-nxx44\" (UID: \"d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nxx44" Jun 07 16:06:24.585198 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.585107 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" Jun 07 16:06:24.732860 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.732831 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9"] Jun 07 16:06:24.736190 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:06:24.736156 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55466313_41cc_4d9a_9ca1_132dc90dc5de.slice/crio-bfe51041a098aff59ca1e3ce94072cdd18b756d9f5a031fd2b30e9473dbce62c WatchSource:0}: Error finding container bfe51041a098aff59ca1e3ce94072cdd18b756d9f5a031fd2b30e9473dbce62c: Status 404 returned error can't find the container with id bfe51041a098aff59ca1e3ce94072cdd18b756d9f5a031fd2b30e9473dbce62c Jun 07 16:06:24.775664 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.775634 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" event={"ID":"55466313-41cc-4d9a-9ca1-132dc90dc5de","Type":"ContainerStarted","Data":"bfe51041a098aff59ca1e3ce94072cdd18b756d9f5a031fd2b30e9473dbce62c"} Jun 07 16:06:24.968134 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.968089 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-nxx44\" (UID: \"d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nxx44" Jun 07 16:06:24.968294 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.968175 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c8c90aa8-cb2d-4d96-8b49-1900050f983e-node-exporter-tls\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.970545 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.970521 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c8c90aa8-cb2d-4d96-8b49-1900050f983e-node-exporter-tls\") pod \"node-exporter-cz9hr\" (UID: \"c8c90aa8-cb2d-4d96-8b49-1900050f983e\") " pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:24.970636 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:24.970602 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-nxx44\" (UID: \"d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nxx44" Jun 07 16:06:25.169504 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:25.169470 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nxx44" Jun 07 16:06:25.193083 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:25.193047 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cz9hr" Jun 07 16:06:25.207482 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:06:25.207457 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8c90aa8_cb2d_4d96_8b49_1900050f983e.slice/crio-211271c07d86bf5b31756505c9e92695e1ab0731e0984cdd92113beefb6e0606 WatchSource:0}: Error finding container 211271c07d86bf5b31756505c9e92695e1ab0731e0984cdd92113beefb6e0606: Status 404 returned error can't find the container with id 211271c07d86bf5b31756505c9e92695e1ab0731e0984cdd92113beefb6e0606 Jun 07 16:06:25.311951 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:25.308170 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-nxx44"] Jun 07 16:06:25.312810 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:06:25.312782 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2103cbf_cb5f_4d2c_9f2b_4d12c9a8a2f7.slice/crio-e2cb77bdec260a8015f24a05380f6951d1909c177c11f23a75b2a36f7fc40c27 WatchSource:0}: Error finding container e2cb77bdec260a8015f24a05380f6951d1909c177c11f23a75b2a36f7fc40c27: Status 404 returned error can't find the container with id e2cb77bdec260a8015f24a05380f6951d1909c177c11f23a75b2a36f7fc40c27 Jun 07 16:06:25.642488 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:25.642393 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6786757f5-zfcl2" podUID="fa72c8ed-e065-4e5c-9b92-df55d28c65c0" containerName="registry" containerID="cri-o://cf20607297c45daf12c8902c724f7c13c22f80e9883304ac11bdd5ef26651cee" gracePeriod=30 Jun 07 16:06:25.784166 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:25.784026 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nxx44" event={"ID":"d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7","Type":"ContainerStarted","Data":"f93ad79192faaecb58ac4651012f7d7635c456001da0259c344afb89d2ed578d"} Jun 07 16:06:25.784166 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:25.784102 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nxx44" event={"ID":"d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7","Type":"ContainerStarted","Data":"92b0ee2464e1ed4c9f9408e4bcae0fbc19f42399ae36056f95f3b3fa89793c9f"} Jun 07 16:06:25.784166 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:25.784130 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nxx44" event={"ID":"d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7","Type":"ContainerStarted","Data":"e2cb77bdec260a8015f24a05380f6951d1909c177c11f23a75b2a36f7fc40c27"} Jun 07 16:06:25.785935 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:25.785879 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cz9hr" event={"ID":"c8c90aa8-cb2d-4d96-8b49-1900050f983e","Type":"ContainerStarted","Data":"211271c07d86bf5b31756505c9e92695e1ab0731e0984cdd92113beefb6e0606"} Jun 07 16:06:25.787871 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:25.787845 2579 generic.go:356] "Generic (PLEG): container finished" podID="fa72c8ed-e065-4e5c-9b92-df55d28c65c0" containerID="cf20607297c45daf12c8902c724f7c13c22f80e9883304ac11bdd5ef26651cee" exitCode=0 Jun 07 16:06:25.787991 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:25.787885 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6786757f5-zfcl2" event={"ID":"fa72c8ed-e065-4e5c-9b92-df55d28c65c0","Type":"ContainerDied","Data":"cf20607297c45daf12c8902c724f7c13c22f80e9883304ac11bdd5ef26651cee"} Jun 07 16:06:26.281874 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.281822 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:06:26.381912 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.381888 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-installation-pull-secrets\") pod \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " Jun 07 16:06:26.382861 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.382072 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-image-registry-private-configuration\") pod \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " Jun 07 16:06:26.382861 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.382647 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-trusted-ca\") pod \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " Jun 07 16:06:26.382861 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.382710 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-certificates\") pod \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " Jun 07 16:06:26.383054 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.382873 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-ca-trust-extracted\") pod \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " Jun 07 16:06:26.383054 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.382915 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-bound-sa-token\") pod \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " Jun 07 16:06:26.383054 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.382951 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbwvl\" (UniqueName: \"kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-kube-api-access-lbwvl\") pod \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " Jun 07 16:06:26.383054 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.382980 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-tls\") pod \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\" (UID: \"fa72c8ed-e065-4e5c-9b92-df55d28c65c0\") " Jun 07 16:06:26.383683 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.383490 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fa72c8ed-e065-4e5c-9b92-df55d28c65c0" (UID: "fa72c8ed-e065-4e5c-9b92-df55d28c65c0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:06:26.384665 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.384622 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fa72c8ed-e065-4e5c-9b92-df55d28c65c0" (UID: "fa72c8ed-e065-4e5c-9b92-df55d28c65c0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:06:26.386928 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.386880 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fa72c8ed-e065-4e5c-9b92-df55d28c65c0" (UID: "fa72c8ed-e065-4e5c-9b92-df55d28c65c0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:06:26.387024 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.386939 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-kube-api-access-lbwvl" (OuterVolumeSpecName: "kube-api-access-lbwvl") pod "fa72c8ed-e065-4e5c-9b92-df55d28c65c0" (UID: "fa72c8ed-e065-4e5c-9b92-df55d28c65c0"). InnerVolumeSpecName "kube-api-access-lbwvl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:06:26.388021 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.387984 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fa72c8ed-e065-4e5c-9b92-df55d28c65c0" (UID: "fa72c8ed-e065-4e5c-9b92-df55d28c65c0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:06:26.388021 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.388003 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fa72c8ed-e065-4e5c-9b92-df55d28c65c0" (UID: "fa72c8ed-e065-4e5c-9b92-df55d28c65c0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:06:26.390097 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.390061 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fa72c8ed-e065-4e5c-9b92-df55d28c65c0" (UID: "fa72c8ed-e065-4e5c-9b92-df55d28c65c0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:06:26.400161 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.400133 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fa72c8ed-e065-4e5c-9b92-df55d28c65c0" (UID: "fa72c8ed-e065-4e5c-9b92-df55d28c65c0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:06:26.486901 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.486508 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-ca-trust-extracted\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:06:26.486901 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.486542 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-bound-sa-token\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:06:26.486901 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.486559 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbwvl\" (UniqueName: \"kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-kube-api-access-lbwvl\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:06:26.486901 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.486573 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-tls\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:06:26.486901 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.486589 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-installation-pull-secrets\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:06:26.486901 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.486604 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-image-registry-private-configuration\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:06:26.486901 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.486618 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-trusted-ca\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:06:26.486901 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.486631 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa72c8ed-e065-4e5c-9b92-df55d28c65c0-registry-certificates\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:06:26.792208 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.792179 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6786757f5-zfcl2" Jun 07 16:06:26.792208 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.792190 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6786757f5-zfcl2" event={"ID":"fa72c8ed-e065-4e5c-9b92-df55d28c65c0","Type":"ContainerDied","Data":"e2544fc4915547bcd0507a9e36c42db322793cccb20297dac9a7912a1e94da3a"} Jun 07 16:06:26.792351 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.792248 2579 scope.go:117] "RemoveContainer" containerID="cf20607297c45daf12c8902c724f7c13c22f80e9883304ac11bdd5ef26651cee" Jun 07 16:06:26.794886 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.794861 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" event={"ID":"55466313-41cc-4d9a-9ca1-132dc90dc5de","Type":"ContainerStarted","Data":"a9edd229f3e2237075f6009264aef2dc811810c59bd2ef49aea8796480035fe3"} Jun 07 16:06:26.795000 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.794928 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" event={"ID":"55466313-41cc-4d9a-9ca1-132dc90dc5de","Type":"ContainerStarted","Data":"fc1199d5519231b3a20bd5c99312f95cce0d8e921550ba04714e30f8a7e5cb4f"} Jun 07 16:06:26.795000 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.794959 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" event={"ID":"55466313-41cc-4d9a-9ca1-132dc90dc5de","Type":"ContainerStarted","Data":"bc9a5fc1505f1a7318474f05e72a92334026f5fede109e57f87f2efef0559fdc"} Jun 07 16:06:26.796813 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.796787 2579 generic.go:356] "Generic (PLEG): container finished" podID="c8c90aa8-cb2d-4d96-8b49-1900050f983e" containerID="9149732faee47f92ccd0ca385d3d44c198151f9223465ad214e5e41b33b8c2d5" exitCode=0 Jun 07 16:06:26.796910 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.796831 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cz9hr" event={"ID":"c8c90aa8-cb2d-4d96-8b49-1900050f983e","Type":"ContainerDied","Data":"9149732faee47f92ccd0ca385d3d44c198151f9223465ad214e5e41b33b8c2d5"} Jun 07 16:06:26.814345 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.814284 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-46pz9" podStartSLOduration=1.255234761 podStartE2EDuration="2.814265251s" totalImagesPullingTime="1.55903049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:26.812010615 +0000 UTC m=+244.209947560" watchObservedRunningTime="2026-06-07 16:06:26.814265251 +0000 UTC m=+244.212202197" Jun 07 16:06:26.828019 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.827993 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6786757f5-zfcl2"] Jun 07 16:06:26.833201 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:26.833178 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6786757f5-zfcl2"] Jun 07 16:06:27.005790 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.005740 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa72c8ed-e065-4e5c-9b92-df55d28c65c0" path="/var/lib/kubelet/pods/fa72c8ed-e065-4e5c-9b92-df55d28c65c0/volumes" Jun 07 16:06:27.230164 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.230130 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6d5b44485f-4dfsh"] Jun 07 16:06:27.230525 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.230512 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa72c8ed-e065-4e5c-9b92-df55d28c65c0" containerName="registry" Jun 07 16:06:27.230567 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.230529 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa72c8ed-e065-4e5c-9b92-df55d28c65c0" containerName="registry" Jun 07 16:06:27.230599 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.230589 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa72c8ed-e065-4e5c-9b92-df55d28c65c0" containerName="registry" Jun 07 16:06:27.234596 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.234574 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.237055 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.236723 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 07 16:06:27.237055 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.236730 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6tic84m52areu\"" Jun 07 16:06:27.237055 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.236870 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 07 16:06:27.237055 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.236922 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 07 16:06:27.237055 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.236937 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 07 16:06:27.237055 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.236958 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2fwvk\"" Jun 07 16:06:27.237055 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.236966 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 07 16:06:27.244625 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.244606 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d5b44485f-4dfsh"] Jun 07 16:06:27.394093 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.394056 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hbb5\" (UniqueName: \"kubernetes.io/projected/132f3857-6eb1-4437-a70f-aa80624c93d3-kube-api-access-4hbb5\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.394480 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.394111 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/132f3857-6eb1-4437-a70f-aa80624c93d3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.394480 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.394167 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/132f3857-6eb1-4437-a70f-aa80624c93d3-secret-thanos-querier-tls\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.394480 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.394190 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/132f3857-6eb1-4437-a70f-aa80624c93d3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.394480 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.394209 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/132f3857-6eb1-4437-a70f-aa80624c93d3-metrics-client-ca\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.394480 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.394288 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/132f3857-6eb1-4437-a70f-aa80624c93d3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.394480 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.394363 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/132f3857-6eb1-4437-a70f-aa80624c93d3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.394480 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.394403 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/132f3857-6eb1-4437-a70f-aa80624c93d3-secret-grpc-tls\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.495471 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.495367 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hbb5\" (UniqueName: \"kubernetes.io/projected/132f3857-6eb1-4437-a70f-aa80624c93d3-kube-api-access-4hbb5\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.495471 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.495420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/132f3857-6eb1-4437-a70f-aa80624c93d3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.495691 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.495478 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/132f3857-6eb1-4437-a70f-aa80624c93d3-secret-thanos-querier-tls\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.495691 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.495500 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/132f3857-6eb1-4437-a70f-aa80624c93d3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.495691 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.495525 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/132f3857-6eb1-4437-a70f-aa80624c93d3-metrics-client-ca\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.495691 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.495566 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/132f3857-6eb1-4437-a70f-aa80624c93d3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.495691 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.495605 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/132f3857-6eb1-4437-a70f-aa80624c93d3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.495691 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.495628 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/132f3857-6eb1-4437-a70f-aa80624c93d3-secret-grpc-tls\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.496420 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.496373 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/132f3857-6eb1-4437-a70f-aa80624c93d3-metrics-client-ca\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.498555 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.498511 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/132f3857-6eb1-4437-a70f-aa80624c93d3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.498727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.498697 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/132f3857-6eb1-4437-a70f-aa80624c93d3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.498986 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.498962 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/132f3857-6eb1-4437-a70f-aa80624c93d3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.499056 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.499004 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/132f3857-6eb1-4437-a70f-aa80624c93d3-secret-grpc-tls\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.499056 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.499030 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/132f3857-6eb1-4437-a70f-aa80624c93d3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.499235 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.499219 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/132f3857-6eb1-4437-a70f-aa80624c93d3-secret-thanos-querier-tls\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.502931 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.502908 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hbb5\" (UniqueName: \"kubernetes.io/projected/132f3857-6eb1-4437-a70f-aa80624c93d3-kube-api-access-4hbb5\") pod \"thanos-querier-6d5b44485f-4dfsh\" (UID: \"132f3857-6eb1-4437-a70f-aa80624c93d3\") " pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.545435 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.545407 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:27.681177 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.681148 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d5b44485f-4dfsh"] Jun 07 16:06:27.683619 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:06:27.683592 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod132f3857_6eb1_4437_a70f_aa80624c93d3.slice/crio-fe85a6a50f45e2d44737987e49903e8a1aff2c0c17d0c58f3173c391d8ec1735 WatchSource:0}: Error finding container fe85a6a50f45e2d44737987e49903e8a1aff2c0c17d0c58f3173c391d8ec1735: Status 404 returned error can't find the container with id fe85a6a50f45e2d44737987e49903e8a1aff2c0c17d0c58f3173c391d8ec1735 Jun 07 16:06:27.805347 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.805249 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nxx44" event={"ID":"d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7","Type":"ContainerStarted","Data":"1164d7906733e955d3a704f534edb6c43528e4a2da2b61bcb5a87182fc34ebdf"} Jun 07 16:06:27.807243 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.807220 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cz9hr" event={"ID":"c8c90aa8-cb2d-4d96-8b49-1900050f983e","Type":"ContainerStarted","Data":"fbe43f00c6ba2bae21e21ed4a80fe6d52b74a26ff11428c3ef6c57f23940e49f"} Jun 07 16:06:27.807359 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.807258 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cz9hr" event={"ID":"c8c90aa8-cb2d-4d96-8b49-1900050f983e","Type":"ContainerStarted","Data":"4bece5adde325315eb335d77324084dccde49116f37582df5cab19ff680daf04"} Jun 07 16:06:27.808467 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.808438 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" event={"ID":"132f3857-6eb1-4437-a70f-aa80624c93d3","Type":"ContainerStarted","Data":"fe85a6a50f45e2d44737987e49903e8a1aff2c0c17d0c58f3173c391d8ec1735"} Jun 07 16:06:27.820969 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.820926 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-nxx44" podStartSLOduration=2.489814775 podStartE2EDuration="3.820911906s" totalImagesPullingTime="1.331097131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:27.82008776 +0000 UTC m=+245.218024707" watchObservedRunningTime="2026-06-07 16:06:27.820911906 +0000 UTC m=+245.218848847" Jun 07 16:06:27.837190 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:27.837147 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cz9hr" podStartSLOduration=2.633174593 podStartE2EDuration="3.837128135s" totalImagesPullingTime="1.09194608s" totalInitContainerRuntime="112.007462ms" isStatefulPod=true podCreationTimestamp="2026-06-07 16:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:27.836508126 +0000 UTC m=+245.234445068" watchObservedRunningTime="2026-06-07 16:06:27.837128135 +0000 UTC m=+245.235065078" Jun 07 16:06:28.646178 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.646141 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7b75f899df-j59pw"] Jun 07 16:06:28.649913 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.649891 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:28.652530 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.652481 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 07 16:06:28.652530 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.652522 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nfbpq\"" Jun 07 16:06:28.652698 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.652586 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-284ri16nthtff\"" Jun 07 16:06:28.652698 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.652522 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 07 16:06:28.652698 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.652685 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 07 16:06:28.652885 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.652829 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 07 16:06:28.656948 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.656922 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b75f899df-j59pw"] Jun 07 16:06:28.705630 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.705598 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/27dd4f60-c766-4787-bbc5-bd8968eac82f-secret-metrics-server-tls\") pod \"metrics-server-7b75f899df-j59pw\" (UID: \"27dd4f60-c766-4787-bbc5-bd8968eac82f\") " pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:28.705849 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.705664 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27dd4f60-c766-4787-bbc5-bd8968eac82f-client-ca-bundle\") pod \"metrics-server-7b75f899df-j59pw\" (UID: \"27dd4f60-c766-4787-bbc5-bd8968eac82f\") " pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:28.705849 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.705716 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/27dd4f60-c766-4787-bbc5-bd8968eac82f-secret-metrics-server-client-certs\") pod \"metrics-server-7b75f899df-j59pw\" (UID: \"27dd4f60-c766-4787-bbc5-bd8968eac82f\") " pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:28.705849 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.705743 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27dd4f60-c766-4787-bbc5-bd8968eac82f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b75f899df-j59pw\" (UID: \"27dd4f60-c766-4787-bbc5-bd8968eac82f\") " pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:28.705849 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.705834 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/27dd4f60-c766-4787-bbc5-bd8968eac82f-audit-log\") pod \"metrics-server-7b75f899df-j59pw\" (UID: \"27dd4f60-c766-4787-bbc5-bd8968eac82f\") " pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:28.706112 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.705864 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wktj\" (UniqueName: \"kubernetes.io/projected/27dd4f60-c766-4787-bbc5-bd8968eac82f-kube-api-access-9wktj\") pod \"metrics-server-7b75f899df-j59pw\" (UID: \"27dd4f60-c766-4787-bbc5-bd8968eac82f\") " pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:28.706112 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.705907 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/27dd4f60-c766-4787-bbc5-bd8968eac82f-metrics-server-audit-profiles\") pod \"metrics-server-7b75f899df-j59pw\" (UID: \"27dd4f60-c766-4787-bbc5-bd8968eac82f\") " pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:28.807117 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.807084 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/27dd4f60-c766-4787-bbc5-bd8968eac82f-secret-metrics-server-tls\") pod \"metrics-server-7b75f899df-j59pw\" (UID: \"27dd4f60-c766-4787-bbc5-bd8968eac82f\") " pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:28.807293 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.807143 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27dd4f60-c766-4787-bbc5-bd8968eac82f-client-ca-bundle\") pod \"metrics-server-7b75f899df-j59pw\" (UID: \"27dd4f60-c766-4787-bbc5-bd8968eac82f\") " pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:28.807293 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.807177 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/27dd4f60-c766-4787-bbc5-bd8968eac82f-secret-metrics-server-client-certs\") pod \"metrics-server-7b75f899df-j59pw\" (UID: \"27dd4f60-c766-4787-bbc5-bd8968eac82f\") " pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:28.807293 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.807207 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27dd4f60-c766-4787-bbc5-bd8968eac82f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b75f899df-j59pw\" (UID: \"27dd4f60-c766-4787-bbc5-bd8968eac82f\") " pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:28.807460 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.807302 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/27dd4f60-c766-4787-bbc5-bd8968eac82f-audit-log\") pod \"metrics-server-7b75f899df-j59pw\" (UID: \"27dd4f60-c766-4787-bbc5-bd8968eac82f\") " pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:28.807460 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.807349 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wktj\" (UniqueName: \"kubernetes.io/projected/27dd4f60-c766-4787-bbc5-bd8968eac82f-kube-api-access-9wktj\") pod \"metrics-server-7b75f899df-j59pw\" (UID: \"27dd4f60-c766-4787-bbc5-bd8968eac82f\") " pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:28.807460 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.807385 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/27dd4f60-c766-4787-bbc5-bd8968eac82f-metrics-server-audit-profiles\") pod \"metrics-server-7b75f899df-j59pw\" (UID: \"27dd4f60-c766-4787-bbc5-bd8968eac82f\") " pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:28.807823 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.807735 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/27dd4f60-c766-4787-bbc5-bd8968eac82f-audit-log\") pod \"metrics-server-7b75f899df-j59pw\" (UID: \"27dd4f60-c766-4787-bbc5-bd8968eac82f\") " pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:28.808206 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.808158 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27dd4f60-c766-4787-bbc5-bd8968eac82f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b75f899df-j59pw\" (UID: \"27dd4f60-c766-4787-bbc5-bd8968eac82f\") " pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:28.808778 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.808713 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/27dd4f60-c766-4787-bbc5-bd8968eac82f-metrics-server-audit-profiles\") pod \"metrics-server-7b75f899df-j59pw\" (UID: \"27dd4f60-c766-4787-bbc5-bd8968eac82f\") " pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:28.810249 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.810227 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/27dd4f60-c766-4787-bbc5-bd8968eac82f-secret-metrics-server-client-certs\") pod \"metrics-server-7b75f899df-j59pw\" (UID: \"27dd4f60-c766-4787-bbc5-bd8968eac82f\") " pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:28.810546 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.810525 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/27dd4f60-c766-4787-bbc5-bd8968eac82f-secret-metrics-server-tls\") pod \"metrics-server-7b75f899df-j59pw\" (UID: \"27dd4f60-c766-4787-bbc5-bd8968eac82f\") " pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:28.811334 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.811311 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27dd4f60-c766-4787-bbc5-bd8968eac82f-client-ca-bundle\") pod \"metrics-server-7b75f899df-j59pw\" (UID: \"27dd4f60-c766-4787-bbc5-bd8968eac82f\") " pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:28.815597 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.815574 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wktj\" (UniqueName: \"kubernetes.io/projected/27dd4f60-c766-4787-bbc5-bd8968eac82f-kube-api-access-9wktj\") pod \"metrics-server-7b75f899df-j59pw\" (UID: \"27dd4f60-c766-4787-bbc5-bd8968eac82f\") " pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:28.962449 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:28.962412 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:29.032880 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.032852 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-qw2ph"] Jun 07 16:06:29.036186 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.036164 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qw2ph" Jun 07 16:06:29.038656 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.038432 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 07 16:06:29.038656 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.038485 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-f56r7\"" Jun 07 16:06:29.046207 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.046143 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-qw2ph"] Jun 07 16:06:29.110748 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.110705 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3cd9e2f6-4e4b-4a18-82af-8e36be0b98c8-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-qw2ph\" (UID: \"3cd9e2f6-4e4b-4a18-82af-8e36be0b98c8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qw2ph" Jun 07 16:06:29.110925 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.110796 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dcxt\" (UniqueName: \"kubernetes.io/projected/3cd9e2f6-4e4b-4a18-82af-8e36be0b98c8-kube-api-access-6dcxt\") pod \"monitoring-plugin-76b68cc874-qw2ph\" (UID: \"3cd9e2f6-4e4b-4a18-82af-8e36be0b98c8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qw2ph" Jun 07 16:06:29.211612 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.211558 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dcxt\" (UniqueName: \"kubernetes.io/projected/3cd9e2f6-4e4b-4a18-82af-8e36be0b98c8-kube-api-access-6dcxt\") pod \"monitoring-plugin-76b68cc874-qw2ph\" (UID: \"3cd9e2f6-4e4b-4a18-82af-8e36be0b98c8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qw2ph" Jun 07 16:06:29.211831 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.211698 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3cd9e2f6-4e4b-4a18-82af-8e36be0b98c8-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-qw2ph\" (UID: \"3cd9e2f6-4e4b-4a18-82af-8e36be0b98c8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qw2ph" Jun 07 16:06:29.211900 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:06:29.211831 2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 07 16:06:29.211957 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:06:29.211908 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3cd9e2f6-4e4b-4a18-82af-8e36be0b98c8-monitoring-plugin-cert podName:3cd9e2f6-4e4b-4a18-82af-8e36be0b98c8 nodeName:}" failed. No retries permitted until 2026-06-07 16:06:29.711887875 +0000 UTC m=+247.109824812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/3cd9e2f6-4e4b-4a18-82af-8e36be0b98c8-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-qw2ph" (UID: "3cd9e2f6-4e4b-4a18-82af-8e36be0b98c8") : secret "monitoring-plugin-cert" not found Jun 07 16:06:29.220323 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.220258 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dcxt\" (UniqueName: \"kubernetes.io/projected/3cd9e2f6-4e4b-4a18-82af-8e36be0b98c8-kube-api-access-6dcxt\") pod \"monitoring-plugin-76b68cc874-qw2ph\" (UID: \"3cd9e2f6-4e4b-4a18-82af-8e36be0b98c8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qw2ph" Jun 07 16:06:29.422960 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.422923 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bd788fcd9-dj4c5"] Jun 07 16:06:29.426606 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.426575 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:29.436992 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.436918 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd788fcd9-dj4c5"] Jun 07 16:06:29.507438 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.507352 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-78cb7b6748-hfwz6"] Jun 07 16:06:29.511295 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.511273 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.514150 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.514123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-service-ca\") pod \"console-7bd788fcd9-dj4c5\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:29.514279 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.514180 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-console-config\") pod \"console-7bd788fcd9-dj4c5\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:29.514279 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.514225 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 07 16:06:29.514279 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.514241 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81253610-0451-4715-88e5-10e6aedea2bc-console-oauth-config\") pod \"console-7bd788fcd9-dj4c5\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:29.514418 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.514280 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81253610-0451-4715-88e5-10e6aedea2bc-console-serving-cert\") pod \"console-7bd788fcd9-dj4c5\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:29.514418 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.514381 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-trusted-ca-bundle\") pod \"console-7bd788fcd9-dj4c5\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:29.514500 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.514419 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr9bj\" (UniqueName: \"kubernetes.io/projected/81253610-0451-4715-88e5-10e6aedea2bc-kube-api-access-lr9bj\") pod \"console-7bd788fcd9-dj4c5\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:29.514500 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.514467 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-oauth-serving-cert\") pod \"console-7bd788fcd9-dj4c5\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:29.515240 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.515221 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 07 16:06:29.515347 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.515284 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 07 16:06:29.515503 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.515485 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5rk9m\"" Jun 07 16:06:29.515568 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.515501 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 07 16:06:29.515772 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.515735 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 07 16:06:29.531563 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.531497 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 07 16:06:29.540654 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.540568 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78cb7b6748-hfwz6"] Jun 07 16:06:29.615522 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.615496 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81253610-0451-4715-88e5-10e6aedea2bc-console-oauth-config\") pod \"console-7bd788fcd9-dj4c5\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:29.615695 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.615542 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81253610-0451-4715-88e5-10e6aedea2bc-console-serving-cert\") pod \"console-7bd788fcd9-dj4c5\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:29.615695 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.615571 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91e59c83-e63a-4ded-82e6-24b35685f59b-serving-certs-ca-bundle\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.615695 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.615614 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/91e59c83-e63a-4ded-82e6-24b35685f59b-telemeter-client-tls\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.615695 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.615659 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91e59c83-e63a-4ded-82e6-24b35685f59b-metrics-client-ca\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.615695 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.615694 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzcpv\" (UniqueName: \"kubernetes.io/projected/91e59c83-e63a-4ded-82e6-24b35685f59b-kube-api-access-lzcpv\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.615962 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.615736 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-trusted-ca-bundle\") pod \"console-7bd788fcd9-dj4c5\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:29.615962 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.615791 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/91e59c83-e63a-4ded-82e6-24b35685f59b-secret-telemeter-client\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.615962 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.615825 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr9bj\" (UniqueName: \"kubernetes.io/projected/81253610-0451-4715-88e5-10e6aedea2bc-kube-api-access-lr9bj\") pod \"console-7bd788fcd9-dj4c5\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:29.615962 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.615870 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91e59c83-e63a-4ded-82e6-24b35685f59b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.615962 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.615900 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-oauth-serving-cert\") pod \"console-7bd788fcd9-dj4c5\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:29.615962 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.615934 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-service-ca\") pod \"console-7bd788fcd9-dj4c5\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:29.616242 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.616012 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/91e59c83-e63a-4ded-82e6-24b35685f59b-federate-client-tls\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.616375 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.616339 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91e59c83-e63a-4ded-82e6-24b35685f59b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.616432 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.616400 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-console-config\") pod \"console-7bd788fcd9-dj4c5\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:29.616801 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.616697 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-service-ca\") pod \"console-7bd788fcd9-dj4c5\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:29.616801 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.616750 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-oauth-serving-cert\") pod \"console-7bd788fcd9-dj4c5\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:29.616999 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.616978 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-trusted-ca-bundle\") pod \"console-7bd788fcd9-dj4c5\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:29.617110 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.617092 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-console-config\") pod \"console-7bd788fcd9-dj4c5\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:29.618680 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.618657 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81253610-0451-4715-88e5-10e6aedea2bc-console-oauth-config\") pod \"console-7bd788fcd9-dj4c5\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:29.618787 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.618743 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81253610-0451-4715-88e5-10e6aedea2bc-console-serving-cert\") pod \"console-7bd788fcd9-dj4c5\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:29.624432 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.624389 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr9bj\" (UniqueName: \"kubernetes.io/projected/81253610-0451-4715-88e5-10e6aedea2bc-kube-api-access-lr9bj\") pod \"console-7bd788fcd9-dj4c5\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:29.677278 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.677252 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b75f899df-j59pw"] Jun 07 16:06:29.680285 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:06:29.680245 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27dd4f60_c766_4787_bbc5_bd8968eac82f.slice/crio-99cd2817efbffe8342eeab5e08a24724f225d0ad3c437518d809c715d76b6e8c WatchSource:0}: Error finding container 99cd2817efbffe8342eeab5e08a24724f225d0ad3c437518d809c715d76b6e8c: Status 404 returned error can't find the container with id 99cd2817efbffe8342eeab5e08a24724f225d0ad3c437518d809c715d76b6e8c Jun 07 16:06:29.717630 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.717600 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/91e59c83-e63a-4ded-82e6-24b35685f59b-federate-client-tls\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.717731 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.717650 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91e59c83-e63a-4ded-82e6-24b35685f59b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.717731 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.717704 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91e59c83-e63a-4ded-82e6-24b35685f59b-serving-certs-ca-bundle\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.717931 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.717746 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/91e59c83-e63a-4ded-82e6-24b35685f59b-telemeter-client-tls\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.717931 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.717803 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91e59c83-e63a-4ded-82e6-24b35685f59b-metrics-client-ca\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.717931 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.717834 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzcpv\" (UniqueName: \"kubernetes.io/projected/91e59c83-e63a-4ded-82e6-24b35685f59b-kube-api-access-lzcpv\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.718188 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.718159 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3cd9e2f6-4e4b-4a18-82af-8e36be0b98c8-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-qw2ph\" (UID: \"3cd9e2f6-4e4b-4a18-82af-8e36be0b98c8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qw2ph" Jun 07 16:06:29.718319 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.718213 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/91e59c83-e63a-4ded-82e6-24b35685f59b-secret-telemeter-client\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.718319 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.718253 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91e59c83-e63a-4ded-82e6-24b35685f59b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.718528 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.718498 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91e59c83-e63a-4ded-82e6-24b35685f59b-serving-certs-ca-bundle\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.719077 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.719011 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91e59c83-e63a-4ded-82e6-24b35685f59b-metrics-client-ca\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.719190 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.719163 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91e59c83-e63a-4ded-82e6-24b35685f59b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.720943 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.720917 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3cd9e2f6-4e4b-4a18-82af-8e36be0b98c8-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-qw2ph\" (UID: \"3cd9e2f6-4e4b-4a18-82af-8e36be0b98c8\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qw2ph" Jun 07 16:06:29.721033 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.721007 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/91e59c83-e63a-4ded-82e6-24b35685f59b-secret-telemeter-client\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.721093 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.721037 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91e59c83-e63a-4ded-82e6-24b35685f59b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.721440 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.721409 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/91e59c83-e63a-4ded-82e6-24b35685f59b-federate-client-tls\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.721669 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.721651 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/91e59c83-e63a-4ded-82e6-24b35685f59b-telemeter-client-tls\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.725584 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.725560 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzcpv\" (UniqueName: \"kubernetes.io/projected/91e59c83-e63a-4ded-82e6-24b35685f59b-kube-api-access-lzcpv\") pod \"telemeter-client-78cb7b6748-hfwz6\" (UID: \"91e59c83-e63a-4ded-82e6-24b35685f59b\") " pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.744598 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.744577 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:29.819282 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.819085 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" event={"ID":"132f3857-6eb1-4437-a70f-aa80624c93d3","Type":"ContainerStarted","Data":"6b787c1db086a20c7c1cecfbd79cc988334870ea69fc388707489ef072cf2ced"} Jun 07 16:06:29.819282 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.819183 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" event={"ID":"132f3857-6eb1-4437-a70f-aa80624c93d3","Type":"ContainerStarted","Data":"2d739fc3159cedcb953c2e25a031c81e0be46023c8e4dd49098261d9c4239205"} Jun 07 16:06:29.819282 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.819217 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" event={"ID":"132f3857-6eb1-4437-a70f-aa80624c93d3","Type":"ContainerStarted","Data":"2d9a8b3e4f821a95ceb93ab7d41d9d0b4d37c96b02226cd322fc7cbbeac21d7b"} Jun 07 16:06:29.820967 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.820942 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" event={"ID":"27dd4f60-c766-4787-bbc5-bd8968eac82f","Type":"ContainerStarted","Data":"99cd2817efbffe8342eeab5e08a24724f225d0ad3c437518d809c715d76b6e8c"} Jun 07 16:06:29.825170 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.825124 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" Jun 07 16:06:29.891619 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.890250 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd788fcd9-dj4c5"] Jun 07 16:06:29.949020 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.948995 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qw2ph" Jun 07 16:06:29.978804 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:29.978780 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78cb7b6748-hfwz6"] Jun 07 16:06:29.981897 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:06:29.981874 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e59c83_e63a_4ded_82e6_24b35685f59b.slice/crio-294e15a4fe9856d10346aab33f7e93811076c4a4953dab3235035db637e1a790 WatchSource:0}: Error finding container 294e15a4fe9856d10346aab33f7e93811076c4a4953dab3235035db637e1a790: Status 404 returned error can't find the container with id 294e15a4fe9856d10346aab33f7e93811076c4a4953dab3235035db637e1a790 Jun 07 16:06:30.085856 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.085826 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-qw2ph"] Jun 07 16:06:30.088675 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:06:30.088653 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cd9e2f6_4e4b_4a18_82af_8e36be0b98c8.slice/crio-5110cab6ce1573b4d81bd9c8f6c988b20b07fc601392d4eff31bd4baeff9aa4c WatchSource:0}: Error finding container 5110cab6ce1573b4d81bd9c8f6c988b20b07fc601392d4eff31bd4baeff9aa4c: Status 404 returned error can't find the container with id 5110cab6ce1573b4d81bd9c8f6c988b20b07fc601392d4eff31bd4baeff9aa4c Jun 07 16:06:30.432777 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.432667 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 07 16:06:30.438095 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.438045 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.441903 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.441269 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 07 16:06:30.441903 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.441345 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 07 16:06:30.441903 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.441380 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4hbktnb2uc4di\"" Jun 07 16:06:30.441903 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.441557 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 07 16:06:30.441903 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.441606 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 07 16:06:30.441903 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.441639 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 07 16:06:30.441903 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.441665 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 07 16:06:30.441903 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.441737 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 07 16:06:30.441903 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.441559 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 07 16:06:30.441903 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.441887 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6n5xw\"" Jun 07 16:06:30.442401 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.442025 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 07 16:06:30.442401 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.442089 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 07 16:06:30.442401 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.442367 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 07 16:06:30.442401 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.442386 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 07 16:06:30.442853 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.442831 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 07 16:06:30.443977 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.443957 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 07 16:06:30.453595 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.453504 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 07 16:06:30.525541 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.525445 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-web-config\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.525541 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.525494 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.525541 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.525516 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d518bdf1-ba18-4caf-94c6-b7981cce19eb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.525541 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.525533 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d518bdf1-ba18-4caf-94c6-b7981cce19eb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.525883 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.525555 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.525883 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.525580 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d518bdf1-ba18-4caf-94c6-b7981cce19eb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.525883 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.525601 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d518bdf1-ba18-4caf-94c6-b7981cce19eb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.525883 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.525634 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d518bdf1-ba18-4caf-94c6-b7981cce19eb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.525883 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.525666 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.525883 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.525696 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.525883 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.525717 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d518bdf1-ba18-4caf-94c6-b7981cce19eb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.525883 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.525740 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd55v\" (UniqueName: \"kubernetes.io/projected/d518bdf1-ba18-4caf-94c6-b7981cce19eb-kube-api-access-gd55v\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.525883 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.525820 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d518bdf1-ba18-4caf-94c6-b7981cce19eb-config-out\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.525883 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.525838 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.525883 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.525873 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.525883 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.525914 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d518bdf1-ba18-4caf-94c6-b7981cce19eb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.526981 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.525947 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.526981 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.525969 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d518bdf1-ba18-4caf-94c6-b7981cce19eb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.526981 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.525999 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-config\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.526981 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.526134 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d518bdf1-ba18-4caf-94c6-b7981cce19eb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.626717 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.626693 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.626835 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.626729 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d518bdf1-ba18-4caf-94c6-b7981cce19eb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.626835 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.626777 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d518bdf1-ba18-4caf-94c6-b7981cce19eb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.626835 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.626811 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d518bdf1-ba18-4caf-94c6-b7981cce19eb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.626974 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.626852 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.626974 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.626877 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.626974 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.626901 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d518bdf1-ba18-4caf-94c6-b7981cce19eb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.626974 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.626928 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd55v\" (UniqueName: \"kubernetes.io/projected/d518bdf1-ba18-4caf-94c6-b7981cce19eb-kube-api-access-gd55v\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.626974 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.626943 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d518bdf1-ba18-4caf-94c6-b7981cce19eb-config-out\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.626974 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.626960 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.627286 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.626977 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.627286 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.626999 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d518bdf1-ba18-4caf-94c6-b7981cce19eb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.627286 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.627014 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.627286 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.627030 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d518bdf1-ba18-4caf-94c6-b7981cce19eb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.627286 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.627051 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-config\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.627286 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.627113 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d518bdf1-ba18-4caf-94c6-b7981cce19eb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.627286 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.627168 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-web-config\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.627286 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.627204 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.627286 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.627222 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d518bdf1-ba18-4caf-94c6-b7981cce19eb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.627286 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.627237 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d518bdf1-ba18-4caf-94c6-b7981cce19eb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.627751 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.627382 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d518bdf1-ba18-4caf-94c6-b7981cce19eb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.627860 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.627818 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d518bdf1-ba18-4caf-94c6-b7981cce19eb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.627971 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.627948 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d518bdf1-ba18-4caf-94c6-b7981cce19eb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.628864 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.628634 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d518bdf1-ba18-4caf-94c6-b7981cce19eb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.631628 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.629349 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d518bdf1-ba18-4caf-94c6-b7981cce19eb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.631628 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.631093 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d518bdf1-ba18-4caf-94c6-b7981cce19eb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.631628 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.631118 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d518bdf1-ba18-4caf-94c6-b7981cce19eb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.631628 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.631494 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.631981 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.631777 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d518bdf1-ba18-4caf-94c6-b7981cce19eb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.632574 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.632466 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.633053 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.633007 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d518bdf1-ba18-4caf-94c6-b7981cce19eb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.633053 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.633017 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.633994 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.633932 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.634300 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.634116 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.634723 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.634585 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.635003 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.634979 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-web-config\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.635367 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.635324 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-config\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.635602 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.635557 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d518bdf1-ba18-4caf-94c6-b7981cce19eb-config-out\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.636718 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.636696 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d518bdf1-ba18-4caf-94c6-b7981cce19eb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.637719 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.637692 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd55v\" (UniqueName: \"kubernetes.io/projected/d518bdf1-ba18-4caf-94c6-b7981cce19eb-kube-api-access-gd55v\") pod \"prometheus-k8s-0\" (UID: \"d518bdf1-ba18-4caf-94c6-b7981cce19eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.754878 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.754806 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:30.832609 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.832568 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" event={"ID":"132f3857-6eb1-4437-a70f-aa80624c93d3","Type":"ContainerStarted","Data":"63ad262d62ef205ee13a72f79681e2eee9a9ffd0595e90a192c0a70254d975b2"} Jun 07 16:06:30.832875 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.832659 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" event={"ID":"132f3857-6eb1-4437-a70f-aa80624c93d3","Type":"ContainerStarted","Data":"5acd140599b3b2715cc6885fcfb67ef8bb0aecfd428433d5b3e3ffd998d8cbe7"} Jun 07 16:06:30.834325 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.834295 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qw2ph" event={"ID":"3cd9e2f6-4e4b-4a18-82af-8e36be0b98c8","Type":"ContainerStarted","Data":"5110cab6ce1573b4d81bd9c8f6c988b20b07fc601392d4eff31bd4baeff9aa4c"} Jun 07 16:06:30.835748 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.835720 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" event={"ID":"91e59c83-e63a-4ded-82e6-24b35685f59b","Type":"ContainerStarted","Data":"294e15a4fe9856d10346aab33f7e93811076c4a4953dab3235035db637e1a790"} Jun 07 16:06:30.837679 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.837543 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd788fcd9-dj4c5" event={"ID":"81253610-0451-4715-88e5-10e6aedea2bc","Type":"ContainerStarted","Data":"1c4bf77a6e6f1b90877a8e99faf4c979b421993e9e0138c6c2a0d194224125aa"} Jun 07 16:06:30.837679 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.837584 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd788fcd9-dj4c5" event={"ID":"81253610-0451-4715-88e5-10e6aedea2bc","Type":"ContainerStarted","Data":"8e5f2dd45080499e219f57f2335d33c74963b49d6acc7dd7402e98aa4f6d7bcd"} Jun 07 16:06:30.855082 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:30.855033 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bd788fcd9-dj4c5" podStartSLOduration=1.855005977 podStartE2EDuration="1.855005977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:06:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:30.853212617 +0000 UTC m=+248.251149560" watchObservedRunningTime="2026-06-07 16:06:30.855005977 +0000 UTC m=+248.252942991" Jun 07 16:06:31.342636 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:31.342595 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 07 16:06:31.630277 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:06:31.630245 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd518bdf1_ba18_4caf_94c6_b7981cce19eb.slice/crio-2ef8729c5c58d0893ba1c3776ede9366451faa2f996bb8915556a40ce569e3f9 WatchSource:0}: Error finding container 2ef8729c5c58d0893ba1c3776ede9366451faa2f996bb8915556a40ce569e3f9: Status 404 returned error can't find the container with id 2ef8729c5c58d0893ba1c3776ede9366451faa2f996bb8915556a40ce569e3f9 Jun 07 16:06:31.843619 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:31.843582 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d518bdf1-ba18-4caf-94c6-b7981cce19eb","Type":"ContainerStarted","Data":"2ef8729c5c58d0893ba1c3776ede9366451faa2f996bb8915556a40ce569e3f9"} Jun 07 16:06:31.847148 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:31.847113 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" event={"ID":"132f3857-6eb1-4437-a70f-aa80624c93d3","Type":"ContainerStarted","Data":"62f52f32dc2b473fee9a9b52397a2075e0aa0147eae1e93c7c40dc5009386ea5"} Jun 07 16:06:31.869010 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:31.868951 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" podStartSLOduration=2.242229636 podStartE2EDuration="4.868928599s" totalImagesPullingTime="2.626698963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:06:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:31.86747628 +0000 UTC m=+249.265413225" watchObservedRunningTime="2026-06-07 16:06:31.868928599 +0000 UTC m=+249.266865546" Jun 07 16:06:31.876952 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:31.876910 2579 patch_prober.go:28] interesting pod/console-557d7f6d5f-qsftt container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" start-of-body= Jun 07 16:06:31.877075 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:31.876973 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-557d7f6d5f-qsftt" podUID="8df98a65-04d2-4d7f-b68f-2c05afaf751e" containerName="console" probeResult="failure" output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" Jun 07 16:06:32.852656 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:32.852630 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qw2ph" event={"ID":"3cd9e2f6-4e4b-4a18-82af-8e36be0b98c8","Type":"ContainerStarted","Data":"bceba3cd22c1b1c7e7b80528ee0df8daa40bbdecd86e886bae094d9fa611d5df"} Jun 07 16:06:32.853051 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:32.852873 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qw2ph" Jun 07 16:06:32.854619 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:32.854596 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" event={"ID":"91e59c83-e63a-4ded-82e6-24b35685f59b","Type":"ContainerStarted","Data":"43e44e4bb558b896f72b1898cf9a78158dc47475b8c2eb8b3da7853437e92ed8"} Jun 07 16:06:32.854730 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:32.854639 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" event={"ID":"91e59c83-e63a-4ded-82e6-24b35685f59b","Type":"ContainerStarted","Data":"7ea01eba6f085441b1e86083d80139a346f99834d4671c037875f7d89b6546a0"} Jun 07 16:06:32.856751 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:32.856719 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" event={"ID":"27dd4f60-c766-4787-bbc5-bd8968eac82f","Type":"ContainerStarted","Data":"9b19f00b0c53322c2d84aa6acd63877d65981f974da1a6dc5d24c4d5a5443f20"} Jun 07 16:06:32.857988 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:32.857968 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qw2ph" Jun 07 16:06:32.858220 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:32.858197 2579 generic.go:356] "Generic (PLEG): container finished" podID="d518bdf1-ba18-4caf-94c6-b7981cce19eb" containerID="ac1df90e58344ff21db38044631e131bf891a5938f70442c020800e6dc9b41c8" exitCode=0 Jun 07 16:06:32.858298 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:32.858264 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d518bdf1-ba18-4caf-94c6-b7981cce19eb","Type":"ContainerDied","Data":"ac1df90e58344ff21db38044631e131bf891a5938f70442c020800e6dc9b41c8"} Jun 07 16:06:32.858629 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:32.858611 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:32.867955 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:32.867914 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qw2ph" podStartSLOduration=1.840225188 podStartE2EDuration="3.867902119s" totalImagesPullingTime="2.027676931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:06:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:32.866098662 +0000 UTC m=+250.264035604" watchObservedRunningTime="2026-06-07 16:06:32.867902119 +0000 UTC m=+250.265839089" Jun 07 16:06:32.923382 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:32.923320 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" podStartSLOduration=2.491480003 podStartE2EDuration="4.923297789s" totalImagesPullingTime="2.431817786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:06:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:32.921690867 +0000 UTC m=+250.319627810" watchObservedRunningTime="2026-06-07 16:06:32.923297789 +0000 UTC m=+250.321234736" Jun 07 16:06:33.864831 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:33.864741 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" event={"ID":"91e59c83-e63a-4ded-82e6-24b35685f59b","Type":"ContainerStarted","Data":"4ad7741bfc30b41e96ae7aa1420606705642983394ae8f64bb28991dc70fad2c"} Jun 07 16:06:33.885542 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:33.885485 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-78cb7b6748-hfwz6" podStartSLOduration=2.225744104 podStartE2EDuration="4.885463102s" totalImagesPullingTime="2.659718998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:06:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:33.883426328 +0000 UTC m=+251.281363294" watchObservedRunningTime="2026-06-07 16:06:33.885463102 +0000 UTC m=+251.283400046" Jun 07 16:06:33.981795 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:33.981739 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-557d7f6d5f-qsftt"] Jun 07 16:06:34.873281 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:34.873242 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs\") pod \"network-metrics-daemon-c9g56\" (UID: \"ec607386-1984-4a48-8b69-eb23b7525b9f\") " pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:06:34.876010 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:34.875985 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec607386-1984-4a48-8b69-eb23b7525b9f-metrics-certs\") pod \"network-metrics-daemon-c9g56\" (UID: \"ec607386-1984-4a48-8b69-eb23b7525b9f\") " pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:06:35.104317 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:35.104280 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8hch6\"" Jun 07 16:06:35.113375 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:35.113350 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9g56" Jun 07 16:06:35.815513 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:35.815488 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c9g56"] Jun 07 16:06:35.817018 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:06:35.816988 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec607386_1984_4a48_8b69_eb23b7525b9f.slice/crio-e77bb13e2d00692230648489f66f5b15e0c79487bb5662070634e16f299d883c WatchSource:0}: Error finding container e77bb13e2d00692230648489f66f5b15e0c79487bb5662070634e16f299d883c: Status 404 returned error can't find the container with id e77bb13e2d00692230648489f66f5b15e0c79487bb5662070634e16f299d883c Jun 07 16:06:35.875407 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:35.875372 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c9g56" event={"ID":"ec607386-1984-4a48-8b69-eb23b7525b9f","Type":"ContainerStarted","Data":"e77bb13e2d00692230648489f66f5b15e0c79487bb5662070634e16f299d883c"} Jun 07 16:06:35.877533 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:35.877493 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d518bdf1-ba18-4caf-94c6-b7981cce19eb","Type":"ContainerStarted","Data":"bb711cfed23f8349097aab224d3e041a13fdf37dbf4e5b0901e6c5098ec18659"} Jun 07 16:06:36.884583 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:36.884551 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c9g56" event={"ID":"ec607386-1984-4a48-8b69-eb23b7525b9f","Type":"ContainerStarted","Data":"0ccd9c78ede4e9418d7c5f1b7292f73c938fb12914ee03fc48a50493aa6fc87d"} Jun 07 16:06:36.885024 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:36.884645 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c9g56" event={"ID":"ec607386-1984-4a48-8b69-eb23b7525b9f","Type":"ContainerStarted","Data":"d0a00d587834a3031b22107d7800f00a885b80e423f116f032fc80245b82ae68"} Jun 07 16:06:36.888548 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:36.888520 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d518bdf1-ba18-4caf-94c6-b7981cce19eb","Type":"ContainerStarted","Data":"e9cc01be0bd89ac16b2f7d5c464d108af3936210ab22df1ed7d752b27732c685"} Jun 07 16:06:36.888670 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:36.888620 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d518bdf1-ba18-4caf-94c6-b7981cce19eb","Type":"ContainerStarted","Data":"55731d9f2ed20b26bd7d73db2b6f0a1123c4408b843102bcdf8735703059c894"} Jun 07 16:06:36.888670 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:36.888667 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d518bdf1-ba18-4caf-94c6-b7981cce19eb","Type":"ContainerStarted","Data":"6426b1980e853d1e7fff86717d7d6f9dd199f88fcaa0c175abf4e73ededd3e91"} Jun 07 16:06:36.888816 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:36.888709 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d518bdf1-ba18-4caf-94c6-b7981cce19eb","Type":"ContainerStarted","Data":"093672dc3e307ad782f3e89908b497ac09fc1b175e1af57d5daf645c91c6562d"} Jun 07 16:06:36.888816 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:36.888735 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d518bdf1-ba18-4caf-94c6-b7981cce19eb","Type":"ContainerStarted","Data":"326d0c0a507cbab422dcdd81f0a7617fe0f9f6649361f3997c96be406454ffbb"} Jun 07 16:06:36.899642 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:36.899590 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-c9g56" podStartSLOduration=253.029032071 podStartE2EDuration="4m13.899577284s" totalImagesPullingTime="870.545213ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:36.898734497 +0000 UTC m=+254.296671442" watchObservedRunningTime="2026-06-07 16:06:36.899577284 +0000 UTC m=+254.297514226" Jun 07 16:06:36.924748 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:36.924684 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.913090708 podStartE2EDuration="6.924665711s" totalImagesPullingTime="3.983328864s" totalInitContainerRuntime="28.246139ms" isStatefulPod=false podCreationTimestamp="2026-06-07 16:06:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:06:36.922899639 +0000 UTC m=+254.320836580" watchObservedRunningTime="2026-06-07 16:06:36.924665711 +0000 UTC m=+254.322602654" Jun 07 16:06:38.871892 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:38.871863 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6d5b44485f-4dfsh" Jun 07 16:06:39.745240 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:39.745187 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:39.745443 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:39.745276 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:06:39.746699 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:39.746673 2579 patch_prober.go:28] interesting pod/console-7bd788fcd9-dj4c5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body= Jun 07 16:06:39.746828 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:39.746716 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7bd788fcd9-dj4c5" podUID="81253610-0451-4715-88e5-10e6aedea2bc" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" Jun 07 16:06:40.755311 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:40.755279 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:06:48.963067 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:48.963033 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:48.963678 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:48.963115 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:06:49.745570 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:49.745536 2579 patch_prober.go:28] interesting pod/console-7bd788fcd9-dj4c5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body= Jun 07 16:06:49.745733 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:49.745586 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7bd788fcd9-dj4c5" podUID="81253610-0451-4715-88e5-10e6aedea2bc" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" Jun 07 16:06:54.403470 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:54.403431 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd788fcd9-dj4c5"] Jun 07 16:06:59.006320 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.006285 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-557d7f6d5f-qsftt" podUID="8df98a65-04d2-4d7f-b68f-2c05afaf751e" containerName="console" containerID="cri-o://70bf9aa1725c0fb82a7d9921f085d4eccf4055b003574a49072218db1d3d6f7f" gracePeriod=15 Jun 07 16:06:59.249548 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.249521 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:59.407376 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.407301 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8df98a65-04d2-4d7f-b68f-2c05afaf751e-console-serving-cert\") pod \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " Jun 07 16:06:59.407376 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.407347 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndg5h\" (UniqueName: \"kubernetes.io/projected/8df98a65-04d2-4d7f-b68f-2c05afaf751e-kube-api-access-ndg5h\") pod \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " Jun 07 16:06:59.407583 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.407381 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-service-ca\") pod \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " Jun 07 16:06:59.407583 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.407432 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-console-config\") pod \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " Jun 07 16:06:59.407583 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.407454 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8df98a65-04d2-4d7f-b68f-2c05afaf751e-console-oauth-config\") pod \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " Jun 07 16:06:59.407583 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.407494 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-oauth-serving-cert\") pod \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " Jun 07 16:06:59.407583 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.407520 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-trusted-ca-bundle\") pod \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\" (UID: \"8df98a65-04d2-4d7f-b68f-2c05afaf751e\") " Jun 07 16:06:59.407916 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.407887 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-service-ca" (OuterVolumeSpecName: "service-ca") pod "8df98a65-04d2-4d7f-b68f-2c05afaf751e" (UID: "8df98a65-04d2-4d7f-b68f-2c05afaf751e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:06:59.408068 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.408027 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-console-config" (OuterVolumeSpecName: "console-config") pod "8df98a65-04d2-4d7f-b68f-2c05afaf751e" (UID: "8df98a65-04d2-4d7f-b68f-2c05afaf751e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:06:59.408382 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.408353 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8df98a65-04d2-4d7f-b68f-2c05afaf751e" (UID: "8df98a65-04d2-4d7f-b68f-2c05afaf751e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:06:59.408540 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.408517 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8df98a65-04d2-4d7f-b68f-2c05afaf751e" (UID: "8df98a65-04d2-4d7f-b68f-2c05afaf751e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:06:59.409822 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.409798 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8df98a65-04d2-4d7f-b68f-2c05afaf751e-kube-api-access-ndg5h" (OuterVolumeSpecName: "kube-api-access-ndg5h") pod "8df98a65-04d2-4d7f-b68f-2c05afaf751e" (UID: "8df98a65-04d2-4d7f-b68f-2c05afaf751e"). InnerVolumeSpecName "kube-api-access-ndg5h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:06:59.409921 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.409837 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8df98a65-04d2-4d7f-b68f-2c05afaf751e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8df98a65-04d2-4d7f-b68f-2c05afaf751e" (UID: "8df98a65-04d2-4d7f-b68f-2c05afaf751e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:06:59.409955 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.409931 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8df98a65-04d2-4d7f-b68f-2c05afaf751e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8df98a65-04d2-4d7f-b68f-2c05afaf751e" (UID: "8df98a65-04d2-4d7f-b68f-2c05afaf751e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:06:59.508731 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.508698 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndg5h\" (UniqueName: \"kubernetes.io/projected/8df98a65-04d2-4d7f-b68f-2c05afaf751e-kube-api-access-ndg5h\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:06:59.508731 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.508727 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-service-ca\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:06:59.508731 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.508737 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-console-config\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:06:59.508731 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.508745 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8df98a65-04d2-4d7f-b68f-2c05afaf751e-console-oauth-config\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:06:59.508731 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.508772 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-oauth-serving-cert\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:06:59.509107 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.508784 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8df98a65-04d2-4d7f-b68f-2c05afaf751e-trusted-ca-bundle\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:06:59.509107 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.508793 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8df98a65-04d2-4d7f-b68f-2c05afaf751e-console-serving-cert\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:06:59.991352 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.991319 2579 generic.go:356] "Generic (PLEG): container finished" podID="8df98a65-04d2-4d7f-b68f-2c05afaf751e" containerID="70bf9aa1725c0fb82a7d9921f085d4eccf4055b003574a49072218db1d3d6f7f" exitCode=0 Jun 07 16:06:59.991521 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.991366 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557d7f6d5f-qsftt" Jun 07 16:06:59.991521 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.991385 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557d7f6d5f-qsftt" event={"ID":"8df98a65-04d2-4d7f-b68f-2c05afaf751e","Type":"ContainerDied","Data":"70bf9aa1725c0fb82a7d9921f085d4eccf4055b003574a49072218db1d3d6f7f"} Jun 07 16:06:59.991521 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.991424 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557d7f6d5f-qsftt" event={"ID":"8df98a65-04d2-4d7f-b68f-2c05afaf751e","Type":"ContainerDied","Data":"15d98ba04cee7b5e893ad2e5e8ed8219787a0fd8423c0fef006080237c54a25d"} Jun 07 16:06:59.991521 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:06:59.991443 2579 scope.go:117] "RemoveContainer" containerID="70bf9aa1725c0fb82a7d9921f085d4eccf4055b003574a49072218db1d3d6f7f" Jun 07 16:07:00.003251 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:00.003233 2579 scope.go:117] "RemoveContainer" containerID="70bf9aa1725c0fb82a7d9921f085d4eccf4055b003574a49072218db1d3d6f7f" Jun 07 16:07:00.003529 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:07:00.003507 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70bf9aa1725c0fb82a7d9921f085d4eccf4055b003574a49072218db1d3d6f7f\": container with ID starting with 70bf9aa1725c0fb82a7d9921f085d4eccf4055b003574a49072218db1d3d6f7f not found: ID does not exist" containerID="70bf9aa1725c0fb82a7d9921f085d4eccf4055b003574a49072218db1d3d6f7f" Jun 07 16:07:00.003578 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:00.003538 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70bf9aa1725c0fb82a7d9921f085d4eccf4055b003574a49072218db1d3d6f7f"} err="failed to get container status \"70bf9aa1725c0fb82a7d9921f085d4eccf4055b003574a49072218db1d3d6f7f\": rpc error: code = NotFound desc = could not find container \"70bf9aa1725c0fb82a7d9921f085d4eccf4055b003574a49072218db1d3d6f7f\": container with ID starting with 70bf9aa1725c0fb82a7d9921f085d4eccf4055b003574a49072218db1d3d6f7f not found: ID does not exist" Jun 07 16:07:00.011286 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:00.011262 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-557d7f6d5f-qsftt"] Jun 07 16:07:00.022838 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:00.022806 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-557d7f6d5f-qsftt"] Jun 07 16:07:01.006152 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:01.006114 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8df98a65-04d2-4d7f-b68f-2c05afaf751e" path="/var/lib/kubelet/pods/8df98a65-04d2-4d7f-b68f-2c05afaf751e/volumes" Jun 07 16:07:04.503957 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:07:04.503916 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5qvz9" podUID="843ede38-3aaa-4002-843e-ae71fca510a5" Jun 07 16:07:05.015923 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:05.015894 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5qvz9" Jun 07 16:07:07.981143 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:07.981109 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls\") pod \"dns-default-5qvz9\" (UID: \"843ede38-3aaa-4002-843e-ae71fca510a5\") " pod="openshift-dns/dns-default-5qvz9" Jun 07 16:07:07.983587 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:07.983560 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/843ede38-3aaa-4002-843e-ae71fca510a5-metrics-tls\") pod \"dns-default-5qvz9\" (UID: \"843ede38-3aaa-4002-843e-ae71fca510a5\") " pod="openshift-dns/dns-default-5qvz9" Jun 07 16:07:08.018997 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:08.018970 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g7mpp\"" Jun 07 16:07:08.027097 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:08.027077 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5qvz9" Jun 07 16:07:08.159744 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:08.159710 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5qvz9"] Jun 07 16:07:08.163366 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:07:08.163342 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod843ede38_3aaa_4002_843e_ae71fca510a5.slice/crio-565aec2d830acddd60588b9d6dbd73bb13bb71f2cd78d23bd60c67f6482d9cb7 WatchSource:0}: Error finding container 565aec2d830acddd60588b9d6dbd73bb13bb71f2cd78d23bd60c67f6482d9cb7: Status 404 returned error can't find the container with id 565aec2d830acddd60588b9d6dbd73bb13bb71f2cd78d23bd60c67f6482d9cb7 Jun 07 16:07:08.969300 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:08.969268 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:07:08.973881 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:08.973838 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7b75f899df-j59pw" Jun 07 16:07:09.033721 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:09.033678 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5qvz9" event={"ID":"843ede38-3aaa-4002-843e-ae71fca510a5","Type":"ContainerStarted","Data":"565aec2d830acddd60588b9d6dbd73bb13bb71f2cd78d23bd60c67f6482d9cb7"} Jun 07 16:07:11.044124 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:11.044085 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5qvz9" event={"ID":"843ede38-3aaa-4002-843e-ae71fca510a5","Type":"ContainerStarted","Data":"9a6fe580ee200fc558b83d4094768596ae7ebfcb0dd2b7a29ef326ac45254e4d"} Jun 07 16:07:11.044580 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:11.044139 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5qvz9" event={"ID":"843ede38-3aaa-4002-843e-ae71fca510a5","Type":"ContainerStarted","Data":"c3c83ddc03357269e80369110630d61c8de18b670565c0e72e280e44a9bf21e5"} Jun 07 16:07:11.044580 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:11.044181 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5qvz9" Jun 07 16:07:11.060013 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:11.059967 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5qvz9" podStartSLOduration=251.291069763 podStartE2EDuration="4m13.059950206s" totalImagesPullingTime="1.768880443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:07:11.058517102 +0000 UTC m=+288.456454044" watchObservedRunningTime="2026-06-07 16:07:11.059950206 +0000 UTC m=+288.457887147" Jun 07 16:07:19.424406 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:19.424342 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7bd788fcd9-dj4c5" podUID="81253610-0451-4715-88e5-10e6aedea2bc" containerName="console" containerID="cri-o://1c4bf77a6e6f1b90877a8e99faf4c979b421993e9e0138c6c2a0d194224125aa" gracePeriod=15 Jun 07 16:07:19.667502 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:19.667479 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:07:19.789742 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:19.789704 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lr9bj\" (UniqueName: \"kubernetes.io/projected/81253610-0451-4715-88e5-10e6aedea2bc-kube-api-access-lr9bj\") pod \"81253610-0451-4715-88e5-10e6aedea2bc\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " Jun 07 16:07:19.789931 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:19.789819 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81253610-0451-4715-88e5-10e6aedea2bc-console-serving-cert\") pod \"81253610-0451-4715-88e5-10e6aedea2bc\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " Jun 07 16:07:19.789931 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:19.789850 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-oauth-serving-cert\") pod \"81253610-0451-4715-88e5-10e6aedea2bc\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " Jun 07 16:07:19.789931 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:19.789913 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-trusted-ca-bundle\") pod \"81253610-0451-4715-88e5-10e6aedea2bc\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " Jun 07 16:07:19.790175 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:19.789948 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-service-ca\") pod \"81253610-0451-4715-88e5-10e6aedea2bc\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " Jun 07 16:07:19.790175 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:19.790035 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81253610-0451-4715-88e5-10e6aedea2bc-console-oauth-config\") pod \"81253610-0451-4715-88e5-10e6aedea2bc\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " Jun 07 16:07:19.790175 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:19.790067 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-console-config\") pod \"81253610-0451-4715-88e5-10e6aedea2bc\" (UID: \"81253610-0451-4715-88e5-10e6aedea2bc\") " Jun 07 16:07:19.790490 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:19.790335 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "81253610-0451-4715-88e5-10e6aedea2bc" (UID: "81253610-0451-4715-88e5-10e6aedea2bc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:07:19.790490 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:19.790345 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "81253610-0451-4715-88e5-10e6aedea2bc" (UID: "81253610-0451-4715-88e5-10e6aedea2bc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:07:19.790644 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:19.790536 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-service-ca" (OuterVolumeSpecName: "service-ca") pod "81253610-0451-4715-88e5-10e6aedea2bc" (UID: "81253610-0451-4715-88e5-10e6aedea2bc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:07:19.790644 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:19.790584 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-console-config" (OuterVolumeSpecName: "console-config") pod "81253610-0451-4715-88e5-10e6aedea2bc" (UID: "81253610-0451-4715-88e5-10e6aedea2bc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:07:19.791960 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:19.791938 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81253610-0451-4715-88e5-10e6aedea2bc-kube-api-access-lr9bj" (OuterVolumeSpecName: "kube-api-access-lr9bj") pod "81253610-0451-4715-88e5-10e6aedea2bc" (UID: "81253610-0451-4715-88e5-10e6aedea2bc"). InnerVolumeSpecName "kube-api-access-lr9bj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:07:19.792239 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:19.792220 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81253610-0451-4715-88e5-10e6aedea2bc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "81253610-0451-4715-88e5-10e6aedea2bc" (UID: "81253610-0451-4715-88e5-10e6aedea2bc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:07:19.792327 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:19.792310 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81253610-0451-4715-88e5-10e6aedea2bc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "81253610-0451-4715-88e5-10e6aedea2bc" (UID: "81253610-0451-4715-88e5-10e6aedea2bc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:07:19.890740 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:19.890686 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81253610-0451-4715-88e5-10e6aedea2bc-console-oauth-config\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:07:19.890740 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:19.890731 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-console-config\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:07:19.890740 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:19.890741 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lr9bj\" (UniqueName: \"kubernetes.io/projected/81253610-0451-4715-88e5-10e6aedea2bc-kube-api-access-lr9bj\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:07:19.890740 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:19.890751 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81253610-0451-4715-88e5-10e6aedea2bc-console-serving-cert\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:07:19.890740 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:19.890786 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-oauth-serving-cert\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:07:19.891058 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:19.890795 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-trusted-ca-bundle\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:07:19.891058 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:19.890803 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81253610-0451-4715-88e5-10e6aedea2bc-service-ca\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:07:20.084075 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:20.083987 2579 generic.go:356] "Generic (PLEG): container finished" podID="81253610-0451-4715-88e5-10e6aedea2bc" containerID="1c4bf77a6e6f1b90877a8e99faf4c979b421993e9e0138c6c2a0d194224125aa" exitCode=0 Jun 07 16:07:20.084075 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:20.084044 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd788fcd9-dj4c5" event={"ID":"81253610-0451-4715-88e5-10e6aedea2bc","Type":"ContainerDied","Data":"1c4bf77a6e6f1b90877a8e99faf4c979b421993e9e0138c6c2a0d194224125aa"} Jun 07 16:07:20.084285 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:20.084105 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd788fcd9-dj4c5" event={"ID":"81253610-0451-4715-88e5-10e6aedea2bc","Type":"ContainerDied","Data":"8e5f2dd45080499e219f57f2335d33c74963b49d6acc7dd7402e98aa4f6d7bcd"} Jun 07 16:07:20.084285 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:20.084124 2579 scope.go:117] "RemoveContainer" containerID="1c4bf77a6e6f1b90877a8e99faf4c979b421993e9e0138c6c2a0d194224125aa" Jun 07 16:07:20.084285 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:20.084047 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd788fcd9-dj4c5" Jun 07 16:07:20.092798 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:20.092782 2579 scope.go:117] "RemoveContainer" containerID="1c4bf77a6e6f1b90877a8e99faf4c979b421993e9e0138c6c2a0d194224125aa" Jun 07 16:07:20.093056 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:07:20.093038 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c4bf77a6e6f1b90877a8e99faf4c979b421993e9e0138c6c2a0d194224125aa\": container with ID starting with 1c4bf77a6e6f1b90877a8e99faf4c979b421993e9e0138c6c2a0d194224125aa not found: ID does not exist" containerID="1c4bf77a6e6f1b90877a8e99faf4c979b421993e9e0138c6c2a0d194224125aa" Jun 07 16:07:20.093117 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:20.093067 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c4bf77a6e6f1b90877a8e99faf4c979b421993e9e0138c6c2a0d194224125aa"} err="failed to get container status \"1c4bf77a6e6f1b90877a8e99faf4c979b421993e9e0138c6c2a0d194224125aa\": rpc error: code = NotFound desc = could not find container \"1c4bf77a6e6f1b90877a8e99faf4c979b421993e9e0138c6c2a0d194224125aa\": container with ID starting with 1c4bf77a6e6f1b90877a8e99faf4c979b421993e9e0138c6c2a0d194224125aa not found: ID does not exist" Jun 07 16:07:20.103540 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:20.103510 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd788fcd9-dj4c5"] Jun 07 16:07:20.107105 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:20.107083 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bd788fcd9-dj4c5"] Jun 07 16:07:21.006404 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:21.006367 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81253610-0451-4715-88e5-10e6aedea2bc" path="/var/lib/kubelet/pods/81253610-0451-4715-88e5-10e6aedea2bc/volumes" Jun 07 16:07:21.050295 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:21.050266 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5qvz9" Jun 07 16:07:22.952663 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:22.952635 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cbczx_2c2fb280-4c43-451e-a2a0-3ad84cb1d977/console-operator/1.log" Jun 07 16:07:22.962063 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:22.962042 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-826vv_7734bfb1-0434-4329-b54a-0069b78b45b1/ovn-acl-logging/0.log" Jun 07 16:07:22.963665 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:22.963647 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cbczx_2c2fb280-4c43-451e-a2a0-3ad84cb1d977/console-operator/1.log" Jun 07 16:07:22.965443 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:22.965426 2579 kubelet.go:1648] "Image garbage collection succeeded" Jun 07 16:07:22.971478 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:22.971461 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-826vv_7734bfb1-0434-4329-b54a-0069b78b45b1/ovn-acl-logging/0.log" Jun 07 16:07:30.755412 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:30.755374 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:07:30.776595 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:30.776568 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:07:31.145150 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:07:31.145075 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 16:09:32.898650 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:32.898577 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-xfkcs"] Jun 07 16:09:32.899094 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:32.898938 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8df98a65-04d2-4d7f-b68f-2c05afaf751e" containerName="console" Jun 07 16:09:32.899094 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:32.898949 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8df98a65-04d2-4d7f-b68f-2c05afaf751e" containerName="console" Jun 07 16:09:32.899094 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:32.898960 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81253610-0451-4715-88e5-10e6aedea2bc" containerName="console" Jun 07 16:09:32.899094 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:32.898965 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="81253610-0451-4715-88e5-10e6aedea2bc" containerName="console" Jun 07 16:09:32.899094 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:32.899020 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8df98a65-04d2-4d7f-b68f-2c05afaf751e" containerName="console" Jun 07 16:09:32.899094 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:32.899028 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="81253610-0451-4715-88e5-10e6aedea2bc" containerName="console" Jun 07 16:09:32.901839 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:32.901823 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xfkcs" Jun 07 16:09:32.903849 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:32.903820 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 07 16:09:32.904549 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:32.904533 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-5dmsg\"" Jun 07 16:09:32.904631 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:32.904559 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 07 16:09:32.910311 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:32.910282 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-xfkcs"] Jun 07 16:09:33.033167 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:33.033117 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc8np\" (UniqueName: \"kubernetes.io/projected/848639cc-6f8e-461f-b09d-3b00899fccb6-kube-api-access-xc8np\") pod \"cert-manager-webhook-7dc76cbb94-xfkcs\" (UID: \"848639cc-6f8e-461f-b09d-3b00899fccb6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xfkcs" Jun 07 16:09:33.033167 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:33.033176 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/848639cc-6f8e-461f-b09d-3b00899fccb6-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-xfkcs\" (UID: \"848639cc-6f8e-461f-b09d-3b00899fccb6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xfkcs" Jun 07 16:09:33.134082 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:33.134026 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc8np\" (UniqueName: \"kubernetes.io/projected/848639cc-6f8e-461f-b09d-3b00899fccb6-kube-api-access-xc8np\") pod \"cert-manager-webhook-7dc76cbb94-xfkcs\" (UID: \"848639cc-6f8e-461f-b09d-3b00899fccb6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xfkcs" Jun 07 16:09:33.134082 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:33.134092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/848639cc-6f8e-461f-b09d-3b00899fccb6-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-xfkcs\" (UID: \"848639cc-6f8e-461f-b09d-3b00899fccb6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xfkcs" Jun 07 16:09:33.142512 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:33.142472 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/848639cc-6f8e-461f-b09d-3b00899fccb6-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-xfkcs\" (UID: \"848639cc-6f8e-461f-b09d-3b00899fccb6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xfkcs" Jun 07 16:09:33.142663 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:33.142635 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc8np\" (UniqueName: \"kubernetes.io/projected/848639cc-6f8e-461f-b09d-3b00899fccb6-kube-api-access-xc8np\") pod \"cert-manager-webhook-7dc76cbb94-xfkcs\" (UID: \"848639cc-6f8e-461f-b09d-3b00899fccb6\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xfkcs" Jun 07 16:09:33.219622 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:33.219585 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xfkcs" Jun 07 16:09:33.350073 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:33.349971 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-xfkcs"] Jun 07 16:09:33.352952 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:09:33.352923 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod848639cc_6f8e_461f_b09d_3b00899fccb6.slice/crio-854c7141d348cd9561ef6eab01bc84704e7ad5fc37f16531e0dc13b47da21fd7 WatchSource:0}: Error finding container 854c7141d348cd9561ef6eab01bc84704e7ad5fc37f16531e0dc13b47da21fd7: Status 404 returned error can't find the container with id 854c7141d348cd9561ef6eab01bc84704e7ad5fc37f16531e0dc13b47da21fd7 Jun 07 16:09:33.354862 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:33.354842 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 16:09:33.616387 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:33.616299 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xfkcs" event={"ID":"848639cc-6f8e-461f-b09d-3b00899fccb6","Type":"ContainerStarted","Data":"854c7141d348cd9561ef6eab01bc84704e7ad5fc37f16531e0dc13b47da21fd7"} Jun 07 16:09:36.634455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:36.634399 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xfkcs" event={"ID":"848639cc-6f8e-461f-b09d-3b00899fccb6","Type":"ContainerStarted","Data":"19d71a0bb96ad52ef45fb910cc24ceded0fe2d5987f81cb39ae0789b373f92b8"} Jun 07 16:09:36.634890 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:36.634486 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xfkcs" Jun 07 16:09:36.651254 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:36.651204 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xfkcs" podStartSLOduration=1.459043542 podStartE2EDuration="4.651186729s" totalImagesPullingTime="3.192143187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:09:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:09:36.651029465 +0000 UTC m=+434.048966410" watchObservedRunningTime="2026-06-07 16:09:36.651186729 +0000 UTC m=+434.049123671" Jun 07 16:09:42.640743 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:42.640711 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xfkcs" Jun 07 16:09:52.016317 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:52.016284 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-x2v5f"] Jun 07 16:09:52.019831 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:52.019812 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-x2v5f" Jun 07 16:09:52.021654 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:52.021634 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-l8mzm\"" Jun 07 16:09:52.028696 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:52.028676 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-x2v5f"] Jun 07 16:09:52.080520 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:52.080478 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69554a70-274d-4f0c-b94a-8b97e9956e89-bound-sa-token\") pod \"cert-manager-59c77684cc-x2v5f\" (UID: \"69554a70-274d-4f0c-b94a-8b97e9956e89\") " pod="cert-manager/cert-manager-59c77684cc-x2v5f" Jun 07 16:09:52.080706 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:52.080548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdn27\" (UniqueName: \"kubernetes.io/projected/69554a70-274d-4f0c-b94a-8b97e9956e89-kube-api-access-hdn27\") pod \"cert-manager-59c77684cc-x2v5f\" (UID: \"69554a70-274d-4f0c-b94a-8b97e9956e89\") " pod="cert-manager/cert-manager-59c77684cc-x2v5f" Jun 07 16:09:52.181426 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:52.181395 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69554a70-274d-4f0c-b94a-8b97e9956e89-bound-sa-token\") pod \"cert-manager-59c77684cc-x2v5f\" (UID: \"69554a70-274d-4f0c-b94a-8b97e9956e89\") " pod="cert-manager/cert-manager-59c77684cc-x2v5f" Jun 07 16:09:52.181591 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:52.181445 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdn27\" (UniqueName: \"kubernetes.io/projected/69554a70-274d-4f0c-b94a-8b97e9956e89-kube-api-access-hdn27\") pod \"cert-manager-59c77684cc-x2v5f\" (UID: \"69554a70-274d-4f0c-b94a-8b97e9956e89\") " pod="cert-manager/cert-manager-59c77684cc-x2v5f" Jun 07 16:09:52.189097 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:52.189062 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69554a70-274d-4f0c-b94a-8b97e9956e89-bound-sa-token\") pod \"cert-manager-59c77684cc-x2v5f\" (UID: \"69554a70-274d-4f0c-b94a-8b97e9956e89\") " pod="cert-manager/cert-manager-59c77684cc-x2v5f" Jun 07 16:09:52.189233 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:52.189218 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdn27\" (UniqueName: \"kubernetes.io/projected/69554a70-274d-4f0c-b94a-8b97e9956e89-kube-api-access-hdn27\") pod \"cert-manager-59c77684cc-x2v5f\" (UID: \"69554a70-274d-4f0c-b94a-8b97e9956e89\") " pod="cert-manager/cert-manager-59c77684cc-x2v5f" Jun 07 16:09:52.328792 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:52.328679 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-x2v5f" Jun 07 16:09:52.459444 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:52.459418 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-x2v5f"] Jun 07 16:09:52.462066 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:09:52.462037 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69554a70_274d_4f0c_b94a_8b97e9956e89.slice/crio-0a55de7ad6c16049102d02466ac63fc20faf3bdf20d97299822e9b8d76e23bf3 WatchSource:0}: Error finding container 0a55de7ad6c16049102d02466ac63fc20faf3bdf20d97299822e9b8d76e23bf3: Status 404 returned error can't find the container with id 0a55de7ad6c16049102d02466ac63fc20faf3bdf20d97299822e9b8d76e23bf3 Jun 07 16:09:52.700255 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:52.700160 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-x2v5f" event={"ID":"69554a70-274d-4f0c-b94a-8b97e9956e89","Type":"ContainerStarted","Data":"a6e38296aa07c2fb2d5ddc3e00599c4cf3a899ff04d01b3dba67b47a86ab934d"} Jun 07 16:09:52.700255 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:52.700203 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-x2v5f" event={"ID":"69554a70-274d-4f0c-b94a-8b97e9956e89","Type":"ContainerStarted","Data":"0a55de7ad6c16049102d02466ac63fc20faf3bdf20d97299822e9b8d76e23bf3"} Jun 07 16:09:52.714397 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:09:52.714346 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-x2v5f" podStartSLOduration=0.714331249 podStartE2EDuration="714.331249ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:09:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:09:52.712920078 +0000 UTC m=+450.110857019" watchObservedRunningTime="2026-06-07 16:09:52.714331249 +0000 UTC m=+450.112268190" Jun 07 16:10:07.738466 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:07.738429 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb"] Jun 07 16:10:07.742231 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:07.742206 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" Jun 07 16:10:07.744865 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:07.744839 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 07 16:10:07.744865 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:07.744852 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 07 16:10:07.745034 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:07.744977 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 07 16:10:07.745034 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:07.744983 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-srqqz\"" Jun 07 16:10:07.745254 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:07.745237 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 07 16:10:07.764299 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:07.764267 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb"] Jun 07 16:10:07.816141 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:07.816104 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7c1cf6bd-788a-4e1c-8a71-959e89feccf1-manifests\") pod \"opendatahub-operator-controller-manager-79675d457c-2p5wb\" (UID: \"7c1cf6bd-788a-4e1c-8a71-959e89feccf1\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" Jun 07 16:10:07.816309 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:07.816150 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c1cf6bd-788a-4e1c-8a71-959e89feccf1-webhook-cert\") pod \"opendatahub-operator-controller-manager-79675d457c-2p5wb\" (UID: \"7c1cf6bd-788a-4e1c-8a71-959e89feccf1\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" Jun 07 16:10:07.816309 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:07.816202 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c1cf6bd-788a-4e1c-8a71-959e89feccf1-tmp\") pod \"opendatahub-operator-controller-manager-79675d457c-2p5wb\" (UID: \"7c1cf6bd-788a-4e1c-8a71-959e89feccf1\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" Jun 07 16:10:07.816309 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:07.816236 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtp8k\" (UniqueName: \"kubernetes.io/projected/7c1cf6bd-788a-4e1c-8a71-959e89feccf1-kube-api-access-vtp8k\") pod \"opendatahub-operator-controller-manager-79675d457c-2p5wb\" (UID: \"7c1cf6bd-788a-4e1c-8a71-959e89feccf1\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" Jun 07 16:10:07.816309 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:07.816282 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7c1cf6bd-788a-4e1c-8a71-959e89feccf1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79675d457c-2p5wb\" (UID: \"7c1cf6bd-788a-4e1c-8a71-959e89feccf1\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" Jun 07 16:10:07.917492 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:07.917453 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtp8k\" (UniqueName: \"kubernetes.io/projected/7c1cf6bd-788a-4e1c-8a71-959e89feccf1-kube-api-access-vtp8k\") pod \"opendatahub-operator-controller-manager-79675d457c-2p5wb\" (UID: \"7c1cf6bd-788a-4e1c-8a71-959e89feccf1\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" Jun 07 16:10:07.917717 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:07.917501 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7c1cf6bd-788a-4e1c-8a71-959e89feccf1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79675d457c-2p5wb\" (UID: \"7c1cf6bd-788a-4e1c-8a71-959e89feccf1\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" Jun 07 16:10:07.917717 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:07.917548 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7c1cf6bd-788a-4e1c-8a71-959e89feccf1-manifests\") pod \"opendatahub-operator-controller-manager-79675d457c-2p5wb\" (UID: \"7c1cf6bd-788a-4e1c-8a71-959e89feccf1\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" Jun 07 16:10:07.917717 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:07.917574 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c1cf6bd-788a-4e1c-8a71-959e89feccf1-webhook-cert\") pod \"opendatahub-operator-controller-manager-79675d457c-2p5wb\" (UID: \"7c1cf6bd-788a-4e1c-8a71-959e89feccf1\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" Jun 07 16:10:07.917717 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:07.917594 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c1cf6bd-788a-4e1c-8a71-959e89feccf1-tmp\") pod \"opendatahub-operator-controller-manager-79675d457c-2p5wb\" (UID: \"7c1cf6bd-788a-4e1c-8a71-959e89feccf1\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" Jun 07 16:10:07.918093 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:07.918065 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7c1cf6bd-788a-4e1c-8a71-959e89feccf1-manifests\") pod \"opendatahub-operator-controller-manager-79675d457c-2p5wb\" (UID: \"7c1cf6bd-788a-4e1c-8a71-959e89feccf1\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" Jun 07 16:10:07.920123 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:07.920102 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c1cf6bd-788a-4e1c-8a71-959e89feccf1-tmp\") pod \"opendatahub-operator-controller-manager-79675d457c-2p5wb\" (UID: \"7c1cf6bd-788a-4e1c-8a71-959e89feccf1\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" Jun 07 16:10:07.920466 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:07.920444 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7c1cf6bd-788a-4e1c-8a71-959e89feccf1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79675d457c-2p5wb\" (UID: \"7c1cf6bd-788a-4e1c-8a71-959e89feccf1\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" Jun 07 16:10:07.920507 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:07.920444 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7c1cf6bd-788a-4e1c-8a71-959e89feccf1-webhook-cert\") pod \"opendatahub-operator-controller-manager-79675d457c-2p5wb\" (UID: \"7c1cf6bd-788a-4e1c-8a71-959e89feccf1\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" Jun 07 16:10:07.926393 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:07.926368 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtp8k\" (UniqueName: \"kubernetes.io/projected/7c1cf6bd-788a-4e1c-8a71-959e89feccf1-kube-api-access-vtp8k\") pod \"opendatahub-operator-controller-manager-79675d457c-2p5wb\" (UID: \"7c1cf6bd-788a-4e1c-8a71-959e89feccf1\") " pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" Jun 07 16:10:08.053511 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:08.053431 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" Jun 07 16:10:08.195797 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:08.195747 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb"] Jun 07 16:10:08.199671 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:10:08.199644 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c1cf6bd_788a_4e1c_8a71_959e89feccf1.slice/crio-98a94bdedc0c0f06d1d97714272d7b7c29d29e562fd0aac9e392fc3cf4a13784 WatchSource:0}: Error finding container 98a94bdedc0c0f06d1d97714272d7b7c29d29e562fd0aac9e392fc3cf4a13784: Status 404 returned error can't find the container with id 98a94bdedc0c0f06d1d97714272d7b7c29d29e562fd0aac9e392fc3cf4a13784 Jun 07 16:10:08.773435 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:08.773388 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" event={"ID":"7c1cf6bd-788a-4e1c-8a71-959e89feccf1","Type":"ContainerStarted","Data":"98a94bdedc0c0f06d1d97714272d7b7c29d29e562fd0aac9e392fc3cf4a13784"} Jun 07 16:10:11.789641 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:11.789600 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" event={"ID":"7c1cf6bd-788a-4e1c-8a71-959e89feccf1","Type":"ContainerStarted","Data":"d393eb58013de45bb7bfbacac57388a7316e3e06961caf5900db3ce8790fd679"} Jun 07 16:10:12.795731 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:12.795693 2579 generic.go:356] "Generic (PLEG): container finished" podID="7c1cf6bd-788a-4e1c-8a71-959e89feccf1" containerID="d393eb58013de45bb7bfbacac57388a7316e3e06961caf5900db3ce8790fd679" exitCode=0 Jun 07 16:10:12.796131 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:12.795783 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" event={"ID":"7c1cf6bd-788a-4e1c-8a71-959e89feccf1","Type":"ContainerDied","Data":"d393eb58013de45bb7bfbacac57388a7316e3e06961caf5900db3ce8790fd679"} Jun 07 16:10:13.802551 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:13.802513 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" event={"ID":"7c1cf6bd-788a-4e1c-8a71-959e89feccf1","Type":"ContainerStarted","Data":"e7b46f732feeecf4473733fc0122af58ce7cfa5e96279aa7eba2b6aacbe434f6"} Jun 07 16:10:13.803011 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:13.802608 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" Jun 07 16:10:13.823393 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:13.823337 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" podStartSLOduration=2.612065312 podStartE2EDuration="6.823320801s" totalImagesPullingTime="3.270894635s" totalInitContainerRuntime="940.360854ms" isStatefulPod=false podCreationTimestamp="2026-06-07 16:10:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:10:13.820868386 +0000 UTC m=+471.218805328" watchObservedRunningTime="2026-06-07 16:10:13.823320801 +0000 UTC m=+471.221257742" Jun 07 16:10:24.809433 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:24.809398 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79675d457c-2p5wb" Jun 07 16:10:33.779014 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:33.778980 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-594b75d8b-fkwnp"] Jun 07 16:10:33.782271 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:33.782249 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-594b75d8b-fkwnp" Jun 07 16:10:33.785114 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:33.785071 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 07 16:10:33.785246 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:33.785118 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ng599\"" Jun 07 16:10:33.785246 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:33.785072 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 07 16:10:33.785246 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:33.785117 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:10:33.785378 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:33.785075 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 07 16:10:33.785433 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:33.785413 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 07 16:10:33.792931 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:33.792907 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-594b75d8b-fkwnp"] Jun 07 16:10:33.953934 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:33.953898 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58fb6667-0454-4874-84c7-e76ae9a26d47-manager-config\") pod \"lws-controller-manager-594b75d8b-fkwnp\" (UID: \"58fb6667-0454-4874-84c7-e76ae9a26d47\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-fkwnp" Jun 07 16:10:33.954135 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:33.953948 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58fb6667-0454-4874-84c7-e76ae9a26d47-cert\") pod \"lws-controller-manager-594b75d8b-fkwnp\" (UID: \"58fb6667-0454-4874-84c7-e76ae9a26d47\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-fkwnp" Jun 07 16:10:33.954135 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:33.954003 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsb9q\" (UniqueName: \"kubernetes.io/projected/58fb6667-0454-4874-84c7-e76ae9a26d47-kube-api-access-lsb9q\") pod \"lws-controller-manager-594b75d8b-fkwnp\" (UID: \"58fb6667-0454-4874-84c7-e76ae9a26d47\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-fkwnp" Jun 07 16:10:33.954135 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:33.954030 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58fb6667-0454-4874-84c7-e76ae9a26d47-metrics-cert\") pod \"lws-controller-manager-594b75d8b-fkwnp\" (UID: \"58fb6667-0454-4874-84c7-e76ae9a26d47\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-fkwnp" Jun 07 16:10:34.054917 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:34.054821 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58fb6667-0454-4874-84c7-e76ae9a26d47-cert\") pod \"lws-controller-manager-594b75d8b-fkwnp\" (UID: \"58fb6667-0454-4874-84c7-e76ae9a26d47\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-fkwnp" Jun 07 16:10:34.054917 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:34.054871 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsb9q\" (UniqueName: \"kubernetes.io/projected/58fb6667-0454-4874-84c7-e76ae9a26d47-kube-api-access-lsb9q\") pod \"lws-controller-manager-594b75d8b-fkwnp\" (UID: \"58fb6667-0454-4874-84c7-e76ae9a26d47\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-fkwnp" Jun 07 16:10:34.055148 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:34.055006 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58fb6667-0454-4874-84c7-e76ae9a26d47-metrics-cert\") pod \"lws-controller-manager-594b75d8b-fkwnp\" (UID: \"58fb6667-0454-4874-84c7-e76ae9a26d47\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-fkwnp" Jun 07 16:10:34.055148 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:34.055142 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58fb6667-0454-4874-84c7-e76ae9a26d47-manager-config\") pod \"lws-controller-manager-594b75d8b-fkwnp\" (UID: \"58fb6667-0454-4874-84c7-e76ae9a26d47\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-fkwnp" Jun 07 16:10:34.055736 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:34.055714 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58fb6667-0454-4874-84c7-e76ae9a26d47-manager-config\") pod \"lws-controller-manager-594b75d8b-fkwnp\" (UID: \"58fb6667-0454-4874-84c7-e76ae9a26d47\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-fkwnp" Jun 07 16:10:34.057483 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:34.057462 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58fb6667-0454-4874-84c7-e76ae9a26d47-cert\") pod \"lws-controller-manager-594b75d8b-fkwnp\" (UID: \"58fb6667-0454-4874-84c7-e76ae9a26d47\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-fkwnp" Jun 07 16:10:34.057601 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:34.057519 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58fb6667-0454-4874-84c7-e76ae9a26d47-metrics-cert\") pod \"lws-controller-manager-594b75d8b-fkwnp\" (UID: \"58fb6667-0454-4874-84c7-e76ae9a26d47\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-fkwnp" Jun 07 16:10:34.066541 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:34.066520 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsb9q\" (UniqueName: \"kubernetes.io/projected/58fb6667-0454-4874-84c7-e76ae9a26d47-kube-api-access-lsb9q\") pod \"lws-controller-manager-594b75d8b-fkwnp\" (UID: \"58fb6667-0454-4874-84c7-e76ae9a26d47\") " pod="openshift-lws-operator/lws-controller-manager-594b75d8b-fkwnp" Jun 07 16:10:34.092418 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:34.092393 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-594b75d8b-fkwnp" Jun 07 16:10:34.228117 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:34.228088 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-594b75d8b-fkwnp"] Jun 07 16:10:34.230942 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:10:34.230908 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58fb6667_0454_4874_84c7_e76ae9a26d47.slice/crio-27b7bf5577bcd8bc004c279693d0c8eec2504c2fd6c62add71e767dc59d062ad WatchSource:0}: Error finding container 27b7bf5577bcd8bc004c279693d0c8eec2504c2fd6c62add71e767dc59d062ad: Status 404 returned error can't find the container with id 27b7bf5577bcd8bc004c279693d0c8eec2504c2fd6c62add71e767dc59d062ad Jun 07 16:10:34.900974 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:34.900935 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-594b75d8b-fkwnp" event={"ID":"58fb6667-0454-4874-84c7-e76ae9a26d47","Type":"ContainerStarted","Data":"27b7bf5577bcd8bc004c279693d0c8eec2504c2fd6c62add71e767dc59d062ad"} Jun 07 16:10:37.919463 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:37.919414 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-594b75d8b-fkwnp" event={"ID":"58fb6667-0454-4874-84c7-e76ae9a26d47","Type":"ContainerStarted","Data":"b62f2c84c5559e6a8c55359220368243697b0f7a53609fa61bac96b074ba60e9"} Jun 07 16:10:37.920163 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:37.920139 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-594b75d8b-fkwnp" Jun 07 16:10:37.939001 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:37.938949 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-594b75d8b-fkwnp" podStartSLOduration=2.175226198 podStartE2EDuration="4.938933086s" totalImagesPullingTime="2.763706888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:10:37.937727501 +0000 UTC m=+495.335664444" watchObservedRunningTime="2026-06-07 16:10:37.938933086 +0000 UTC m=+495.336870027" Jun 07 16:10:48.925635 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:48.925598 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-594b75d8b-fkwnp" Jun 07 16:10:57.094295 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:57.094256 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-558f5455c4-bbjxk"] Jun 07 16:10:57.101291 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:57.101270 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-558f5455c4-bbjxk" Jun 07 16:10:57.103168 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:57.103143 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hlg86\"" Jun 07 16:10:57.103431 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:57.103414 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 07 16:10:57.104231 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:57.104208 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-558f5455c4-bbjxk"] Jun 07 16:10:57.178950 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:57.178914 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-855nq\" (UniqueName: \"kubernetes.io/projected/171bf4c2-c75c-41af-8443-44fd191ed8f8-kube-api-access-855nq\") pod \"dashboard-redirect-558f5455c4-bbjxk\" (UID: \"171bf4c2-c75c-41af-8443-44fd191ed8f8\") " pod="opendatahub/dashboard-redirect-558f5455c4-bbjxk" Jun 07 16:10:57.179128 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:57.178998 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/171bf4c2-c75c-41af-8443-44fd191ed8f8-redirect-config\") pod \"dashboard-redirect-558f5455c4-bbjxk\" (UID: \"171bf4c2-c75c-41af-8443-44fd191ed8f8\") " pod="opendatahub/dashboard-redirect-558f5455c4-bbjxk" Jun 07 16:10:57.279702 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:57.279665 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/171bf4c2-c75c-41af-8443-44fd191ed8f8-redirect-config\") pod \"dashboard-redirect-558f5455c4-bbjxk\" (UID: \"171bf4c2-c75c-41af-8443-44fd191ed8f8\") " pod="opendatahub/dashboard-redirect-558f5455c4-bbjxk" Jun 07 16:10:57.279923 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:57.279745 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-855nq\" (UniqueName: \"kubernetes.io/projected/171bf4c2-c75c-41af-8443-44fd191ed8f8-kube-api-access-855nq\") pod \"dashboard-redirect-558f5455c4-bbjxk\" (UID: \"171bf4c2-c75c-41af-8443-44fd191ed8f8\") " pod="opendatahub/dashboard-redirect-558f5455c4-bbjxk" Jun 07 16:10:57.280443 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:57.280416 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/171bf4c2-c75c-41af-8443-44fd191ed8f8-redirect-config\") pod \"dashboard-redirect-558f5455c4-bbjxk\" (UID: \"171bf4c2-c75c-41af-8443-44fd191ed8f8\") " pod="opendatahub/dashboard-redirect-558f5455c4-bbjxk" Jun 07 16:10:57.287195 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:57.287170 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-855nq\" (UniqueName: \"kubernetes.io/projected/171bf4c2-c75c-41af-8443-44fd191ed8f8-kube-api-access-855nq\") pod \"dashboard-redirect-558f5455c4-bbjxk\" (UID: \"171bf4c2-c75c-41af-8443-44fd191ed8f8\") " pod="opendatahub/dashboard-redirect-558f5455c4-bbjxk" Jun 07 16:10:57.413888 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:57.413805 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-558f5455c4-bbjxk" Jun 07 16:10:57.540883 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:57.540855 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-558f5455c4-bbjxk"] Jun 07 16:10:57.543264 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:10:57.543217 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod171bf4c2_c75c_41af_8443_44fd191ed8f8.slice/crio-810d4d94a7556811b34ba7920f8951ed7f1f72f57210df5e846af631171657d6 WatchSource:0}: Error finding container 810d4d94a7556811b34ba7920f8951ed7f1f72f57210df5e846af631171657d6: Status 404 returned error can't find the container with id 810d4d94a7556811b34ba7920f8951ed7f1f72f57210df5e846af631171657d6 Jun 07 16:10:58.017023 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:10:58.016987 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-558f5455c4-bbjxk" event={"ID":"171bf4c2-c75c-41af-8443-44fd191ed8f8","Type":"ContainerStarted","Data":"810d4d94a7556811b34ba7920f8951ed7f1f72f57210df5e846af631171657d6"} Jun 07 16:11:00.028106 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:00.028019 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-558f5455c4-bbjxk" event={"ID":"171bf4c2-c75c-41af-8443-44fd191ed8f8","Type":"ContainerStarted","Data":"b6e896fb2c97a67f6c3949a70d69c2b392b288e360d8b3f757b521fc7e71fada"} Jun 07 16:11:00.042812 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:00.042747 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-558f5455c4-bbjxk" podStartSLOduration=1.014314898 podStartE2EDuration="3.042728878s" totalImagesPullingTime="2.02841398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:10:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:11:00.040713825 +0000 UTC m=+517.438650769" watchObservedRunningTime="2026-06-07 16:11:00.042728878 +0000 UTC m=+517.440665819" Jun 07 16:11:20.794349 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:20.794311 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht"] Jun 07 16:11:20.800795 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:20.800746 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:20.803069 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:20.803030 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 07 16:11:20.803233 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:20.803072 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 07 16:11:20.803233 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:20.803071 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-mmjj8\"" Jun 07 16:11:20.803233 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:20.803040 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 07 16:11:20.807359 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:20.807335 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht"] Jun 07 16:11:21.000652 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.000622 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d957809-1705-4182-9a1b-b367d48ae0b1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.000880 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.000677 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d957809-1705-4182-9a1b-b367d48ae0b1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.000880 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.000819 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d957809-1705-4182-9a1b-b367d48ae0b1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.000880 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.000860 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d957809-1705-4182-9a1b-b367d48ae0b1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.001057 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.000899 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d957809-1705-4182-9a1b-b367d48ae0b1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.001057 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.000932 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d957809-1705-4182-9a1b-b367d48ae0b1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.001057 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.000969 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d957809-1705-4182-9a1b-b367d48ae0b1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.001057 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.001019 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d957809-1705-4182-9a1b-b367d48ae0b1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.001260 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.001092 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2ph7\" (UniqueName: \"kubernetes.io/projected/4d957809-1705-4182-9a1b-b367d48ae0b1-kube-api-access-r2ph7\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.102261 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.102161 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d957809-1705-4182-9a1b-b367d48ae0b1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.102261 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.102218 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d957809-1705-4182-9a1b-b367d48ae0b1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.102491 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.102411 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d957809-1705-4182-9a1b-b367d48ae0b1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.102491 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.102467 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d957809-1705-4182-9a1b-b367d48ae0b1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.102607 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.102501 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d957809-1705-4182-9a1b-b367d48ae0b1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.102607 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.102540 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d957809-1705-4182-9a1b-b367d48ae0b1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.102607 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.102568 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d957809-1705-4182-9a1b-b367d48ae0b1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.102788 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.102616 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d957809-1705-4182-9a1b-b367d48ae0b1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.102788 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.102619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2ph7\" (UniqueName: \"kubernetes.io/projected/4d957809-1705-4182-9a1b-b367d48ae0b1-kube-api-access-r2ph7\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.102788 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.102709 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d957809-1705-4182-9a1b-b367d48ae0b1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.103216 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.102901 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d957809-1705-4182-9a1b-b367d48ae0b1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.103216 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.103075 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d957809-1705-4182-9a1b-b367d48ae0b1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.103216 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.103092 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d957809-1705-4182-9a1b-b367d48ae0b1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.103216 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.103127 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d957809-1705-4182-9a1b-b367d48ae0b1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.105261 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.105230 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d957809-1705-4182-9a1b-b367d48ae0b1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.105359 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.105268 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d957809-1705-4182-9a1b-b367d48ae0b1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.109807 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.109780 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d957809-1705-4182-9a1b-b367d48ae0b1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.109926 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.109885 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2ph7\" (UniqueName: \"kubernetes.io/projected/4d957809-1705-4182-9a1b-b367d48ae0b1-kube-api-access-r2ph7\") pod \"data-science-gateway-data-science-gateway-class-74759f97959tdht\" (UID: \"4d957809-1705-4182-9a1b-b367d48ae0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.112808 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.112780 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:21.257714 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:21.257587 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht"] Jun 07 16:11:21.260482 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:11:21.260446 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d957809_1705_4182_9a1b_b367d48ae0b1.slice/crio-8c8a046fca70d7d39db7d539e89d1b1284b61145fa277a82a1c818e8d25d6158 WatchSource:0}: Error finding container 8c8a046fca70d7d39db7d539e89d1b1284b61145fa277a82a1c818e8d25d6158: Status 404 returned error can't find the container with id 8c8a046fca70d7d39db7d539e89d1b1284b61145fa277a82a1c818e8d25d6158 Jun 07 16:11:22.137782 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:22.135145 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" event={"ID":"4d957809-1705-4182-9a1b-b367d48ae0b1","Type":"ContainerStarted","Data":"8c8a046fca70d7d39db7d539e89d1b1284b61145fa277a82a1c818e8d25d6158"} Jun 07 16:11:25.299885 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:25.299843 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 07 16:11:25.300268 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:25.299931 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 07 16:11:25.300268 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:25.299977 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 07 16:11:26.154426 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:26.154394 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" event={"ID":"4d957809-1705-4182-9a1b-b367d48ae0b1","Type":"ContainerStarted","Data":"69f1ce14a1df2b1ca19ba5fb2c5b65c01741f59f763582a75e73395a6bf18e64"} Jun 07 16:11:26.173929 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:26.173879 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" podStartSLOduration=2.136848676 podStartE2EDuration="6.173864332s" totalImagesPullingTime="4.037015656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:11:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:11:26.171037419 +0000 UTC m=+543.568974360" watchObservedRunningTime="2026-06-07 16:11:26.173864332 +0000 UTC m=+543.571801273" Jun 07 16:11:27.113938 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:27.113899 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:27.118914 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:27.118889 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:27.159520 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:27.159493 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:27.160368 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:27.160345 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959tdht" Jun 07 16:11:28.336888 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:28.336852 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f5nmj"] Jun 07 16:11:28.340783 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:28.340744 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f5nmj" Jun 07 16:11:28.343129 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:28.343106 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 07 16:11:28.343865 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:28.343844 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 07 16:11:28.344118 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:28.343994 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-9x42f\"" Jun 07 16:11:28.350040 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:28.350014 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f5nmj"] Jun 07 16:11:28.370237 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:28.370201 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rswrg\" (UniqueName: \"kubernetes.io/projected/ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d-kube-api-access-rswrg\") pod \"kuadrant-operator-catalog-f5nmj\" (UID: \"ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d\") " pod="kuadrant-system/kuadrant-operator-catalog-f5nmj" Jun 07 16:11:28.470717 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:28.470674 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rswrg\" (UniqueName: \"kubernetes.io/projected/ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d-kube-api-access-rswrg\") pod \"kuadrant-operator-catalog-f5nmj\" (UID: \"ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d\") " pod="kuadrant-system/kuadrant-operator-catalog-f5nmj" Jun 07 16:11:28.478310 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:28.478288 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rswrg\" (UniqueName: \"kubernetes.io/projected/ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d-kube-api-access-rswrg\") pod \"kuadrant-operator-catalog-f5nmj\" (UID: \"ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d\") " pod="kuadrant-system/kuadrant-operator-catalog-f5nmj" Jun 07 16:11:28.651627 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:28.651533 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f5nmj" Jun 07 16:11:28.705148 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:28.705107 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f5nmj"] Jun 07 16:11:28.784250 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:28.784213 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f5nmj"] Jun 07 16:11:28.787251 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:11:28.787223 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea7d390b_d6d4_46e3_8a6e_5ee06fdccf4d.slice/crio-49c4935660c8ffef351b07206a83085f68be7ad7e22ac37e127587df206ebdc5 WatchSource:0}: Error finding container 49c4935660c8ffef351b07206a83085f68be7ad7e22ac37e127587df206ebdc5: Status 404 returned error can't find the container with id 49c4935660c8ffef351b07206a83085f68be7ad7e22ac37e127587df206ebdc5 Jun 07 16:11:28.915909 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:28.915831 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fzw4w"] Jun 07 16:11:28.920304 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:28.920287 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fzw4w" Jun 07 16:11:28.926102 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:28.926080 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fzw4w"] Jun 07 16:11:28.974915 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:28.974872 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctm8x\" (UniqueName: \"kubernetes.io/projected/46fb6d3c-aeb3-489f-a3ec-5f4c7108bca9-kube-api-access-ctm8x\") pod \"kuadrant-operator-catalog-fzw4w\" (UID: \"46fb6d3c-aeb3-489f-a3ec-5f4c7108bca9\") " pod="kuadrant-system/kuadrant-operator-catalog-fzw4w" Jun 07 16:11:29.076031 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:29.075996 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctm8x\" (UniqueName: \"kubernetes.io/projected/46fb6d3c-aeb3-489f-a3ec-5f4c7108bca9-kube-api-access-ctm8x\") pod \"kuadrant-operator-catalog-fzw4w\" (UID: \"46fb6d3c-aeb3-489f-a3ec-5f4c7108bca9\") " pod="kuadrant-system/kuadrant-operator-catalog-fzw4w" Jun 07 16:11:29.083258 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:29.083232 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctm8x\" (UniqueName: \"kubernetes.io/projected/46fb6d3c-aeb3-489f-a3ec-5f4c7108bca9-kube-api-access-ctm8x\") pod \"kuadrant-operator-catalog-fzw4w\" (UID: \"46fb6d3c-aeb3-489f-a3ec-5f4c7108bca9\") " pod="kuadrant-system/kuadrant-operator-catalog-fzw4w" Jun 07 16:11:29.170515 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:29.170428 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f5nmj" event={"ID":"ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d","Type":"ContainerStarted","Data":"49c4935660c8ffef351b07206a83085f68be7ad7e22ac37e127587df206ebdc5"} Jun 07 16:11:29.231078 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:29.231038 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fzw4w" Jun 07 16:11:29.374349 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:29.374310 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fzw4w"] Jun 07 16:11:29.422925 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:11:29.422834 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46fb6d3c_aeb3_489f_a3ec_5f4c7108bca9.slice/crio-fa90aae31bcae5cbf0bcf6de60286dc11b5f65583d1ebbbd41943e8e87f3ddc3 WatchSource:0}: Error finding container fa90aae31bcae5cbf0bcf6de60286dc11b5f65583d1ebbbd41943e8e87f3ddc3: Status 404 returned error can't find the container with id fa90aae31bcae5cbf0bcf6de60286dc11b5f65583d1ebbbd41943e8e87f3ddc3 Jun 07 16:11:30.178970 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:30.178715 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fzw4w" event={"ID":"46fb6d3c-aeb3-489f-a3ec-5f4c7108bca9","Type":"ContainerStarted","Data":"fa90aae31bcae5cbf0bcf6de60286dc11b5f65583d1ebbbd41943e8e87f3ddc3"} Jun 07 16:11:32.192155 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:32.192113 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fzw4w" event={"ID":"46fb6d3c-aeb3-489f-a3ec-5f4c7108bca9","Type":"ContainerStarted","Data":"a663625c51305a6481b9121668d3def419212f470bfd9832abe515b656ca66c7"} Jun 07 16:11:32.193702 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:32.193674 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f5nmj" event={"ID":"ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d","Type":"ContainerStarted","Data":"259607e7685c09bc20e2dcd0fafe39de96d03845a014a95ed85b7a5581376dee"} Jun 07 16:11:32.193851 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:32.193717 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-f5nmj" podUID="ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d" containerName="registry-server" containerID="cri-o://259607e7685c09bc20e2dcd0fafe39de96d03845a014a95ed85b7a5581376dee" gracePeriod=2 Jun 07 16:11:32.206363 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:32.206317 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fzw4w" podStartSLOduration=2.210634284 podStartE2EDuration="4.206302028s" totalImagesPullingTime="1.995667744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:11:32.205283955 +0000 UTC m=+549.603220901" watchObservedRunningTime="2026-06-07 16:11:32.206302028 +0000 UTC m=+549.604239006" Jun 07 16:11:32.219003 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:32.218961 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-f5nmj" podStartSLOduration=1.571265948 podStartE2EDuration="4.21894568s" totalImagesPullingTime="2.647679732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:11:32.218197881 +0000 UTC m=+549.616134825" watchObservedRunningTime="2026-06-07 16:11:32.21894568 +0000 UTC m=+549.616882621" Jun 07 16:11:32.450163 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:32.450096 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f5nmj" Jun 07 16:11:32.508515 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:32.508483 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rswrg\" (UniqueName: \"kubernetes.io/projected/ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d-kube-api-access-rswrg\") pod \"ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d\" (UID: \"ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d\") " Jun 07 16:11:32.510878 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:32.510849 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d-kube-api-access-rswrg" (OuterVolumeSpecName: "kube-api-access-rswrg") pod "ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d" (UID: "ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d"). InnerVolumeSpecName "kube-api-access-rswrg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:11:32.609788 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:32.609724 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rswrg\" (UniqueName: \"kubernetes.io/projected/ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d-kube-api-access-rswrg\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:11:33.199339 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:33.199301 2579 generic.go:356] "Generic (PLEG): container finished" podID="ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d" containerID="259607e7685c09bc20e2dcd0fafe39de96d03845a014a95ed85b7a5581376dee" exitCode=0 Jun 07 16:11:33.199797 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:33.199362 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-f5nmj" Jun 07 16:11:33.199797 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:33.199389 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f5nmj" event={"ID":"ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d","Type":"ContainerDied","Data":"259607e7685c09bc20e2dcd0fafe39de96d03845a014a95ed85b7a5581376dee"} Jun 07 16:11:33.199797 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:33.199444 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-f5nmj" event={"ID":"ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d","Type":"ContainerDied","Data":"49c4935660c8ffef351b07206a83085f68be7ad7e22ac37e127587df206ebdc5"} Jun 07 16:11:33.199797 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:33.199464 2579 scope.go:117] "RemoveContainer" containerID="259607e7685c09bc20e2dcd0fafe39de96d03845a014a95ed85b7a5581376dee" Jun 07 16:11:33.208423 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:33.208405 2579 scope.go:117] "RemoveContainer" containerID="259607e7685c09bc20e2dcd0fafe39de96d03845a014a95ed85b7a5581376dee" Jun 07 16:11:33.208683 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:11:33.208656 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"259607e7685c09bc20e2dcd0fafe39de96d03845a014a95ed85b7a5581376dee\": container with ID starting with 259607e7685c09bc20e2dcd0fafe39de96d03845a014a95ed85b7a5581376dee not found: ID does not exist" containerID="259607e7685c09bc20e2dcd0fafe39de96d03845a014a95ed85b7a5581376dee" Jun 07 16:11:33.208799 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:33.208681 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"259607e7685c09bc20e2dcd0fafe39de96d03845a014a95ed85b7a5581376dee"} err="failed to get container status \"259607e7685c09bc20e2dcd0fafe39de96d03845a014a95ed85b7a5581376dee\": rpc error: code = NotFound desc = could not find container \"259607e7685c09bc20e2dcd0fafe39de96d03845a014a95ed85b7a5581376dee\": container with ID starting with 259607e7685c09bc20e2dcd0fafe39de96d03845a014a95ed85b7a5581376dee not found: ID does not exist" Jun 07 16:11:33.213382 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:33.213347 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f5nmj"] Jun 07 16:11:33.215298 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:33.215274 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-f5nmj"] Jun 07 16:11:35.007110 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:35.007066 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d" path="/var/lib/kubelet/pods/ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d/volumes" Jun 07 16:11:39.231685 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:39.231643 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-fzw4w" Jun 07 16:11:39.232105 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:39.231715 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-fzw4w" Jun 07 16:11:39.254576 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:39.254549 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-fzw4w" Jun 07 16:11:40.255348 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:40.255319 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-fzw4w" Jun 07 16:11:41.463257 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.463222 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69fb956c98-mdqm5"] Jun 07 16:11:41.463869 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.463840 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d" containerName="registry-server" Jun 07 16:11:41.463869 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.463865 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d" containerName="registry-server" Jun 07 16:11:41.464029 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.463956 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea7d390b-d6d4-46e3-8a6e-5ee06fdccf4d" containerName="registry-server" Jun 07 16:11:41.468678 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.468659 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:41.470989 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.470847 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 07 16:11:41.470989 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.470853 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 07 16:11:41.472016 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.471442 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 07 16:11:41.472016 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.471702 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 07 16:11:41.472016 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.471916 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 07 16:11:41.472016 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.471948 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 07 16:11:41.472266 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.472246 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-48p8n\"" Jun 07 16:11:41.472324 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.472297 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 07 16:11:41.476594 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.476570 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 07 16:11:41.479599 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.479577 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69fb956c98-mdqm5"] Jun 07 16:11:41.586300 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.586265 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b7540c9-ee99-4b0c-8a7d-15666f6639f5-console-config\") pod \"console-69fb956c98-mdqm5\" (UID: \"2b7540c9-ee99-4b0c-8a7d-15666f6639f5\") " pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:41.586476 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.586330 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4tqw\" (UniqueName: \"kubernetes.io/projected/2b7540c9-ee99-4b0c-8a7d-15666f6639f5-kube-api-access-t4tqw\") pod \"console-69fb956c98-mdqm5\" (UID: \"2b7540c9-ee99-4b0c-8a7d-15666f6639f5\") " pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:41.586476 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.586387 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b7540c9-ee99-4b0c-8a7d-15666f6639f5-oauth-serving-cert\") pod \"console-69fb956c98-mdqm5\" (UID: \"2b7540c9-ee99-4b0c-8a7d-15666f6639f5\") " pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:41.586476 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.586430 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b7540c9-ee99-4b0c-8a7d-15666f6639f5-trusted-ca-bundle\") pod \"console-69fb956c98-mdqm5\" (UID: \"2b7540c9-ee99-4b0c-8a7d-15666f6639f5\") " pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:41.586476 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.586454 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b7540c9-ee99-4b0c-8a7d-15666f6639f5-console-oauth-config\") pod \"console-69fb956c98-mdqm5\" (UID: \"2b7540c9-ee99-4b0c-8a7d-15666f6639f5\") " pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:41.586621 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.586501 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b7540c9-ee99-4b0c-8a7d-15666f6639f5-console-serving-cert\") pod \"console-69fb956c98-mdqm5\" (UID: \"2b7540c9-ee99-4b0c-8a7d-15666f6639f5\") " pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:41.586621 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.586521 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b7540c9-ee99-4b0c-8a7d-15666f6639f5-service-ca\") pod \"console-69fb956c98-mdqm5\" (UID: \"2b7540c9-ee99-4b0c-8a7d-15666f6639f5\") " pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:41.687644 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.687590 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4tqw\" (UniqueName: \"kubernetes.io/projected/2b7540c9-ee99-4b0c-8a7d-15666f6639f5-kube-api-access-t4tqw\") pod \"console-69fb956c98-mdqm5\" (UID: \"2b7540c9-ee99-4b0c-8a7d-15666f6639f5\") " pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:41.687644 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.687653 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b7540c9-ee99-4b0c-8a7d-15666f6639f5-oauth-serving-cert\") pod \"console-69fb956c98-mdqm5\" (UID: \"2b7540c9-ee99-4b0c-8a7d-15666f6639f5\") " pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:41.687900 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.687698 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b7540c9-ee99-4b0c-8a7d-15666f6639f5-trusted-ca-bundle\") pod \"console-69fb956c98-mdqm5\" (UID: \"2b7540c9-ee99-4b0c-8a7d-15666f6639f5\") " pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:41.687900 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.687727 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b7540c9-ee99-4b0c-8a7d-15666f6639f5-console-oauth-config\") pod \"console-69fb956c98-mdqm5\" (UID: \"2b7540c9-ee99-4b0c-8a7d-15666f6639f5\") " pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:41.687900 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.687800 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b7540c9-ee99-4b0c-8a7d-15666f6639f5-console-serving-cert\") pod \"console-69fb956c98-mdqm5\" (UID: \"2b7540c9-ee99-4b0c-8a7d-15666f6639f5\") " pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:41.687900 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.687832 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b7540c9-ee99-4b0c-8a7d-15666f6639f5-service-ca\") pod \"console-69fb956c98-mdqm5\" (UID: \"2b7540c9-ee99-4b0c-8a7d-15666f6639f5\") " pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:41.687900 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.687876 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b7540c9-ee99-4b0c-8a7d-15666f6639f5-console-config\") pod \"console-69fb956c98-mdqm5\" (UID: \"2b7540c9-ee99-4b0c-8a7d-15666f6639f5\") " pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:41.688524 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.688491 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2b7540c9-ee99-4b0c-8a7d-15666f6639f5-oauth-serving-cert\") pod \"console-69fb956c98-mdqm5\" (UID: \"2b7540c9-ee99-4b0c-8a7d-15666f6639f5\") " pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:41.688643 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.688597 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2b7540c9-ee99-4b0c-8a7d-15666f6639f5-service-ca\") pod \"console-69fb956c98-mdqm5\" (UID: \"2b7540c9-ee99-4b0c-8a7d-15666f6639f5\") " pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:41.688643 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.688621 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2b7540c9-ee99-4b0c-8a7d-15666f6639f5-console-config\") pod \"console-69fb956c98-mdqm5\" (UID: \"2b7540c9-ee99-4b0c-8a7d-15666f6639f5\") " pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:41.688643 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.688624 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b7540c9-ee99-4b0c-8a7d-15666f6639f5-trusted-ca-bundle\") pod \"console-69fb956c98-mdqm5\" (UID: \"2b7540c9-ee99-4b0c-8a7d-15666f6639f5\") " pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:41.690995 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.690979 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b7540c9-ee99-4b0c-8a7d-15666f6639f5-console-serving-cert\") pod \"console-69fb956c98-mdqm5\" (UID: \"2b7540c9-ee99-4b0c-8a7d-15666f6639f5\") " pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:41.691096 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.691075 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2b7540c9-ee99-4b0c-8a7d-15666f6639f5-console-oauth-config\") pod \"console-69fb956c98-mdqm5\" (UID: \"2b7540c9-ee99-4b0c-8a7d-15666f6639f5\") " pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:41.694579 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.694555 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4tqw\" (UniqueName: \"kubernetes.io/projected/2b7540c9-ee99-4b0c-8a7d-15666f6639f5-kube-api-access-t4tqw\") pod \"console-69fb956c98-mdqm5\" (UID: \"2b7540c9-ee99-4b0c-8a7d-15666f6639f5\") " pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:41.781185 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.781096 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:41.915521 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:41.915497 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69fb956c98-mdqm5"] Jun 07 16:11:41.917889 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:11:41.917865 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b7540c9_ee99_4b0c_8a7d_15666f6639f5.slice/crio-e9b7f38ee4f80998844c948640fea15bcaba3ab30ded8a3d919826bf31ef3660 WatchSource:0}: Error finding container e9b7f38ee4f80998844c948640fea15bcaba3ab30ded8a3d919826bf31ef3660: Status 404 returned error can't find the container with id e9b7f38ee4f80998844c948640fea15bcaba3ab30ded8a3d919826bf31ef3660 Jun 07 16:11:42.244317 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:42.244279 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69fb956c98-mdqm5" event={"ID":"2b7540c9-ee99-4b0c-8a7d-15666f6639f5","Type":"ContainerStarted","Data":"d17b18dbf0c0cb4173740710dc312dfa5b308d3100a45068f2ab33c19ba1181d"} Jun 07 16:11:42.244487 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:42.244364 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69fb956c98-mdqm5" event={"ID":"2b7540c9-ee99-4b0c-8a7d-15666f6639f5","Type":"ContainerStarted","Data":"e9b7f38ee4f80998844c948640fea15bcaba3ab30ded8a3d919826bf31ef3660"} Jun 07 16:11:42.261319 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:42.261267 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69fb956c98-mdqm5" podStartSLOduration=1.2612490410000001 podStartE2EDuration="1.261249041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:11:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:11:42.259881843 +0000 UTC m=+559.657818786" watchObservedRunningTime="2026-06-07 16:11:42.261249041 +0000 UTC m=+559.659185982" Jun 07 16:11:51.782072 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:51.782016 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:51.782648 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:51.782098 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:51.787080 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:51.787053 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:11:52.300743 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:11:52.300715 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69fb956c98-mdqm5" Jun 07 16:12:00.691464 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:00.691424 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv"] Jun 07 16:12:00.696920 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:00.696901 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" Jun 07 16:12:00.698938 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:00.698917 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pfh6f\"" Jun 07 16:12:00.702427 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:00.702403 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv"] Jun 07 16:12:00.872968 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:00.872932 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtg5p\" (UniqueName: \"kubernetes.io/projected/4b8cffbd-28ab-4eee-9418-0a868446a0ae-kube-api-access-dtg5p\") pod \"limitador-operator-controller-manager-859d7b78bd-hvpzv\" (UID: \"4b8cffbd-28ab-4eee-9418-0a868446a0ae\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" Jun 07 16:12:00.974413 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:00.974377 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtg5p\" (UniqueName: \"kubernetes.io/projected/4b8cffbd-28ab-4eee-9418-0a868446a0ae-kube-api-access-dtg5p\") pod \"limitador-operator-controller-manager-859d7b78bd-hvpzv\" (UID: \"4b8cffbd-28ab-4eee-9418-0a868446a0ae\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" Jun 07 16:12:00.984780 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:00.984733 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtg5p\" (UniqueName: \"kubernetes.io/projected/4b8cffbd-28ab-4eee-9418-0a868446a0ae-kube-api-access-dtg5p\") pod \"limitador-operator-controller-manager-859d7b78bd-hvpzv\" (UID: \"4b8cffbd-28ab-4eee-9418-0a868446a0ae\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" Jun 07 16:12:01.008816 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:01.008776 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" Jun 07 16:12:01.148111 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:01.148080 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv"] Jun 07 16:12:01.151630 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:12:01.151602 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b8cffbd_28ab_4eee_9418_0a868446a0ae.slice/crio-644615e37346a3820fa1e8b283689fdce535e92b0e8f307447ee9c1252c36d51 WatchSource:0}: Error finding container 644615e37346a3820fa1e8b283689fdce535e92b0e8f307447ee9c1252c36d51: Status 404 returned error can't find the container with id 644615e37346a3820fa1e8b283689fdce535e92b0e8f307447ee9c1252c36d51 Jun 07 16:12:01.339496 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:01.339407 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" event={"ID":"4b8cffbd-28ab-4eee-9418-0a868446a0ae","Type":"ContainerStarted","Data":"644615e37346a3820fa1e8b283689fdce535e92b0e8f307447ee9c1252c36d51"} Jun 07 16:12:03.349777 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:03.349725 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" event={"ID":"4b8cffbd-28ab-4eee-9418-0a868446a0ae","Type":"ContainerStarted","Data":"10ae3da83d2518554405dc4fa6b13c6b787c08a9ab137449ae312828dfe21d75"} Jun 07 16:12:03.350269 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:03.349839 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" Jun 07 16:12:03.373405 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:03.373352 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" podStartSLOduration=1.745025255 podStartE2EDuration="3.373337395s" totalImagesPullingTime="1.62831214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:12:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:12:03.372395478 +0000 UTC m=+580.770332443" watchObservedRunningTime="2026-06-07 16:12:03.373337395 +0000 UTC m=+580.771274336" Jun 07 16:12:05.822079 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:05.822040 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq"] Jun 07 16:12:05.830412 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:05.830384 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:05.832965 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:05.832937 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9wrrz\"" Jun 07 16:12:05.839515 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:05.839490 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq"] Jun 07 16:12:05.919308 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:05.919265 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtxd2\" (UniqueName: \"kubernetes.io/projected/d270e645-e877-4ca1-9ed8-1fbfe2063070-kube-api-access-wtxd2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c2bwq\" (UID: \"d270e645-e877-4ca1-9ed8-1fbfe2063070\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:05.919487 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:05.919419 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d270e645-e877-4ca1-9ed8-1fbfe2063070-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c2bwq\" (UID: \"d270e645-e877-4ca1-9ed8-1fbfe2063070\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:06.020011 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:06.019970 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtxd2\" (UniqueName: \"kubernetes.io/projected/d270e645-e877-4ca1-9ed8-1fbfe2063070-kube-api-access-wtxd2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c2bwq\" (UID: \"d270e645-e877-4ca1-9ed8-1fbfe2063070\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:06.020183 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:06.020077 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d270e645-e877-4ca1-9ed8-1fbfe2063070-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c2bwq\" (UID: \"d270e645-e877-4ca1-9ed8-1fbfe2063070\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:06.020399 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:06.020382 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d270e645-e877-4ca1-9ed8-1fbfe2063070-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c2bwq\" (UID: \"d270e645-e877-4ca1-9ed8-1fbfe2063070\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:06.028545 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:06.028517 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtxd2\" (UniqueName: \"kubernetes.io/projected/d270e645-e877-4ca1-9ed8-1fbfe2063070-kube-api-access-wtxd2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c2bwq\" (UID: \"d270e645-e877-4ca1-9ed8-1fbfe2063070\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:06.142262 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:06.142176 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:06.287472 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:06.287438 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq"] Jun 07 16:12:06.291195 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:12:06.291162 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd270e645_e877_4ca1_9ed8_1fbfe2063070.slice/crio-cb7220dc9b8bd43b5930aeed5483730858525beb021f75973cc94dcb89ebc03e WatchSource:0}: Error finding container cb7220dc9b8bd43b5930aeed5483730858525beb021f75973cc94dcb89ebc03e: Status 404 returned error can't find the container with id cb7220dc9b8bd43b5930aeed5483730858525beb021f75973cc94dcb89ebc03e Jun 07 16:12:06.371102 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:06.371067 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" event={"ID":"d270e645-e877-4ca1-9ed8-1fbfe2063070","Type":"ContainerStarted","Data":"cb7220dc9b8bd43b5930aeed5483730858525beb021f75973cc94dcb89ebc03e"} Jun 07 16:12:11.898387 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:11.898278 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dddnd"] Jun 07 16:12:11.901986 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:11.901970 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dddnd" Jun 07 16:12:11.904105 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:11.904077 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 07 16:12:11.904235 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:11.904121 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-j46mh\"" Jun 07 16:12:11.911131 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:11.911106 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dddnd"] Jun 07 16:12:11.975262 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:11.975226 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2hzc\" (UniqueName: \"kubernetes.io/projected/d6744aec-382f-47eb-9fba-0978a2fbf256-kube-api-access-r2hzc\") pod \"dns-operator-controller-manager-864dd78c4c-dddnd\" (UID: \"d6744aec-382f-47eb-9fba-0978a2fbf256\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dddnd" Jun 07 16:12:12.076285 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:12.076251 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2hzc\" (UniqueName: \"kubernetes.io/projected/d6744aec-382f-47eb-9fba-0978a2fbf256-kube-api-access-r2hzc\") pod \"dns-operator-controller-manager-864dd78c4c-dddnd\" (UID: \"d6744aec-382f-47eb-9fba-0978a2fbf256\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dddnd" Jun 07 16:12:12.096062 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:12.096034 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2hzc\" (UniqueName: \"kubernetes.io/projected/d6744aec-382f-47eb-9fba-0978a2fbf256-kube-api-access-r2hzc\") pod \"dns-operator-controller-manager-864dd78c4c-dddnd\" (UID: \"d6744aec-382f-47eb-9fba-0978a2fbf256\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dddnd" Jun 07 16:12:12.213727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:12.213699 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dddnd" Jun 07 16:12:12.353380 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:12.353352 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-dddnd"] Jun 07 16:12:12.355519 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:12:12.355492 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6744aec_382f_47eb_9fba_0978a2fbf256.slice/crio-353a91caf009a8fb3a54ae014f7af5f0ab3e4e75ec7524009a140899f316d04a WatchSource:0}: Error finding container 353a91caf009a8fb3a54ae014f7af5f0ab3e4e75ec7524009a140899f316d04a: Status 404 returned error can't find the container with id 353a91caf009a8fb3a54ae014f7af5f0ab3e4e75ec7524009a140899f316d04a Jun 07 16:12:12.405855 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:12.405813 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" event={"ID":"d270e645-e877-4ca1-9ed8-1fbfe2063070","Type":"ContainerStarted","Data":"a4fd0d6de8433e996580665ccc9892d87d83aa9c954d85f4365abf2f3a346e01"} Jun 07 16:12:12.406034 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:12.406015 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:12.407122 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:12.407099 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dddnd" event={"ID":"d6744aec-382f-47eb-9fba-0978a2fbf256","Type":"ContainerStarted","Data":"353a91caf009a8fb3a54ae014f7af5f0ab3e4e75ec7524009a140899f316d04a"} Jun 07 16:12:12.425160 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:12.425109 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" podStartSLOduration=2.071505287 podStartE2EDuration="7.425096419s" totalImagesPullingTime="5.353591132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:12:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:12:12.423891574 +0000 UTC m=+589.821828517" watchObservedRunningTime="2026-06-07 16:12:12.425096419 +0000 UTC m=+589.823033362" Jun 07 16:12:14.356170 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:14.356136 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" Jun 07 16:12:14.420713 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:14.420677 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dddnd" event={"ID":"d6744aec-382f-47eb-9fba-0978a2fbf256","Type":"ContainerStarted","Data":"c19ac3e7ab617d1c7c120e07443dee938104e7817b19a4208788c629486f3da1"} Jun 07 16:12:14.420913 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:14.420786 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dddnd" Jun 07 16:12:14.436326 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:14.436273 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dddnd" podStartSLOduration=1.557990899 podStartE2EDuration="3.436258261s" totalImagesPullingTime="1.878267362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:12:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:12:14.434792429 +0000 UTC m=+591.832729390" watchObservedRunningTime="2026-06-07 16:12:14.436258261 +0000 UTC m=+591.834195202" Jun 07 16:12:22.994170 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:22.994139 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cbczx_2c2fb280-4c43-451e-a2a0-3ad84cb1d977/console-operator/1.log" Jun 07 16:12:22.997363 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:22.997337 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cbczx_2c2fb280-4c43-451e-a2a0-3ad84cb1d977/console-operator/1.log" Jun 07 16:12:23.002337 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:23.002162 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-826vv_7734bfb1-0434-4329-b54a-0069b78b45b1/ovn-acl-logging/0.log" Jun 07 16:12:23.006409 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:23.006392 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-826vv_7734bfb1-0434-4329-b54a-0069b78b45b1/ovn-acl-logging/0.log" Jun 07 16:12:23.415458 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:23.415376 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:24.566105 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:24.566069 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r9bsw"] Jun 07 16:12:24.571157 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:24.571135 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r9bsw" Jun 07 16:12:24.586660 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:24.586628 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r9bsw"] Jun 07 16:12:24.682260 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:24.682224 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r9bsw"] Jun 07 16:12:24.682583 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:24.682558 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-4tc7x], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r9bsw" podUID="8d1add49-f775-420a-9e1b-3e7ddfbb3381" Jun 07 16:12:24.686251 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:24.686227 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tc7x\" (UniqueName: \"kubernetes.io/projected/8d1add49-f775-420a-9e1b-3e7ddfbb3381-kube-api-access-4tc7x\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-r9bsw\" (UID: \"8d1add49-f775-420a-9e1b-3e7ddfbb3381\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r9bsw" Jun 07 16:12:24.686316 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:24.686294 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d1add49-f775-420a-9e1b-3e7ddfbb3381-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-r9bsw\" (UID: \"8d1add49-f775-420a-9e1b-3e7ddfbb3381\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r9bsw" Jun 07 16:12:24.787645 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:24.787599 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d1add49-f775-420a-9e1b-3e7ddfbb3381-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-r9bsw\" (UID: \"8d1add49-f775-420a-9e1b-3e7ddfbb3381\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r9bsw" Jun 07 16:12:24.787863 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:24.787677 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tc7x\" (UniqueName: \"kubernetes.io/projected/8d1add49-f775-420a-9e1b-3e7ddfbb3381-kube-api-access-4tc7x\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-r9bsw\" (UID: \"8d1add49-f775-420a-9e1b-3e7ddfbb3381\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r9bsw" Jun 07 16:12:24.788049 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:24.788008 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d1add49-f775-420a-9e1b-3e7ddfbb3381-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-r9bsw\" (UID: \"8d1add49-f775-420a-9e1b-3e7ddfbb3381\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r9bsw" Jun 07 16:12:24.801325 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:24.801296 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tc7x\" (UniqueName: \"kubernetes.io/projected/8d1add49-f775-420a-9e1b-3e7ddfbb3381-kube-api-access-4tc7x\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-r9bsw\" (UID: \"8d1add49-f775-420a-9e1b-3e7ddfbb3381\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r9bsw" Jun 07 16:12:25.151020 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.150983 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r9bsw"] Jun 07 16:12:25.161833 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.161803 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r9bsw"] Jun 07 16:12:25.176270 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.176242 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq"] Jun 07 16:12:25.176434 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.176411 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" podUID="d270e645-e877-4ca1-9ed8-1fbfe2063070" containerName="manager" containerID="cri-o://a4fd0d6de8433e996580665ccc9892d87d83aa9c954d85f4365abf2f3a346e01" gracePeriod=2 Jun 07 16:12:25.189487 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.189456 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq"] Jun 07 16:12:25.196825 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.196741 2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d270e645-e877-4ca1-9ed8-1fbfe2063070\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-c2bwq\": pods \"kuadrant-operator-controller-manager-8684c9ff49-c2bwq\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:25.199309 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.199282 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv"] Jun 07 16:12:25.199532 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.199508 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" podUID="4b8cffbd-28ab-4eee-9418-0a868446a0ae" containerName="manager" containerID="cri-o://10ae3da83d2518554405dc4fa6b13c6b787c08a9ab137449ae312828dfe21d75" gracePeriod=2 Jun 07 16:12:25.203661 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.203636 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq"] Jun 07 16:12:25.204060 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.204047 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d270e645-e877-4ca1-9ed8-1fbfe2063070" containerName="manager" Jun 07 16:12:25.204111 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.204062 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d270e645-e877-4ca1-9ed8-1fbfe2063070" containerName="manager" Jun 07 16:12:25.204148 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.204140 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d270e645-e877-4ca1-9ed8-1fbfe2063070" containerName="manager" Jun 07 16:12:25.207208 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.207188 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq" Jun 07 16:12:25.219921 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.219835 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq"] Jun 07 16:12:25.222484 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.222462 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv"] Jun 07 16:12:25.224466 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.224445 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d44fn"] Jun 07 16:12:25.225076 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.225057 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b8cffbd-28ab-4eee-9418-0a868446a0ae" containerName="manager" Jun 07 16:12:25.225174 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.225080 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b8cffbd-28ab-4eee-9418-0a868446a0ae" containerName="manager" Jun 07 16:12:25.225235 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.225218 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b8cffbd-28ab-4eee-9418-0a868446a0ae" containerName="manager" Jun 07 16:12:25.228486 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.228468 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d44fn" Jun 07 16:12:25.230259 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.230223 2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4b8cffbd-28ab-4eee-9418-0a868446a0ae\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-hvpzv\": pods \"limitador-operator-controller-manager-859d7b78bd-hvpzv\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" Jun 07 16:12:25.232195 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.232160 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2bwq\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="d270e645-e877-4ca1-9ed8-1fbfe2063070" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:25.236435 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.236411 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hvpzv\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="4b8cffbd-28ab-4eee-9418-0a868446a0ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" Jun 07 16:12:25.245625 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.245596 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d44fn"] Jun 07 16:12:25.258004 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.257966 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2bwq\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="d270e645-e877-4ca1-9ed8-1fbfe2063070" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:25.292478 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.292438 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7vg4\" (UniqueName: \"kubernetes.io/projected/501d792b-5388-4f83-9dbd-0f7d1427ba13-kube-api-access-h7vg4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b4lfq\" (UID: \"501d792b-5388-4f83-9dbd-0f7d1427ba13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq" Jun 07 16:12:25.292667 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.292528 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/501d792b-5388-4f83-9dbd-0f7d1427ba13-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b4lfq\" (UID: \"501d792b-5388-4f83-9dbd-0f7d1427ba13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq" Jun 07 16:12:25.292667 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.292555 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwqzt\" (UniqueName: \"kubernetes.io/projected/be2c3439-38e7-4ffc-bc86-42225c89c56b-kube-api-access-xwqzt\") pod \"limitador-operator-controller-manager-859d7b78bd-d44fn\" (UID: \"be2c3439-38e7-4ffc-bc86-42225c89c56b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d44fn" Jun 07 16:12:25.393576 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.393521 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/501d792b-5388-4f83-9dbd-0f7d1427ba13-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b4lfq\" (UID: \"501d792b-5388-4f83-9dbd-0f7d1427ba13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq" Jun 07 16:12:25.393747 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.393579 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwqzt\" (UniqueName: \"kubernetes.io/projected/be2c3439-38e7-4ffc-bc86-42225c89c56b-kube-api-access-xwqzt\") pod \"limitador-operator-controller-manager-859d7b78bd-d44fn\" (UID: \"be2c3439-38e7-4ffc-bc86-42225c89c56b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d44fn" Jun 07 16:12:25.393747 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.393651 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7vg4\" (UniqueName: \"kubernetes.io/projected/501d792b-5388-4f83-9dbd-0f7d1427ba13-kube-api-access-h7vg4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b4lfq\" (UID: \"501d792b-5388-4f83-9dbd-0f7d1427ba13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq" Jun 07 16:12:25.394037 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.393976 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/501d792b-5388-4f83-9dbd-0f7d1427ba13-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b4lfq\" (UID: \"501d792b-5388-4f83-9dbd-0f7d1427ba13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq" Jun 07 16:12:25.403677 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.403611 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwqzt\" (UniqueName: \"kubernetes.io/projected/be2c3439-38e7-4ffc-bc86-42225c89c56b-kube-api-access-xwqzt\") pod \"limitador-operator-controller-manager-859d7b78bd-d44fn\" (UID: \"be2c3439-38e7-4ffc-bc86-42225c89c56b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d44fn" Jun 07 16:12:25.403677 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.403627 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7vg4\" (UniqueName: \"kubernetes.io/projected/501d792b-5388-4f83-9dbd-0f7d1427ba13-kube-api-access-h7vg4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b4lfq\" (UID: \"501d792b-5388-4f83-9dbd-0f7d1427ba13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq" Jun 07 16:12:25.427518 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.427489 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-dddnd" Jun 07 16:12:25.429530 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.429500 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hvpzv\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="4b8cffbd-28ab-4eee-9418-0a868446a0ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" Jun 07 16:12:25.435694 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.435674 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:25.437749 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.437733 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" Jun 07 16:12:25.445735 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.445686 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2bwq\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="d270e645-e877-4ca1-9ed8-1fbfe2063070" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:25.447112 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.447089 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hvpzv\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="4b8cffbd-28ab-4eee-9418-0a868446a0ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" Jun 07 16:12:25.448445 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.448417 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2bwq\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="d270e645-e877-4ca1-9ed8-1fbfe2063070" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:25.476688 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.476653 2579 generic.go:356] "Generic (PLEG): container finished" podID="4b8cffbd-28ab-4eee-9418-0a868446a0ae" containerID="10ae3da83d2518554405dc4fa6b13c6b787c08a9ab137449ae312828dfe21d75" exitCode=0 Jun 07 16:12:25.476862 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.476696 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" Jun 07 16:12:25.476862 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.476744 2579 scope.go:117] "RemoveContainer" containerID="10ae3da83d2518554405dc4fa6b13c6b787c08a9ab137449ae312828dfe21d75" Jun 07 16:12:25.478435 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.478419 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:25.478540 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.478408 2579 generic.go:356] "Generic (PLEG): container finished" podID="d270e645-e877-4ca1-9ed8-1fbfe2063070" containerID="a4fd0d6de8433e996580665ccc9892d87d83aa9c954d85f4365abf2f3a346e01" exitCode=0 Jun 07 16:12:25.478734 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.478718 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r9bsw" Jun 07 16:12:25.478857 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.478823 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hvpzv\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="4b8cffbd-28ab-4eee-9418-0a868446a0ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" Jun 07 16:12:25.480321 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.480296 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2bwq\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="d270e645-e877-4ca1-9ed8-1fbfe2063070" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:25.481844 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.481815 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hvpzv\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="4b8cffbd-28ab-4eee-9418-0a868446a0ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" Jun 07 16:12:25.483337 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.483311 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2bwq\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="d270e645-e877-4ca1-9ed8-1fbfe2063070" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:25.484681 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.484652 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-r9bsw\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="8d1add49-f775-420a-9e1b-3e7ddfbb3381" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r9bsw" Jun 07 16:12:25.487936 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.487914 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r9bsw" Jun 07 16:12:25.488030 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.487929 2579 scope.go:117] "RemoveContainer" containerID="10ae3da83d2518554405dc4fa6b13c6b787c08a9ab137449ae312828dfe21d75" Jun 07 16:12:25.488247 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.488230 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10ae3da83d2518554405dc4fa6b13c6b787c08a9ab137449ae312828dfe21d75\": container with ID starting with 10ae3da83d2518554405dc4fa6b13c6b787c08a9ab137449ae312828dfe21d75 not found: ID does not exist" containerID="10ae3da83d2518554405dc4fa6b13c6b787c08a9ab137449ae312828dfe21d75" Jun 07 16:12:25.488292 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.488256 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10ae3da83d2518554405dc4fa6b13c6b787c08a9ab137449ae312828dfe21d75"} err="failed to get container status \"10ae3da83d2518554405dc4fa6b13c6b787c08a9ab137449ae312828dfe21d75\": rpc error: code = NotFound desc = could not find container \"10ae3da83d2518554405dc4fa6b13c6b787c08a9ab137449ae312828dfe21d75\": container with ID starting with 10ae3da83d2518554405dc4fa6b13c6b787c08a9ab137449ae312828dfe21d75 not found: ID does not exist" Jun 07 16:12:25.488292 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.488271 2579 scope.go:117] "RemoveContainer" containerID="a4fd0d6de8433e996580665ccc9892d87d83aa9c954d85f4365abf2f3a346e01" Jun 07 16:12:25.489558 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.489486 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hvpzv\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="4b8cffbd-28ab-4eee-9418-0a868446a0ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" Jun 07 16:12:25.491134 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.491112 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2bwq\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="d270e645-e877-4ca1-9ed8-1fbfe2063070" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:25.492532 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.492506 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-r9bsw\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="8d1add49-f775-420a-9e1b-3e7ddfbb3381" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r9bsw" Jun 07 16:12:25.494971 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.494946 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtg5p\" (UniqueName: \"kubernetes.io/projected/4b8cffbd-28ab-4eee-9418-0a868446a0ae-kube-api-access-dtg5p\") pod \"4b8cffbd-28ab-4eee-9418-0a868446a0ae\" (UID: \"4b8cffbd-28ab-4eee-9418-0a868446a0ae\") " Jun 07 16:12:25.495071 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.495035 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtxd2\" (UniqueName: \"kubernetes.io/projected/d270e645-e877-4ca1-9ed8-1fbfe2063070-kube-api-access-wtxd2\") pod \"d270e645-e877-4ca1-9ed8-1fbfe2063070\" (UID: \"d270e645-e877-4ca1-9ed8-1fbfe2063070\") " Jun 07 16:12:25.495150 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.495073 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d270e645-e877-4ca1-9ed8-1fbfe2063070-extensions-socket-volume\") pod \"d270e645-e877-4ca1-9ed8-1fbfe2063070\" (UID: \"d270e645-e877-4ca1-9ed8-1fbfe2063070\") " Jun 07 16:12:25.495513 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.495489 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d270e645-e877-4ca1-9ed8-1fbfe2063070-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d270e645-e877-4ca1-9ed8-1fbfe2063070" (UID: "d270e645-e877-4ca1-9ed8-1fbfe2063070"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:12:25.497308 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.497195 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d270e645-e877-4ca1-9ed8-1fbfe2063070-kube-api-access-wtxd2" (OuterVolumeSpecName: "kube-api-access-wtxd2") pod "d270e645-e877-4ca1-9ed8-1fbfe2063070" (UID: "d270e645-e877-4ca1-9ed8-1fbfe2063070"). InnerVolumeSpecName "kube-api-access-wtxd2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:12:25.497308 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.497276 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b8cffbd-28ab-4eee-9418-0a868446a0ae-kube-api-access-dtg5p" (OuterVolumeSpecName: "kube-api-access-dtg5p") pod "4b8cffbd-28ab-4eee-9418-0a868446a0ae" (UID: "4b8cffbd-28ab-4eee-9418-0a868446a0ae"). InnerVolumeSpecName "kube-api-access-dtg5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:12:25.497420 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.497355 2579 scope.go:117] "RemoveContainer" containerID="a4fd0d6de8433e996580665ccc9892d87d83aa9c954d85f4365abf2f3a346e01" Jun 07 16:12:25.497697 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.497661 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4fd0d6de8433e996580665ccc9892d87d83aa9c954d85f4365abf2f3a346e01\": container with ID starting with a4fd0d6de8433e996580665ccc9892d87d83aa9c954d85f4365abf2f3a346e01 not found: ID does not exist" containerID="a4fd0d6de8433e996580665ccc9892d87d83aa9c954d85f4365abf2f3a346e01" Jun 07 16:12:25.497746 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.497710 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4fd0d6de8433e996580665ccc9892d87d83aa9c954d85f4365abf2f3a346e01"} err="failed to get container status \"a4fd0d6de8433e996580665ccc9892d87d83aa9c954d85f4365abf2f3a346e01\": rpc error: code = NotFound desc = could not find container \"a4fd0d6de8433e996580665ccc9892d87d83aa9c954d85f4365abf2f3a346e01\": container with ID starting with a4fd0d6de8433e996580665ccc9892d87d83aa9c954d85f4365abf2f3a346e01 not found: ID does not exist" Jun 07 16:12:25.596449 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.596411 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d1add49-f775-420a-9e1b-3e7ddfbb3381-extensions-socket-volume\") pod \"8d1add49-f775-420a-9e1b-3e7ddfbb3381\" (UID: \"8d1add49-f775-420a-9e1b-3e7ddfbb3381\") " Jun 07 16:12:25.596910 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.596468 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tc7x\" (UniqueName: \"kubernetes.io/projected/8d1add49-f775-420a-9e1b-3e7ddfbb3381-kube-api-access-4tc7x\") pod \"8d1add49-f775-420a-9e1b-3e7ddfbb3381\" (UID: \"8d1add49-f775-420a-9e1b-3e7ddfbb3381\") " Jun 07 16:12:25.596910 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.596643 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtg5p\" (UniqueName: \"kubernetes.io/projected/4b8cffbd-28ab-4eee-9418-0a868446a0ae-kube-api-access-dtg5p\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:12:25.596910 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.596655 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtxd2\" (UniqueName: \"kubernetes.io/projected/d270e645-e877-4ca1-9ed8-1fbfe2063070-kube-api-access-wtxd2\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:12:25.596910 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.596664 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d270e645-e877-4ca1-9ed8-1fbfe2063070-extensions-socket-volume\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:12:25.596910 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.596726 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d1add49-f775-420a-9e1b-3e7ddfbb3381-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8d1add49-f775-420a-9e1b-3e7ddfbb3381" (UID: "8d1add49-f775-420a-9e1b-3e7ddfbb3381"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:12:25.598709 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.598687 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d1add49-f775-420a-9e1b-3e7ddfbb3381-kube-api-access-4tc7x" (OuterVolumeSpecName: "kube-api-access-4tc7x") pod "8d1add49-f775-420a-9e1b-3e7ddfbb3381" (UID: "8d1add49-f775-420a-9e1b-3e7ddfbb3381"). InnerVolumeSpecName "kube-api-access-4tc7x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:12:25.610006 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.609973 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq" Jun 07 16:12:25.616283 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.616256 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d44fn" Jun 07 16:12:25.697807 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.697774 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d1add49-f775-420a-9e1b-3e7ddfbb3381-extensions-socket-volume\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:12:25.697807 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.697804 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tc7x\" (UniqueName: \"kubernetes.io/projected/8d1add49-f775-420a-9e1b-3e7ddfbb3381-kube-api-access-4tc7x\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:12:25.766867 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.766822 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq"] Jun 07 16:12:25.769219 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:12:25.769196 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod501d792b_5388_4f83_9dbd_0f7d1427ba13.slice/crio-562962f5ebfd1c808d08194619cc51a2df3909914057356be4e83cb5100818a7 WatchSource:0}: Error finding container 562962f5ebfd1c808d08194619cc51a2df3909914057356be4e83cb5100818a7: Status 404 returned error can't find the container with id 562962f5ebfd1c808d08194619cc51a2df3909914057356be4e83cb5100818a7 Jun 07 16:12:25.788495 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:25.788258 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d44fn"] Jun 07 16:12:25.790598 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:12:25.790568 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2c3439_38e7_4ffc_bc86_42225c89c56b.slice/crio-7ec7515307b5e4e4e75352ceb122316e5ea0881033180f24d335c467e7f05fc9 WatchSource:0}: Error finding container 7ec7515307b5e4e4e75352ceb122316e5ea0881033180f24d335c467e7f05fc9: Status 404 returned error can't find the container with id 7ec7515307b5e4e4e75352ceb122316e5ea0881033180f24d335c467e7f05fc9 Jun 07 16:12:25.790712 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.790681 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hvpzv\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="4b8cffbd-28ab-4eee-9418-0a868446a0ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" Jun 07 16:12:25.792226 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.792195 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2bwq\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="d270e645-e877-4ca1-9ed8-1fbfe2063070" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:25.793657 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.793631 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-r9bsw\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="8d1add49-f775-420a-9e1b-3e7ddfbb3381" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r9bsw" Jun 07 16:12:25.795115 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.795091 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2bwq\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="d270e645-e877-4ca1-9ed8-1fbfe2063070" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:25.796572 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.796549 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-r9bsw\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="8d1add49-f775-420a-9e1b-3e7ddfbb3381" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r9bsw" Jun 07 16:12:25.797969 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:25.797941 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hvpzv\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="4b8cffbd-28ab-4eee-9418-0a868446a0ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" Jun 07 16:12:26.485915 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:26.485875 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d44fn" event={"ID":"be2c3439-38e7-4ffc-bc86-42225c89c56b","Type":"ContainerStarted","Data":"ed2c6145e92d12062989a4131d222182cf8b5ed13d607e92adf25f08e8a27c92"} Jun 07 16:12:26.486091 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:26.485932 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d44fn" event={"ID":"be2c3439-38e7-4ffc-bc86-42225c89c56b","Type":"ContainerStarted","Data":"7ec7515307b5e4e4e75352ceb122316e5ea0881033180f24d335c467e7f05fc9"} Jun 07 16:12:26.486091 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:26.485988 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d44fn" Jun 07 16:12:26.487717 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:26.487689 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq" event={"ID":"501d792b-5388-4f83-9dbd-0f7d1427ba13","Type":"ContainerStarted","Data":"c72d33736497fc7e2894505031345111dc343495f143a75441cb39b325eb501c"} Jun 07 16:12:26.487852 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:26.487728 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq" event={"ID":"501d792b-5388-4f83-9dbd-0f7d1427ba13","Type":"ContainerStarted","Data":"562962f5ebfd1c808d08194619cc51a2df3909914057356be4e83cb5100818a7"} Jun 07 16:12:26.487852 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:26.487785 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq" Jun 07 16:12:26.488644 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:26.488615 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hvpzv\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="4b8cffbd-28ab-4eee-9418-0a868446a0ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" Jun 07 16:12:26.488722 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:26.488658 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r9bsw" Jun 07 16:12:26.495081 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:26.495040 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2bwq\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="d270e645-e877-4ca1-9ed8-1fbfe2063070" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:26.496927 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:26.496892 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-r9bsw\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="8d1add49-f775-420a-9e1b-3e7ddfbb3381" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r9bsw" Jun 07 16:12:26.519260 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:26.519033 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d44fn" podStartSLOduration=1.519014777 podStartE2EDuration="1.519014777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:12:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:12:26.517784349 +0000 UTC m=+603.915721288" watchObservedRunningTime="2026-06-07 16:12:26.519014777 +0000 UTC m=+603.916951721" Jun 07 16:12:26.539010 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:26.538964 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-c2bwq\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="d270e645-e877-4ca1-9ed8-1fbfe2063070" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c2bwq" Jun 07 16:12:26.539697 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:26.539656 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq" podStartSLOduration=1.539642884 podStartE2EDuration="1.539642884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:12:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:12:26.537196118 +0000 UTC m=+603.935133059" watchObservedRunningTime="2026-06-07 16:12:26.539642884 +0000 UTC m=+603.937579825" Jun 07 16:12:26.540401 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:26.540379 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-r9bsw\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="8d1add49-f775-420a-9e1b-3e7ddfbb3381" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r9bsw" Jun 07 16:12:26.541658 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:26.541638 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hvpzv\" is forbidden: User \"system:node:ip-10-0-130-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-133.ec2.internal' and this object" podUID="4b8cffbd-28ab-4eee-9418-0a868446a0ae" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvpzv" Jun 07 16:12:27.007036 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:27.007000 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b8cffbd-28ab-4eee-9418-0a868446a0ae" path="/var/lib/kubelet/pods/4b8cffbd-28ab-4eee-9418-0a868446a0ae/volumes" Jun 07 16:12:27.007412 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:27.007385 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d1add49-f775-420a-9e1b-3e7ddfbb3381" path="/var/lib/kubelet/pods/8d1add49-f775-420a-9e1b-3e7ddfbb3381/volumes" Jun 07 16:12:27.007625 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:27.007612 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d270e645-e877-4ca1-9ed8-1fbfe2063070" path="/var/lib/kubelet/pods/d270e645-e877-4ca1-9ed8-1fbfe2063070/volumes" Jun 07 16:12:37.496416 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:37.496385 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq" Jun 07 16:12:37.500211 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:37.496455 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d44fn" Jun 07 16:12:40.743596 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:40.743563 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq"] Jun 07 16:12:40.744023 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:40.743779 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq" podUID="501d792b-5388-4f83-9dbd-0f7d1427ba13" containerName="manager" containerID="cri-o://c72d33736497fc7e2894505031345111dc343495f143a75441cb39b325eb501c" gracePeriod=10 Jun 07 16:12:40.986577 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:40.986547 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95vmg"] Jun 07 16:12:40.991615 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:40.991591 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95vmg" Jun 07 16:12:40.999118 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:40.999093 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95vmg"] Jun 07 16:12:41.019840 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.019799 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq" Jun 07 16:12:41.153021 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.152979 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7vg4\" (UniqueName: \"kubernetes.io/projected/501d792b-5388-4f83-9dbd-0f7d1427ba13-kube-api-access-h7vg4\") pod \"501d792b-5388-4f83-9dbd-0f7d1427ba13\" (UID: \"501d792b-5388-4f83-9dbd-0f7d1427ba13\") " Jun 07 16:12:41.153187 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.153040 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/501d792b-5388-4f83-9dbd-0f7d1427ba13-extensions-socket-volume\") pod \"501d792b-5388-4f83-9dbd-0f7d1427ba13\" (UID: \"501d792b-5388-4f83-9dbd-0f7d1427ba13\") " Jun 07 16:12:41.153256 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.153236 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5hr5\" (UniqueName: \"kubernetes.io/projected/d30ecf6e-bdac-4c26-913f-4da1a24b1dfc-kube-api-access-b5hr5\") pod \"kuadrant-operator-controller-manager-86878c769f-95vmg\" (UID: \"d30ecf6e-bdac-4c26-913f-4da1a24b1dfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95vmg" Jun 07 16:12:41.153312 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.153270 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d30ecf6e-bdac-4c26-913f-4da1a24b1dfc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-95vmg\" (UID: \"d30ecf6e-bdac-4c26-913f-4da1a24b1dfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95vmg" Jun 07 16:12:41.153418 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.153391 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/501d792b-5388-4f83-9dbd-0f7d1427ba13-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "501d792b-5388-4f83-9dbd-0f7d1427ba13" (UID: "501d792b-5388-4f83-9dbd-0f7d1427ba13"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:12:41.155016 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.154995 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/501d792b-5388-4f83-9dbd-0f7d1427ba13-kube-api-access-h7vg4" (OuterVolumeSpecName: "kube-api-access-h7vg4") pod "501d792b-5388-4f83-9dbd-0f7d1427ba13" (UID: "501d792b-5388-4f83-9dbd-0f7d1427ba13"). InnerVolumeSpecName "kube-api-access-h7vg4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:12:41.254542 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.254443 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5hr5\" (UniqueName: \"kubernetes.io/projected/d30ecf6e-bdac-4c26-913f-4da1a24b1dfc-kube-api-access-b5hr5\") pod \"kuadrant-operator-controller-manager-86878c769f-95vmg\" (UID: \"d30ecf6e-bdac-4c26-913f-4da1a24b1dfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95vmg" Jun 07 16:12:41.254542 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.254492 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d30ecf6e-bdac-4c26-913f-4da1a24b1dfc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-95vmg\" (UID: \"d30ecf6e-bdac-4c26-913f-4da1a24b1dfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95vmg" Jun 07 16:12:41.254736 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.254592 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7vg4\" (UniqueName: \"kubernetes.io/projected/501d792b-5388-4f83-9dbd-0f7d1427ba13-kube-api-access-h7vg4\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:12:41.254736 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.254608 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/501d792b-5388-4f83-9dbd-0f7d1427ba13-extensions-socket-volume\") on node \"ip-10-0-130-133.ec2.internal\" DevicePath \"\"" Jun 07 16:12:41.254938 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.254916 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d30ecf6e-bdac-4c26-913f-4da1a24b1dfc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-95vmg\" (UID: \"d30ecf6e-bdac-4c26-913f-4da1a24b1dfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95vmg" Jun 07 16:12:41.262081 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.262056 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5hr5\" (UniqueName: \"kubernetes.io/projected/d30ecf6e-bdac-4c26-913f-4da1a24b1dfc-kube-api-access-b5hr5\") pod \"kuadrant-operator-controller-manager-86878c769f-95vmg\" (UID: \"d30ecf6e-bdac-4c26-913f-4da1a24b1dfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95vmg" Jun 07 16:12:41.324615 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.324574 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95vmg" Jun 07 16:12:41.464922 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.464895 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95vmg"] Jun 07 16:12:41.467439 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:12:41.467413 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd30ecf6e_bdac_4c26_913f_4da1a24b1dfc.slice/crio-0c245f795eebcba42d6b0eecfea538e77b94e48e93e7a7a204ff8eecded04819 WatchSource:0}: Error finding container 0c245f795eebcba42d6b0eecfea538e77b94e48e93e7a7a204ff8eecded04819: Status 404 returned error can't find the container with id 0c245f795eebcba42d6b0eecfea538e77b94e48e93e7a7a204ff8eecded04819 Jun 07 16:12:41.573471 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.573426 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95vmg" event={"ID":"d30ecf6e-bdac-4c26-913f-4da1a24b1dfc","Type":"ContainerStarted","Data":"8d342acb1495a781953771f3382c10696e35464353124010ec7cf160dc42e1dd"} Jun 07 16:12:41.573669 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.573493 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95vmg" event={"ID":"d30ecf6e-bdac-4c26-913f-4da1a24b1dfc","Type":"ContainerStarted","Data":"0c245f795eebcba42d6b0eecfea538e77b94e48e93e7a7a204ff8eecded04819"} Jun 07 16:12:41.573669 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.573525 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95vmg" Jun 07 16:12:41.574848 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.574826 2579 generic.go:356] "Generic (PLEG): container finished" podID="501d792b-5388-4f83-9dbd-0f7d1427ba13" containerID="c72d33736497fc7e2894505031345111dc343495f143a75441cb39b325eb501c" exitCode=0 Jun 07 16:12:41.574938 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.574874 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq" Jun 07 16:12:41.574982 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.574873 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq" event={"ID":"501d792b-5388-4f83-9dbd-0f7d1427ba13","Type":"ContainerDied","Data":"c72d33736497fc7e2894505031345111dc343495f143a75441cb39b325eb501c"} Jun 07 16:12:41.575016 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.574991 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq" event={"ID":"501d792b-5388-4f83-9dbd-0f7d1427ba13","Type":"ContainerDied","Data":"562962f5ebfd1c808d08194619cc51a2df3909914057356be4e83cb5100818a7"} Jun 07 16:12:41.575059 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.575019 2579 scope.go:117] "RemoveContainer" containerID="c72d33736497fc7e2894505031345111dc343495f143a75441cb39b325eb501c" Jun 07 16:12:41.584447 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.584428 2579 scope.go:117] "RemoveContainer" containerID="c72d33736497fc7e2894505031345111dc343495f143a75441cb39b325eb501c" Jun 07 16:12:41.584711 ip-10-0-130-133 kubenswrapper[2579]: E0607 16:12:41.584687 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c72d33736497fc7e2894505031345111dc343495f143a75441cb39b325eb501c\": container with ID starting with c72d33736497fc7e2894505031345111dc343495f143a75441cb39b325eb501c not found: ID does not exist" containerID="c72d33736497fc7e2894505031345111dc343495f143a75441cb39b325eb501c" Jun 07 16:12:41.584789 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.584720 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c72d33736497fc7e2894505031345111dc343495f143a75441cb39b325eb501c"} err="failed to get container status \"c72d33736497fc7e2894505031345111dc343495f143a75441cb39b325eb501c\": rpc error: code = NotFound desc = could not find container \"c72d33736497fc7e2894505031345111dc343495f143a75441cb39b325eb501c\": container with ID starting with c72d33736497fc7e2894505031345111dc343495f143a75441cb39b325eb501c not found: ID does not exist" Jun 07 16:12:41.591507 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.591463 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95vmg" podStartSLOduration=1.591449848 podStartE2EDuration="1.591449848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:12:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:12:41.589390658 +0000 UTC m=+618.987327600" watchObservedRunningTime="2026-06-07 16:12:41.591449848 +0000 UTC m=+618.989386789" Jun 07 16:12:41.601273 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.601251 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq"] Jun 07 16:12:41.609230 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:41.609209 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b4lfq"] Jun 07 16:12:43.007402 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:43.007369 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="501d792b-5388-4f83-9dbd-0f7d1427ba13" path="/var/lib/kubelet/pods/501d792b-5388-4f83-9dbd-0f7d1427ba13/volumes" Jun 07 16:12:52.584021 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:52.583989 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-95vmg" Jun 07 16:12:56.956866 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:56.956832 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq"] Jun 07 16:12:56.957356 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:56.957341 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="501d792b-5388-4f83-9dbd-0f7d1427ba13" containerName="manager" Jun 07 16:12:56.957411 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:56.957358 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="501d792b-5388-4f83-9dbd-0f7d1427ba13" containerName="manager" Jun 07 16:12:56.957452 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:56.957422 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="501d792b-5388-4f83-9dbd-0f7d1427ba13" containerName="manager" Jun 07 16:12:56.962704 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:56.962681 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:56.964995 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:56.964970 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9v8pp\"" Jun 07 16:12:56.975427 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:56.975404 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq"] Jun 07 16:12:57.001092 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.001060 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5pn7\" (UniqueName: \"kubernetes.io/projected/6e2216dc-d02c-43dc-9427-8b0bf092c770-kube-api-access-l5pn7\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.001270 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.001102 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e2216dc-d02c-43dc-9427-8b0bf092c770-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.001270 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.001118 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e2216dc-d02c-43dc-9427-8b0bf092c770-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.001270 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.001139 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e2216dc-d02c-43dc-9427-8b0bf092c770-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.001270 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.001158 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e2216dc-d02c-43dc-9427-8b0bf092c770-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.001270 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.001189 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e2216dc-d02c-43dc-9427-8b0bf092c770-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.001270 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.001220 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e2216dc-d02c-43dc-9427-8b0bf092c770-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.001270 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.001245 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e2216dc-d02c-43dc-9427-8b0bf092c770-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.001270 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.001268 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e2216dc-d02c-43dc-9427-8b0bf092c770-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.102063 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.102028 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5pn7\" (UniqueName: \"kubernetes.io/projected/6e2216dc-d02c-43dc-9427-8b0bf092c770-kube-api-access-l5pn7\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.102242 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.102088 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e2216dc-d02c-43dc-9427-8b0bf092c770-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.102242 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.102113 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e2216dc-d02c-43dc-9427-8b0bf092c770-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.102242 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.102155 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e2216dc-d02c-43dc-9427-8b0bf092c770-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.102242 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.102178 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e2216dc-d02c-43dc-9427-8b0bf092c770-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.102242 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.102202 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e2216dc-d02c-43dc-9427-8b0bf092c770-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.102242 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.102240 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e2216dc-d02c-43dc-9427-8b0bf092c770-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.102563 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.102274 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e2216dc-d02c-43dc-9427-8b0bf092c770-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.102563 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.102310 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e2216dc-d02c-43dc-9427-8b0bf092c770-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.102823 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.102792 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e2216dc-d02c-43dc-9427-8b0bf092c770-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.102958 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.102819 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e2216dc-d02c-43dc-9427-8b0bf092c770-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.102958 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.102867 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e2216dc-d02c-43dc-9427-8b0bf092c770-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.103046 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.102999 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e2216dc-d02c-43dc-9427-8b0bf092c770-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.103157 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.103140 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e2216dc-d02c-43dc-9427-8b0bf092c770-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.105187 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.105169 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e2216dc-d02c-43dc-9427-8b0bf092c770-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.105435 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.105414 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e2216dc-d02c-43dc-9427-8b0bf092c770-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.110977 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.110949 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5pn7\" (UniqueName: \"kubernetes.io/projected/6e2216dc-d02c-43dc-9427-8b0bf092c770-kube-api-access-l5pn7\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.111505 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.111475 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e2216dc-d02c-43dc-9427-8b0bf092c770-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-tvqjq\" (UID: \"6e2216dc-d02c-43dc-9427-8b0bf092c770\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.278044 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.277957 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:57.425275 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.425111 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq"] Jun 07 16:12:57.428518 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:12:57.428479 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e2216dc_d02c_43dc_9427_8b0bf092c770.slice/crio-671bd006029ae7c7b4ae7e914be6005c23ffd9423f13c80a3653cdfe65743a87 WatchSource:0}: Error finding container 671bd006029ae7c7b4ae7e914be6005c23ffd9423f13c80a3653cdfe65743a87: Status 404 returned error can't find the container with id 671bd006029ae7c7b4ae7e914be6005c23ffd9423f13c80a3653cdfe65743a87 Jun 07 16:12:57.430726 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.430692 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 07 16:12:57.430836 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.430778 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 07 16:12:57.430836 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.430809 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 07 16:12:57.664903 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.664810 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" event={"ID":"6e2216dc-d02c-43dc-9427-8b0bf092c770","Type":"ContainerStarted","Data":"b13f378dff6e472ab24914b4eb01070d870656347f4222c179f46d27649bc7cf"} Jun 07 16:12:57.664903 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.664872 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" event={"ID":"6e2216dc-d02c-43dc-9427-8b0bf092c770","Type":"ContainerStarted","Data":"671bd006029ae7c7b4ae7e914be6005c23ffd9423f13c80a3653cdfe65743a87"} Jun 07 16:12:57.683103 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:57.683013 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" podStartSLOduration=1.682993732 podStartE2EDuration="1.682993732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:12:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:12:57.681430031 +0000 UTC m=+635.079366972" watchObservedRunningTime="2026-06-07 16:12:57.682993732 +0000 UTC m=+635.080930674" Jun 07 16:12:58.279171 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:58.279136 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:58.284072 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:58.284045 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:58.669987 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:58.669909 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:12:58.671002 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:12:58.670982 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:13:12.834922 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:13:12.834888 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:13:12.838549 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:13:12.838529 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9s5vq" Jun 07 16:13:12.840455 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:13:12.840433 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 07 16:13:12.840565 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:13:12.840467 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z5h6z\"" Jun 07 16:13:12.845486 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:13:12.845465 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:13:12.877871 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:13:12.877841 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:13:12.949238 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:13:12.949208 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntjfc\" (UniqueName: \"kubernetes.io/projected/9a96d58c-7ded-435f-b485-824c3be2478d-kube-api-access-ntjfc\") pod \"limitador-limitador-54d6d988d5-9s5vq\" (UID: \"9a96d58c-7ded-435f-b485-824c3be2478d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9s5vq" Jun 07 16:13:12.949398 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:13:12.949292 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a96d58c-7ded-435f-b485-824c3be2478d-config-file\") pod \"limitador-limitador-54d6d988d5-9s5vq\" (UID: \"9a96d58c-7ded-435f-b485-824c3be2478d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9s5vq" Jun 07 16:13:13.050819 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:13:13.050789 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntjfc\" (UniqueName: \"kubernetes.io/projected/9a96d58c-7ded-435f-b485-824c3be2478d-kube-api-access-ntjfc\") pod \"limitador-limitador-54d6d988d5-9s5vq\" (UID: \"9a96d58c-7ded-435f-b485-824c3be2478d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9s5vq" Jun 07 16:13:13.050986 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:13:13.050860 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a96d58c-7ded-435f-b485-824c3be2478d-config-file\") pod \"limitador-limitador-54d6d988d5-9s5vq\" (UID: \"9a96d58c-7ded-435f-b485-824c3be2478d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9s5vq" Jun 07 16:13:13.051462 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:13:13.051444 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9a96d58c-7ded-435f-b485-824c3be2478d-config-file\") pod \"limitador-limitador-54d6d988d5-9s5vq\" (UID: \"9a96d58c-7ded-435f-b485-824c3be2478d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9s5vq" Jun 07 16:13:13.058362 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:13:13.058334 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntjfc\" (UniqueName: \"kubernetes.io/projected/9a96d58c-7ded-435f-b485-824c3be2478d-kube-api-access-ntjfc\") pod \"limitador-limitador-54d6d988d5-9s5vq\" (UID: \"9a96d58c-7ded-435f-b485-824c3be2478d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9s5vq" Jun 07 16:13:13.151782 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:13:13.151680 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9s5vq" Jun 07 16:13:13.297519 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:13:13.297489 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:13:13.300462 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:13:13.300426 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a96d58c_7ded_435f_b485_824c3be2478d.slice/crio-ef3d833198c47ee406ecf36c0c300816e987e2c1661f21d76a691bbf7bb8a9d2 WatchSource:0}: Error finding container ef3d833198c47ee406ecf36c0c300816e987e2c1661f21d76a691bbf7bb8a9d2: Status 404 returned error can't find the container with id ef3d833198c47ee406ecf36c0c300816e987e2c1661f21d76a691bbf7bb8a9d2 Jun 07 16:13:13.750582 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:13:13.750539 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9s5vq" event={"ID":"9a96d58c-7ded-435f-b485-824c3be2478d","Type":"ContainerStarted","Data":"ef3d833198c47ee406ecf36c0c300816e987e2c1661f21d76a691bbf7bb8a9d2"} Jun 07 16:13:16.769552 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:13:16.769519 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9s5vq" event={"ID":"9a96d58c-7ded-435f-b485-824c3be2478d","Type":"ContainerStarted","Data":"4d2427e4a7dfd279273f2a690697f8318be5c3fa94be6a663ea886076df6b82a"} Jun 07 16:13:16.769958 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:13:16.769648 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9s5vq" Jun 07 16:13:16.785399 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:13:16.785350 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-9s5vq" podStartSLOduration=2.339514146 podStartE2EDuration="4.7853355s" totalImagesPullingTime="2.445821354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:13:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:13:16.783736256 +0000 UTC m=+654.181673199" watchObservedRunningTime="2026-06-07 16:13:16.7853355 +0000 UTC m=+654.183272442" Jun 07 16:13:27.775901 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:13:27.775867 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9s5vq" Jun 07 16:15:18.370664 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:15:18.370630 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:15:26.429284 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:15:26.429246 2579 generic.go:356] "Generic (PLEG): container finished" podID="6e2216dc-d02c-43dc-9427-8b0bf092c770" containerID="b13f378dff6e472ab24914b4eb01070d870656347f4222c179f46d27649bc7cf" exitCode=0 Jun 07 16:15:26.429684 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:15:26.429323 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" event={"ID":"6e2216dc-d02c-43dc-9427-8b0bf092c770","Type":"ContainerDied","Data":"b13f378dff6e472ab24914b4eb01070d870656347f4222c179f46d27649bc7cf"} Jun 07 16:15:26.429797 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:15:26.429780 2579 scope.go:117] "RemoveContainer" containerID="b13f378dff6e472ab24914b4eb01070d870656347f4222c179f46d27649bc7cf" Jun 07 16:15:26.430827 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:15:26.430801 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 07 16:15:26.430939 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:15:26.430868 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 07 16:15:26.430939 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:15:26.430912 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 07 16:15:27.436314 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:15:27.436276 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" event={"ID":"6e2216dc-d02c-43dc-9427-8b0bf092c770","Type":"ContainerStarted","Data":"ee484880c3b65830b6cbd3ac1c699de308d37b8eb545265b8605f0f351c97422"} Jun 07 16:15:28.279162 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:15:28.279115 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:15:28.280570 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:15:28.280542 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-tvqjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jun 07 16:15:28.280834 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:15:28.280803 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" podUID="6e2216dc-d02c-43dc-9427-8b0bf092c770" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jun 07 16:15:28.670550 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:15:28.670449 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:15:29.279006 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:15:29.278517 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-tvqjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jun 07 16:15:29.279006 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:15:29.278593 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" podUID="6e2216dc-d02c-43dc-9427-8b0bf092c770" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jun 07 16:15:30.279064 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:15:30.278956 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-tvqjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jun 07 16:15:30.279064 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:15:30.279044 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" podUID="6e2216dc-d02c-43dc-9427-8b0bf092c770" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jun 07 16:15:31.278547 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:15:31.278500 2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-tvqjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jun 07 16:15:31.278795 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:15:31.278570 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" podUID="6e2216dc-d02c-43dc-9427-8b0bf092c770" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jun 07 16:15:32.283156 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:15:32.283125 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:15:32.284183 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:15:32.284165 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-tvqjq" Jun 07 16:16:30.003725 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.003693 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2"] Jun 07 16:16:30.007426 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.007408 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:30.009626 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.009602 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 07 16:16:30.010286 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.010269 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nddxh\"" Jun 07 16:16:30.010391 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.010314 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 07 16:16:30.010391 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.010272 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 07 16:16:30.016531 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.016509 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2"] Jun 07 16:16:30.153033 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.152990 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d916075a-61d6-4b50-a01c-233ad4a1f9d6-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2\" (UID: \"d916075a-61d6-4b50-a01c-233ad4a1f9d6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:30.153033 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.153037 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d916075a-61d6-4b50-a01c-233ad4a1f9d6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2\" (UID: \"d916075a-61d6-4b50-a01c-233ad4a1f9d6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:30.153284 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.153131 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw2bz\" (UniqueName: \"kubernetes.io/projected/d916075a-61d6-4b50-a01c-233ad4a1f9d6-kube-api-access-sw2bz\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2\" (UID: \"d916075a-61d6-4b50-a01c-233ad4a1f9d6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:30.153284 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.153166 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d916075a-61d6-4b50-a01c-233ad4a1f9d6-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2\" (UID: \"d916075a-61d6-4b50-a01c-233ad4a1f9d6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:30.153284 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.153195 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d916075a-61d6-4b50-a01c-233ad4a1f9d6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2\" (UID: \"d916075a-61d6-4b50-a01c-233ad4a1f9d6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:30.153284 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.153276 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d916075a-61d6-4b50-a01c-233ad4a1f9d6-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2\" (UID: \"d916075a-61d6-4b50-a01c-233ad4a1f9d6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:30.254956 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.254858 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw2bz\" (UniqueName: \"kubernetes.io/projected/d916075a-61d6-4b50-a01c-233ad4a1f9d6-kube-api-access-sw2bz\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2\" (UID: \"d916075a-61d6-4b50-a01c-233ad4a1f9d6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:30.254956 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.254925 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d916075a-61d6-4b50-a01c-233ad4a1f9d6-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2\" (UID: \"d916075a-61d6-4b50-a01c-233ad4a1f9d6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:30.255179 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.254968 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d916075a-61d6-4b50-a01c-233ad4a1f9d6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2\" (UID: \"d916075a-61d6-4b50-a01c-233ad4a1f9d6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:30.255179 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.255005 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d916075a-61d6-4b50-a01c-233ad4a1f9d6-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2\" (UID: \"d916075a-61d6-4b50-a01c-233ad4a1f9d6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:30.255179 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.255105 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d916075a-61d6-4b50-a01c-233ad4a1f9d6-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2\" (UID: \"d916075a-61d6-4b50-a01c-233ad4a1f9d6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:30.255336 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.255318 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d916075a-61d6-4b50-a01c-233ad4a1f9d6-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2\" (UID: \"d916075a-61d6-4b50-a01c-233ad4a1f9d6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:30.255395 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.255374 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d916075a-61d6-4b50-a01c-233ad4a1f9d6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2\" (UID: \"d916075a-61d6-4b50-a01c-233ad4a1f9d6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:30.255447 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.255420 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d916075a-61d6-4b50-a01c-233ad4a1f9d6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2\" (UID: \"d916075a-61d6-4b50-a01c-233ad4a1f9d6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:30.255572 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.255551 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d916075a-61d6-4b50-a01c-233ad4a1f9d6-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2\" (UID: \"d916075a-61d6-4b50-a01c-233ad4a1f9d6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:30.257472 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.257444 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d916075a-61d6-4b50-a01c-233ad4a1f9d6-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2\" (UID: \"d916075a-61d6-4b50-a01c-233ad4a1f9d6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:30.257984 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.257967 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d916075a-61d6-4b50-a01c-233ad4a1f9d6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2\" (UID: \"d916075a-61d6-4b50-a01c-233ad4a1f9d6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:30.263332 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.263313 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw2bz\" (UniqueName: \"kubernetes.io/projected/d916075a-61d6-4b50-a01c-233ad4a1f9d6-kube-api-access-sw2bz\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2\" (UID: \"d916075a-61d6-4b50-a01c-233ad4a1f9d6\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:30.319151 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.319112 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:30.320442 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.320417 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:16:30.461178 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.461155 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2"] Jun 07 16:16:30.463427 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:16:30.463401 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd916075a_61d6_4b50_a01c_233ad4a1f9d6.slice/crio-32faa78da401b448e6c3fce04c70c84c031f1e737ec0338d62e31d7dd98b3c21 WatchSource:0}: Error finding container 32faa78da401b448e6c3fce04c70c84c031f1e737ec0338d62e31d7dd98b3c21: Status 404 returned error can't find the container with id 32faa78da401b448e6c3fce04c70c84c031f1e737ec0338d62e31d7dd98b3c21 Jun 07 16:16:30.465521 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.465501 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 16:16:30.754355 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:30.754318 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" event={"ID":"d916075a-61d6-4b50-a01c-233ad4a1f9d6","Type":"ContainerStarted","Data":"32faa78da401b448e6c3fce04c70c84c031f1e737ec0338d62e31d7dd98b3c21"} Jun 07 16:16:34.781250 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:34.781209 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" event={"ID":"d916075a-61d6-4b50-a01c-233ad4a1f9d6","Type":"ContainerStarted","Data":"477339f50a0bad8bb85acb193b4e95a0d7a577cb34d5d1a747cd178a8a3c2ff2"} Jun 07 16:16:35.787907 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:35.787873 2579 generic.go:356] "Generic (PLEG): container finished" podID="d916075a-61d6-4b50-a01c-233ad4a1f9d6" containerID="477339f50a0bad8bb85acb193b4e95a0d7a577cb34d5d1a747cd178a8a3c2ff2" exitCode=0 Jun 07 16:16:35.788281 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:35.787952 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" event={"ID":"d916075a-61d6-4b50-a01c-233ad4a1f9d6","Type":"ContainerDied","Data":"477339f50a0bad8bb85acb193b4e95a0d7a577cb34d5d1a747cd178a8a3c2ff2"} Jun 07 16:16:37.802554 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:37.802517 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" event={"ID":"d916075a-61d6-4b50-a01c-233ad4a1f9d6","Type":"ContainerStarted","Data":"6135963a03b76965be95bf2c758c277f2a6d937e43a1f70a187fa9ad978a6edc"} Jun 07 16:16:37.821359 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:37.821306 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" podStartSLOduration=2.360651554 podStartE2EDuration="8.821290176s" totalImagesPullingTime="5.192892858s" totalInitContainerRuntime="1.267745764s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:16:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:16:37.818347033 +0000 UTC m=+855.216283974" watchObservedRunningTime="2026-06-07 16:16:37.821290176 +0000 UTC m=+855.219227118" Jun 07 16:16:39.530223 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:39.530180 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:16:40.319860 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:40.319823 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:40.320038 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:40.319891 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:40.332541 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:40.332514 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:40.829163 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:40.829131 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2" Jun 07 16:16:53.820447 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:16:53.820413 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:17:10.991810 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:10.990188 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5"] Jun 07 16:17:10.997798 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:10.997710 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:11.001701 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.001670 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 07 16:17:11.011258 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.011221 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5"] Jun 07 16:17:11.155173 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.155133 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2579756d-6019-40b6-b52b-ba5a73bfaa6d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5\" (UID: \"2579756d-6019-40b6-b52b-ba5a73bfaa6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:11.155366 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.155236 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bfx9\" (UniqueName: \"kubernetes.io/projected/2579756d-6019-40b6-b52b-ba5a73bfaa6d-kube-api-access-7bfx9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5\" (UID: \"2579756d-6019-40b6-b52b-ba5a73bfaa6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:11.155366 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.155269 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2579756d-6019-40b6-b52b-ba5a73bfaa6d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5\" (UID: \"2579756d-6019-40b6-b52b-ba5a73bfaa6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:11.155487 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.155376 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2579756d-6019-40b6-b52b-ba5a73bfaa6d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5\" (UID: \"2579756d-6019-40b6-b52b-ba5a73bfaa6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:11.155548 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.155480 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2579756d-6019-40b6-b52b-ba5a73bfaa6d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5\" (UID: \"2579756d-6019-40b6-b52b-ba5a73bfaa6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:11.155649 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.155632 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2579756d-6019-40b6-b52b-ba5a73bfaa6d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5\" (UID: \"2579756d-6019-40b6-b52b-ba5a73bfaa6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:11.257125 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.257024 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2579756d-6019-40b6-b52b-ba5a73bfaa6d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5\" (UID: \"2579756d-6019-40b6-b52b-ba5a73bfaa6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:11.257125 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.257094 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bfx9\" (UniqueName: \"kubernetes.io/projected/2579756d-6019-40b6-b52b-ba5a73bfaa6d-kube-api-access-7bfx9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5\" (UID: \"2579756d-6019-40b6-b52b-ba5a73bfaa6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:11.257125 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.257115 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2579756d-6019-40b6-b52b-ba5a73bfaa6d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5\" (UID: \"2579756d-6019-40b6-b52b-ba5a73bfaa6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:11.257485 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.257145 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2579756d-6019-40b6-b52b-ba5a73bfaa6d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5\" (UID: \"2579756d-6019-40b6-b52b-ba5a73bfaa6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:11.257485 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.257162 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2579756d-6019-40b6-b52b-ba5a73bfaa6d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5\" (UID: \"2579756d-6019-40b6-b52b-ba5a73bfaa6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:11.257485 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.257313 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2579756d-6019-40b6-b52b-ba5a73bfaa6d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5\" (UID: \"2579756d-6019-40b6-b52b-ba5a73bfaa6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:11.257623 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.257576 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2579756d-6019-40b6-b52b-ba5a73bfaa6d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5\" (UID: \"2579756d-6019-40b6-b52b-ba5a73bfaa6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:11.257722 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.257649 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2579756d-6019-40b6-b52b-ba5a73bfaa6d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5\" (UID: \"2579756d-6019-40b6-b52b-ba5a73bfaa6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:11.257806 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.257736 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2579756d-6019-40b6-b52b-ba5a73bfaa6d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5\" (UID: \"2579756d-6019-40b6-b52b-ba5a73bfaa6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:11.259677 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.259653 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2579756d-6019-40b6-b52b-ba5a73bfaa6d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5\" (UID: \"2579756d-6019-40b6-b52b-ba5a73bfaa6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:11.259996 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.259973 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2579756d-6019-40b6-b52b-ba5a73bfaa6d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5\" (UID: \"2579756d-6019-40b6-b52b-ba5a73bfaa6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:11.264605 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.264581 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bfx9\" (UniqueName: \"kubernetes.io/projected/2579756d-6019-40b6-b52b-ba5a73bfaa6d-kube-api-access-7bfx9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5\" (UID: \"2579756d-6019-40b6-b52b-ba5a73bfaa6d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:11.314476 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.314438 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:11.455423 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.455390 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5"] Jun 07 16:17:11.459231 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:17:11.459202 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2579756d_6019_40b6_b52b_ba5a73bfaa6d.slice/crio-249485a7ab94278bb6f1dc39de46c09c0e1df4826c20ab35e12dbc4dbf60c0e0 WatchSource:0}: Error finding container 249485a7ab94278bb6f1dc39de46c09c0e1df4826c20ab35e12dbc4dbf60c0e0: Status 404 returned error can't find the container with id 249485a7ab94278bb6f1dc39de46c09c0e1df4826c20ab35e12dbc4dbf60c0e0 Jun 07 16:17:11.620219 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.620174 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:17:11.978239 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.978197 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" event={"ID":"2579756d-6019-40b6-b52b-ba5a73bfaa6d","Type":"ContainerStarted","Data":"dfba7f6d881ef3103c45b09072d699e06398023b08225e25ebd7324535ed440d"} Jun 07 16:17:11.978454 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:11.978264 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" event={"ID":"2579756d-6019-40b6-b52b-ba5a73bfaa6d","Type":"ContainerStarted","Data":"249485a7ab94278bb6f1dc39de46c09c0e1df4826c20ab35e12dbc4dbf60c0e0"} Jun 07 16:17:12.984809 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:12.984771 2579 generic.go:356] "Generic (PLEG): container finished" podID="2579756d-6019-40b6-b52b-ba5a73bfaa6d" containerID="dfba7f6d881ef3103c45b09072d699e06398023b08225e25ebd7324535ed440d" exitCode=0 Jun 07 16:17:12.985192 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:12.984852 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" event={"ID":"2579756d-6019-40b6-b52b-ba5a73bfaa6d","Type":"ContainerDied","Data":"dfba7f6d881ef3103c45b09072d699e06398023b08225e25ebd7324535ed440d"} Jun 07 16:17:13.991975 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:13.991939 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" event={"ID":"2579756d-6019-40b6-b52b-ba5a73bfaa6d","Type":"ContainerStarted","Data":"3a4e6d6ebedb36f4c0252c4088f591de3b1a6bc1de18bd894fbc07a6f0c13ddc"} Jun 07 16:17:14.008861 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:14.008808 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" podStartSLOduration=2.52674337 podStartE2EDuration="4.008793696s" totalImagesPullingTime="196.511319ms" totalInitContainerRuntime="1.285539007s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:17:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:17:14.00741159 +0000 UTC m=+891.405348532" watchObservedRunningTime="2026-06-07 16:17:14.008793696 +0000 UTC m=+891.406730637" Jun 07 16:17:16.699420 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:16.699380 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h"] Jun 07 16:17:16.703792 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:16.703745 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:16.705847 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:16.705828 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 07 16:17:16.709689 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:16.709658 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h"] Jun 07 16:17:16.813251 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:16.813206 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7dh2\" (UniqueName: \"kubernetes.io/projected/3f68e8bc-72f7-472a-b730-c45f47bd097d-kube-api-access-h7dh2\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h\" (UID: \"3f68e8bc-72f7-472a-b730-c45f47bd097d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:16.813454 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:16.813261 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f68e8bc-72f7-472a-b730-c45f47bd097d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h\" (UID: \"3f68e8bc-72f7-472a-b730-c45f47bd097d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:16.813454 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:16.813337 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3f68e8bc-72f7-472a-b730-c45f47bd097d-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h\" (UID: \"3f68e8bc-72f7-472a-b730-c45f47bd097d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:16.813454 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:16.813439 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f68e8bc-72f7-472a-b730-c45f47bd097d-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h\" (UID: \"3f68e8bc-72f7-472a-b730-c45f47bd097d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:16.813618 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:16.813480 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f68e8bc-72f7-472a-b730-c45f47bd097d-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h\" (UID: \"3f68e8bc-72f7-472a-b730-c45f47bd097d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:16.813618 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:16.813513 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f68e8bc-72f7-472a-b730-c45f47bd097d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h\" (UID: \"3f68e8bc-72f7-472a-b730-c45f47bd097d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:16.915059 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:16.915019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f68e8bc-72f7-472a-b730-c45f47bd097d-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h\" (UID: \"3f68e8bc-72f7-472a-b730-c45f47bd097d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:16.915059 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:16.915063 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f68e8bc-72f7-472a-b730-c45f47bd097d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h\" (UID: \"3f68e8bc-72f7-472a-b730-c45f47bd097d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:16.915318 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:16.915113 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7dh2\" (UniqueName: \"kubernetes.io/projected/3f68e8bc-72f7-472a-b730-c45f47bd097d-kube-api-access-h7dh2\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h\" (UID: \"3f68e8bc-72f7-472a-b730-c45f47bd097d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:16.915318 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:16.915139 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f68e8bc-72f7-472a-b730-c45f47bd097d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h\" (UID: \"3f68e8bc-72f7-472a-b730-c45f47bd097d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:16.915318 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:16.915180 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3f68e8bc-72f7-472a-b730-c45f47bd097d-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h\" (UID: \"3f68e8bc-72f7-472a-b730-c45f47bd097d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:16.915318 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:16.915267 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f68e8bc-72f7-472a-b730-c45f47bd097d-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h\" (UID: \"3f68e8bc-72f7-472a-b730-c45f47bd097d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:16.915524 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:16.915500 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f68e8bc-72f7-472a-b730-c45f47bd097d-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h\" (UID: \"3f68e8bc-72f7-472a-b730-c45f47bd097d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:16.915579 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:16.915543 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f68e8bc-72f7-472a-b730-c45f47bd097d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h\" (UID: \"3f68e8bc-72f7-472a-b730-c45f47bd097d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:16.915623 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:16.915576 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3f68e8bc-72f7-472a-b730-c45f47bd097d-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h\" (UID: \"3f68e8bc-72f7-472a-b730-c45f47bd097d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:16.917646 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:16.917623 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f68e8bc-72f7-472a-b730-c45f47bd097d-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h\" (UID: \"3f68e8bc-72f7-472a-b730-c45f47bd097d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:16.917911 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:16.917896 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f68e8bc-72f7-472a-b730-c45f47bd097d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h\" (UID: \"3f68e8bc-72f7-472a-b730-c45f47bd097d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:16.922121 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:16.922094 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7dh2\" (UniqueName: \"kubernetes.io/projected/3f68e8bc-72f7-472a-b730-c45f47bd097d-kube-api-access-h7dh2\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h\" (UID: \"3f68e8bc-72f7-472a-b730-c45f47bd097d\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:17.015962 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:17.015925 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:17.162575 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:17.162545 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h"] Jun 07 16:17:17.164816 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:17:17.164784 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f68e8bc_72f7_472a_b730_c45f47bd097d.slice/crio-8dc20656307d8203d70a89de8f13cd80471e88f32d243128d593c21694bf122d WatchSource:0}: Error finding container 8dc20656307d8203d70a89de8f13cd80471e88f32d243128d593c21694bf122d: Status 404 returned error can't find the container with id 8dc20656307d8203d70a89de8f13cd80471e88f32d243128d593c21694bf122d Jun 07 16:17:17.427669 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:17.427561 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:17:18.017549 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:18.017515 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" event={"ID":"3f68e8bc-72f7-472a-b730-c45f47bd097d","Type":"ContainerStarted","Data":"0bf816132ae49f0374132ca7388fc53ac3484d031eb92e50366becb3a3c62ea8"} Jun 07 16:17:18.018030 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:18.017578 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" event={"ID":"3f68e8bc-72f7-472a-b730-c45f47bd097d","Type":"ContainerStarted","Data":"8dc20656307d8203d70a89de8f13cd80471e88f32d243128d593c21694bf122d"} Jun 07 16:17:19.023534 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:19.023495 2579 generic.go:356] "Generic (PLEG): container finished" podID="3f68e8bc-72f7-472a-b730-c45f47bd097d" containerID="0bf816132ae49f0374132ca7388fc53ac3484d031eb92e50366becb3a3c62ea8" exitCode=0 Jun 07 16:17:19.024008 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:19.023571 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" event={"ID":"3f68e8bc-72f7-472a-b730-c45f47bd097d","Type":"ContainerDied","Data":"0bf816132ae49f0374132ca7388fc53ac3484d031eb92e50366becb3a3c62ea8"} Jun 07 16:17:20.031810 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:20.031768 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" event={"ID":"3f68e8bc-72f7-472a-b730-c45f47bd097d","Type":"ContainerStarted","Data":"f2e15eed481b51f4f22c686fb7a7c338bb14af14652ee5118e65eaf9cb535175"} Jun 07 16:17:20.049312 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:20.049263 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" podStartSLOduration=2.549565464 podStartE2EDuration="4.049246174s" totalImagesPullingTime="174.739677ms" totalInitContainerRuntime="1.324941033s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:17:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:17:20.047659217 +0000 UTC m=+897.445596159" watchObservedRunningTime="2026-06-07 16:17:20.049246174 +0000 UTC m=+897.447183119" Jun 07 16:17:21.314828 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:21.314781 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:21.315267 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:21.314860 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:21.327799 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:21.327752 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:22.053495 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:22.053466 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5" Jun 07 16:17:23.032325 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:23.032294 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cbczx_2c2fb280-4c43-451e-a2a0-3ad84cb1d977/console-operator/1.log" Jun 07 16:17:23.032726 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:23.032693 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cbczx_2c2fb280-4c43-451e-a2a0-3ad84cb1d977/console-operator/1.log" Jun 07 16:17:23.039476 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:23.039452 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-826vv_7734bfb1-0434-4329-b54a-0069b78b45b1/ovn-acl-logging/0.log" Jun 07 16:17:23.039972 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:23.039954 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-826vv_7734bfb1-0434-4329-b54a-0069b78b45b1/ovn-acl-logging/0.log" Jun 07 16:17:27.016373 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:27.016335 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:27.016817 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:27.016417 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:27.029443 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:27.029421 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:27.079100 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:27.079072 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h" Jun 07 16:17:39.042740 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:17:39.042700 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:18:50.722257 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:18:50.722174 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:19:01.224096 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:19:01.224053 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:19:10.017518 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:19:10.017477 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:19:21.020693 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:19:21.020659 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:19:29.322841 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:19:29.322800 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:19:39.916576 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:19:39.916539 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:20:11.226182 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:20:11.226132 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:20:15.418530 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:20:15.418489 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:20:20.719918 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:20:20.719879 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:20:23.215278 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:20:23.215242 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:20:51.624730 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:20:51.624692 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:21:07.418652 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:21:07.418604 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:21:46.026498 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:21:46.026407 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:22:02.918713 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:22:02.918674 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:22:17.124601 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:22:17.124566 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:22:23.066074 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:22:23.066044 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cbczx_2c2fb280-4c43-451e-a2a0-3ad84cb1d977/console-operator/1.log" Jun 07 16:22:23.066993 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:22:23.066972 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cbczx_2c2fb280-4c43-451e-a2a0-3ad84cb1d977/console-operator/1.log" Jun 07 16:22:23.073422 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:22:23.073400 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-826vv_7734bfb1-0434-4329-b54a-0069b78b45b1/ovn-acl-logging/0.log" Jun 07 16:22:23.074320 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:22:23.074295 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-826vv_7734bfb1-0434-4329-b54a-0069b78b45b1/ovn-acl-logging/0.log" Jun 07 16:22:33.315044 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:22:33.315010 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9s5vq"] Jun 07 16:22:51.265324 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:22:51.265295 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-558f5455c4-bbjxk_171bf4c2-c75c-41af-8443-44fd191ed8f8/nginx/0.log" Jun 07 16:22:51.931639 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:22:51.931606 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79675d457c-2p5wb_7c1cf6bd-788a-4e1c-8a71-959e89feccf1/manager/0.log" Jun 07 16:22:51.938155 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:22:51.938134 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79675d457c-2p5wb_7c1cf6bd-788a-4e1c-8a71-959e89feccf1/copy-manifests/0.log" Jun 07 16:22:53.598688 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:22:53.598657 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dddnd_d6744aec-382f-47eb-9fba-0978a2fbf256/manager/0.log" Jun 07 16:22:53.824207 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:22:53.824174 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fzw4w_46fb6d3c-aeb3-489f-a3ec-5f4c7108bca9/registry-server/0.log" Jun 07 16:22:53.944858 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:22:53.944776 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-95vmg_d30ecf6e-bdac-4c26-913f-4da1a24b1dfc/manager/0.log" Jun 07 16:22:54.051354 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:22:54.051328 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9s5vq_9a96d58c-7ded-435f-b485-824c3be2478d/limitador/0.log" Jun 07 16:22:54.161747 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:22:54.161713 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-d44fn_be2c3439-38e7-4ffc-bc86-42225c89c56b/manager/0.log" Jun 07 16:22:54.521921 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:22:54.521894 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97959tdht_4d957809-1705-4182-9a1b-b367d48ae0b1/istio-proxy/0.log" Jun 07 16:22:54.951775 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:22:54.951684 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-tvqjq_6e2216dc-d02c-43dc-9427-8b0bf092c770/istio-proxy/1.log" Jun 07 16:22:55.598681 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:22:55.598655 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2_d916075a-61d6-4b50-a01c-233ad4a1f9d6/storage-initializer/0.log" Jun 07 16:22:55.604717 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:22:55.604694 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-7xcr2_d916075a-61d6-4b50-a01c-233ad4a1f9d6/main/0.log" Jun 07 16:22:55.929411 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:22:55.929322 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5_2579756d-6019-40b6-b52b-ba5a73bfaa6d/storage-initializer/0.log" Jun 07 16:22:55.936191 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:22:55.936160 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cvqvf5_2579756d-6019-40b6-b52b-ba5a73bfaa6d/main/0.log" Jun 07 16:22:56.047222 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:22:56.047194 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h_3f68e8bc-72f7-472a-b730-c45f47bd097d/storage-initializer/0.log" Jun 07 16:22:56.053512 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:22:56.053491 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-nfc6h_3f68e8bc-72f7-472a-b730-c45f47bd097d/main/0.log" Jun 07 16:23:03.431284 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:03.431202 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lg8vx_9885b2fd-1551-4bfc-9e75-18c6b4ff31aa/global-pull-secret-syncer/0.log" Jun 07 16:23:03.575188 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:03.575153 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mj7mp_0c49c912-24d0-4c26-9a89-46f6e3cec1b2/konnectivity-agent/0.log" Jun 07 16:23:03.593446 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:03.593413 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-133.ec2.internal_17d1772778b6e8d61f944dcb69222ce7/haproxy/0.log" Jun 07 16:23:08.499713 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:08.499681 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-dddnd_d6744aec-382f-47eb-9fba-0978a2fbf256/manager/0.log" Jun 07 16:23:08.568531 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:08.568502 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fzw4w_46fb6d3c-aeb3-489f-a3ec-5f4c7108bca9/registry-server/0.log" Jun 07 16:23:08.606872 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:08.606840 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-95vmg_d30ecf6e-bdac-4c26-913f-4da1a24b1dfc/manager/0.log" Jun 07 16:23:08.626115 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:08.626078 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9s5vq_9a96d58c-7ded-435f-b485-824c3be2478d/limitador/0.log" Jun 07 16:23:08.662941 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:08.662908 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-d44fn_be2c3439-38e7-4ffc-bc86-42225c89c56b/manager/0.log" Jun 07 16:23:10.491282 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:10.491251 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-46pz9_55466313-41cc-4d9a-9ca1-132dc90dc5de/kube-state-metrics/0.log" Jun 07 16:23:10.508287 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:10.508260 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-46pz9_55466313-41cc-4d9a-9ca1-132dc90dc5de/kube-rbac-proxy-main/0.log" Jun 07 16:23:10.530425 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:10.530392 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-46pz9_55466313-41cc-4d9a-9ca1-132dc90dc5de/kube-rbac-proxy-self/0.log" Jun 07 16:23:10.564054 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:10.564031 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7b75f899df-j59pw_27dd4f60-c766-4787-bbc5-bd8968eac82f/metrics-server/0.log" Jun 07 16:23:10.589263 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:10.589233 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-qw2ph_3cd9e2f6-4e4b-4a18-82af-8e36be0b98c8/monitoring-plugin/0.log" Jun 07 16:23:10.681542 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:10.681511 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cz9hr_c8c90aa8-cb2d-4d96-8b49-1900050f983e/node-exporter/0.log" Jun 07 16:23:10.701305 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:10.701275 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cz9hr_c8c90aa8-cb2d-4d96-8b49-1900050f983e/kube-rbac-proxy/0.log" Jun 07 16:23:10.720107 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:10.720081 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cz9hr_c8c90aa8-cb2d-4d96-8b49-1900050f983e/init-textfile/0.log" Jun 07 16:23:10.827606 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:10.827582 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-nxx44_d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7/kube-rbac-proxy-main/0.log" Jun 07 16:23:10.852972 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:10.852947 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-nxx44_d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7/kube-rbac-proxy-self/0.log" Jun 07 16:23:10.872624 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:10.872597 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-nxx44_d2103cbf-cb5f-4d2c-9f2b-4d12c9a8a2f7/openshift-state-metrics/0.log" Jun 07 16:23:10.921333 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:10.921286 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d518bdf1-ba18-4caf-94c6-b7981cce19eb/prometheus/0.log" Jun 07 16:23:10.939944 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:10.939918 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d518bdf1-ba18-4caf-94c6-b7981cce19eb/config-reloader/0.log" Jun 07 16:23:10.959953 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:10.959929 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d518bdf1-ba18-4caf-94c6-b7981cce19eb/thanos-sidecar/0.log" Jun 07 16:23:10.978727 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:10.978702 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d518bdf1-ba18-4caf-94c6-b7981cce19eb/kube-rbac-proxy-web/0.log" Jun 07 16:23:10.998334 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:10.998304 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d518bdf1-ba18-4caf-94c6-b7981cce19eb/kube-rbac-proxy/0.log" Jun 07 16:23:11.017674 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:11.017646 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d518bdf1-ba18-4caf-94c6-b7981cce19eb/kube-rbac-proxy-thanos/0.log" Jun 07 16:23:11.037341 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:11.037258 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d518bdf1-ba18-4caf-94c6-b7981cce19eb/init-config-reloader/0.log" Jun 07 16:23:11.157964 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:11.157936 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78cb7b6748-hfwz6_91e59c83-e63a-4ded-82e6-24b35685f59b/telemeter-client/0.log" Jun 07 16:23:11.189798 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:11.189738 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78cb7b6748-hfwz6_91e59c83-e63a-4ded-82e6-24b35685f59b/reload/0.log" Jun 07 16:23:11.217971 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:11.217947 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78cb7b6748-hfwz6_91e59c83-e63a-4ded-82e6-24b35685f59b/kube-rbac-proxy/0.log" Jun 07 16:23:11.257900 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:11.257874 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5b44485f-4dfsh_132f3857-6eb1-4437-a70f-aa80624c93d3/thanos-query/0.log" Jun 07 16:23:11.284156 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:11.284133 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5b44485f-4dfsh_132f3857-6eb1-4437-a70f-aa80624c93d3/kube-rbac-proxy-web/0.log" Jun 07 16:23:11.313881 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:11.313810 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5b44485f-4dfsh_132f3857-6eb1-4437-a70f-aa80624c93d3/kube-rbac-proxy/0.log" Jun 07 16:23:11.336606 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:11.336575 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5b44485f-4dfsh_132f3857-6eb1-4437-a70f-aa80624c93d3/prom-label-proxy/0.log" Jun 07 16:23:11.356444 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:11.356411 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5b44485f-4dfsh_132f3857-6eb1-4437-a70f-aa80624c93d3/kube-rbac-proxy-rules/0.log" Jun 07 16:23:11.374506 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:11.374484 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5b44485f-4dfsh_132f3857-6eb1-4437-a70f-aa80624c93d3/kube-rbac-proxy-metrics/0.log" Jun 07 16:23:13.521304 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:13.521273 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cbczx_2c2fb280-4c43-451e-a2a0-3ad84cb1d977/console-operator/1.log" Jun 07 16:23:13.526233 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:13.526214 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-cbczx_2c2fb280-4c43-451e-a2a0-3ad84cb1d977/console-operator/2.log" Jun 07 16:23:14.089852 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:14.089812 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69fb956c98-mdqm5_2b7540c9-ee99-4b0c-8a7d-15666f6639f5/console/0.log" Jun 07 16:23:14.901023 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:14.900978 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r"] Jun 07 16:23:14.904985 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:14.904964 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r" Jun 07 16:23:14.907067 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:14.907046 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-59tjk\"/\"kube-root-ca.crt\"" Jun 07 16:23:14.907752 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:14.907715 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-59tjk\"/\"default-dockercfg-mcg5b\"" Jun 07 16:23:14.907895 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:14.907793 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-59tjk\"/\"openshift-service-ca.crt\"" Jun 07 16:23:14.913689 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:14.913669 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r"] Jun 07 16:23:14.926025 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:14.925993 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/08a66857-1699-4181-9e30-fcd9894dd62b-podres\") pod \"perf-node-gather-daemonset-kxj6r\" (UID: \"08a66857-1699-4181-9e30-fcd9894dd62b\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r" Jun 07 16:23:14.926025 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:14.926044 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08a66857-1699-4181-9e30-fcd9894dd62b-sys\") pod \"perf-node-gather-daemonset-kxj6r\" (UID: \"08a66857-1699-4181-9e30-fcd9894dd62b\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r" Jun 07 16:23:14.926257 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:14.926174 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08a66857-1699-4181-9e30-fcd9894dd62b-lib-modules\") pod \"perf-node-gather-daemonset-kxj6r\" (UID: \"08a66857-1699-4181-9e30-fcd9894dd62b\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r" Jun 07 16:23:14.926300 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:14.926282 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc2ff\" (UniqueName: \"kubernetes.io/projected/08a66857-1699-4181-9e30-fcd9894dd62b-kube-api-access-fc2ff\") pod \"perf-node-gather-daemonset-kxj6r\" (UID: \"08a66857-1699-4181-9e30-fcd9894dd62b\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r" Jun 07 16:23:14.926363 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:14.926347 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/08a66857-1699-4181-9e30-fcd9894dd62b-proc\") pod \"perf-node-gather-daemonset-kxj6r\" (UID: \"08a66857-1699-4181-9e30-fcd9894dd62b\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r" Jun 07 16:23:15.027717 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:15.027675 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/08a66857-1699-4181-9e30-fcd9894dd62b-proc\") pod \"perf-node-gather-daemonset-kxj6r\" (UID: \"08a66857-1699-4181-9e30-fcd9894dd62b\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r" Jun 07 16:23:15.027951 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:15.027736 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/08a66857-1699-4181-9e30-fcd9894dd62b-podres\") pod \"perf-node-gather-daemonset-kxj6r\" (UID: \"08a66857-1699-4181-9e30-fcd9894dd62b\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r" Jun 07 16:23:15.027951 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:15.027802 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08a66857-1699-4181-9e30-fcd9894dd62b-sys\") pod \"perf-node-gather-daemonset-kxj6r\" (UID: \"08a66857-1699-4181-9e30-fcd9894dd62b\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r" Jun 07 16:23:15.027951 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:15.027846 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08a66857-1699-4181-9e30-fcd9894dd62b-lib-modules\") pod \"perf-node-gather-daemonset-kxj6r\" (UID: \"08a66857-1699-4181-9e30-fcd9894dd62b\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r" Jun 07 16:23:15.027951 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:15.027840 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/08a66857-1699-4181-9e30-fcd9894dd62b-proc\") pod \"perf-node-gather-daemonset-kxj6r\" (UID: \"08a66857-1699-4181-9e30-fcd9894dd62b\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r" Jun 07 16:23:15.027951 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:15.027870 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08a66857-1699-4181-9e30-fcd9894dd62b-sys\") pod \"perf-node-gather-daemonset-kxj6r\" (UID: \"08a66857-1699-4181-9e30-fcd9894dd62b\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r" Jun 07 16:23:15.027951 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:15.027916 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/08a66857-1699-4181-9e30-fcd9894dd62b-podres\") pod \"perf-node-gather-daemonset-kxj6r\" (UID: \"08a66857-1699-4181-9e30-fcd9894dd62b\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r" Jun 07 16:23:15.027951 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:15.027922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc2ff\" (UniqueName: \"kubernetes.io/projected/08a66857-1699-4181-9e30-fcd9894dd62b-kube-api-access-fc2ff\") pod \"perf-node-gather-daemonset-kxj6r\" (UID: \"08a66857-1699-4181-9e30-fcd9894dd62b\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r" Jun 07 16:23:15.028219 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:15.027998 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/08a66857-1699-4181-9e30-fcd9894dd62b-lib-modules\") pod \"perf-node-gather-daemonset-kxj6r\" (UID: \"08a66857-1699-4181-9e30-fcd9894dd62b\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r" Jun 07 16:23:15.035977 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:15.035947 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc2ff\" (UniqueName: \"kubernetes.io/projected/08a66857-1699-4181-9e30-fcd9894dd62b-kube-api-access-fc2ff\") pod \"perf-node-gather-daemonset-kxj6r\" (UID: \"08a66857-1699-4181-9e30-fcd9894dd62b\") " pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r" Jun 07 16:23:15.217140 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:15.217106 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r" Jun 07 16:23:15.355974 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:15.355948 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r"] Jun 07 16:23:15.358623 ip-10-0-130-133 kubenswrapper[2579]: W0607 16:23:15.358593 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod08a66857_1699_4181_9e30_fcd9894dd62b.slice/crio-19ac8f7af7d210215bbc78419cce3f51427e2218d6b1e172e43a9b12b2312d06 WatchSource:0}: Error finding container 19ac8f7af7d210215bbc78419cce3f51427e2218d6b1e172e43a9b12b2312d06: Status 404 returned error can't find the container with id 19ac8f7af7d210215bbc78419cce3f51427e2218d6b1e172e43a9b12b2312d06 Jun 07 16:23:15.925566 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:15.925477 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r" event={"ID":"08a66857-1699-4181-9e30-fcd9894dd62b","Type":"ContainerStarted","Data":"2c4211ed8d5b59d55a2673345f937125460bee826b16a1ef812ff5f10b61fa33"} Jun 07 16:23:15.925566 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:15.925536 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r" event={"ID":"08a66857-1699-4181-9e30-fcd9894dd62b","Type":"ContainerStarted","Data":"19ac8f7af7d210215bbc78419cce3f51427e2218d6b1e172e43a9b12b2312d06"} Jun 07 16:23:15.925985 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:15.925571 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r" Jun 07 16:23:15.939630 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:15.939587 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r" podStartSLOduration=1.9395720669999998 podStartE2EDuration="1.939572067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:23:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:23:15.938790416 +0000 UTC m=+1253.336727359" watchObservedRunningTime="2026-06-07 16:23:15.939572067 +0000 UTC m=+1253.337509008" Jun 07 16:23:16.051995 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:16.051959 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5qvz9_843ede38-3aaa-4002-843e-ae71fca510a5/dns/0.log" Jun 07 16:23:16.071300 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:16.071265 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5qvz9_843ede38-3aaa-4002-843e-ae71fca510a5/kube-rbac-proxy/0.log" Jun 07 16:23:16.165576 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:16.165545 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wfs76_6a7766ae-5bce-436a-ba5d-40bf36fc0d7c/dns-node-resolver/0.log" Jun 07 16:23:16.721819 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:16.721790 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sh4jr_ac34f759-ee32-402b-8ba7-b99a4983eb62/node-ca/0.log" Jun 07 16:23:17.643203 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:17.643170 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97959tdht_4d957809-1705-4182-9a1b-b367d48ae0b1/istio-proxy/0.log" Jun 07 16:23:17.758183 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:17.758145 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-tvqjq_6e2216dc-d02c-43dc-9427-8b0bf092c770/istio-proxy/0.log" Jun 07 16:23:17.766403 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:17.766371 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-tvqjq_6e2216dc-d02c-43dc-9427-8b0bf092c770/istio-proxy/1.log" Jun 07 16:23:18.468605 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:18.468572 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v6l9d_39d00b6b-37cc-4de8-ab5d-037a5080ecd0/serve-healthcheck-canary/0.log" Jun 07 16:23:18.996922 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:18.996891 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ck9vn_0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d/kube-rbac-proxy/0.log" Jun 07 16:23:19.016063 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:19.016035 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ck9vn_0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d/exporter/0.log" Jun 07 16:23:19.040014 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:19.039990 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ck9vn_0a6ddf8a-77d5-4f17-b0b1-ed127abc3d8d/extractor/0.log" Jun 07 16:23:21.338396 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:21.338368 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-558f5455c4-bbjxk_171bf4c2-c75c-41af-8443-44fd191ed8f8/nginx/0.log" Jun 07 16:23:21.514883 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:21.514854 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79675d457c-2p5wb_7c1cf6bd-788a-4e1c-8a71-959e89feccf1/manager/0.log" Jun 07 16:23:21.532691 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:21.532658 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79675d457c-2p5wb_7c1cf6bd-788a-4e1c-8a71-959e89feccf1/copy-manifests/0.log" Jun 07 16:23:21.941751 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:21.941719 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-59tjk/perf-node-gather-daemonset-kxj6r" Jun 07 16:23:23.077409 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:23.077370 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-594b75d8b-fkwnp_58fb6667-0454-4874-84c7-e76ae9a26d47/manager/0.log" Jun 07 16:23:28.717870 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:28.717841 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-8856t_5472e974-3d92-48b3-abaf-e4405d0b6a36/migrator/0.log" Jun 07 16:23:28.742431 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:28.742396 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-8856t_5472e974-3d92-48b3-abaf-e4405d0b6a36/graceful-termination/0.log" Jun 07 16:23:29.074844 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:29.074728 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97959tdht_4d957809-1705-4182-9a1b-b367d48ae0b1/istio-proxy/0.log" Jun 07 16:23:29.162776 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:29.162734 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-tvqjq_6e2216dc-d02c-43dc-9427-8b0bf092c770/istio-proxy/0.log" Jun 07 16:23:29.174258 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:29.174218 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-tvqjq_6e2216dc-d02c-43dc-9427-8b0bf092c770/istio-proxy/1.log" Jun 07 16:23:30.335166 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:30.335126 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97959tdht_4d957809-1705-4182-9a1b-b367d48ae0b1/istio-proxy/0.log" Jun 07 16:23:30.352798 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:30.352745 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4r4mr_4f808007-b5eb-4a1a-a186-0a90489f7102/kube-multus/0.log" Jun 07 16:23:30.427450 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:30.427403 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-tvqjq_6e2216dc-d02c-43dc-9427-8b0bf092c770/istio-proxy/0.log" Jun 07 16:23:30.435748 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:30.435669 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-tvqjq_6e2216dc-d02c-43dc-9427-8b0bf092c770/istio-proxy/1.log" Jun 07 16:23:30.553272 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:30.553247 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hdls5_d71a3072-92cb-4580-9260-0579a591a6a5/kube-multus-additional-cni-plugins/0.log" Jun 07 16:23:30.578738 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:30.578710 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hdls5_d71a3072-92cb-4580-9260-0579a591a6a5/egress-router-binary-copy/0.log" Jun 07 16:23:30.600744 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:30.600672 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hdls5_d71a3072-92cb-4580-9260-0579a591a6a5/cni-plugins/0.log" Jun 07 16:23:30.622853 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:30.622825 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hdls5_d71a3072-92cb-4580-9260-0579a591a6a5/bond-cni-plugin/0.log" Jun 07 16:23:30.642119 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:30.642089 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hdls5_d71a3072-92cb-4580-9260-0579a591a6a5/routeoverride-cni/0.log" Jun 07 16:23:30.663244 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:30.663213 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hdls5_d71a3072-92cb-4580-9260-0579a591a6a5/whereabouts-cni-bincopy/0.log" Jun 07 16:23:30.682202 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:30.682172 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hdls5_d71a3072-92cb-4580-9260-0579a591a6a5/whereabouts-cni/0.log" Jun 07 16:23:30.928331 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:30.928255 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-c9g56_ec607386-1984-4a48-8b69-eb23b7525b9f/network-metrics-daemon/0.log" Jun 07 16:23:30.947880 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:30.947848 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-c9g56_ec607386-1984-4a48-8b69-eb23b7525b9f/kube-rbac-proxy/0.log" Jun 07 16:23:31.974040 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:31.974010 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-826vv_7734bfb1-0434-4329-b54a-0069b78b45b1/ovn-controller/0.log" Jun 07 16:23:31.991848 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:31.991824 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-826vv_7734bfb1-0434-4329-b54a-0069b78b45b1/ovn-acl-logging/1.log" Jun 07 16:23:31.992019 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:31.991858 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-826vv_7734bfb1-0434-4329-b54a-0069b78b45b1/ovn-acl-logging/0.log" Jun 07 16:23:32.014195 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:32.014167 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-826vv_7734bfb1-0434-4329-b54a-0069b78b45b1/kube-rbac-proxy-node/0.log" Jun 07 16:23:32.033415 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:32.033387 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-826vv_7734bfb1-0434-4329-b54a-0069b78b45b1/kube-rbac-proxy-ovn-metrics/0.log" Jun 07 16:23:32.050398 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:32.050377 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-826vv_7734bfb1-0434-4329-b54a-0069b78b45b1/northd/0.log" Jun 07 16:23:32.072434 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:32.072412 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-826vv_7734bfb1-0434-4329-b54a-0069b78b45b1/nbdb/0.log" Jun 07 16:23:32.100810 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:32.100774 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-826vv_7734bfb1-0434-4329-b54a-0069b78b45b1/sbdb/0.log" Jun 07 16:23:32.104408 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:32.104385 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97959tdht_4d957809-1705-4182-9a1b-b367d48ae0b1/istio-proxy/0.log" Jun 07 16:23:32.142609 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:32.142580 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-826vv_7734bfb1-0434-4329-b54a-0069b78b45b1/ovnkube-controller/0.log" Jun 07 16:23:32.198088 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:32.198061 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-tvqjq_6e2216dc-d02c-43dc-9427-8b0bf092c770/istio-proxy/0.log" Jun 07 16:23:32.205931 ip-10-0-130-133 kubenswrapper[2579]: I0607 16:23:32.205908 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-tvqjq_6e2216dc-d02c-43dc-9427-8b0bf092c770/istio-proxy/1.log"