Jul 16 08:52:54.065269 ip-10-0-140-31 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 16 08:52:54.065277 ip-10-0-140-31 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 16 08:52:54.065284 ip-10-0-140-31 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 16 08:52:54.065491 ip-10-0-140-31 systemd[1]: Failed to start Kubernetes Kubelet. Jul 16 08:53:02.752874 ip-10-0-140-31 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 16 08:53:02.752888 ip-10-0-140-31 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f35a9aa5bfaf44a6adf2ac159fb8f14a -- Jul 16 08:54:31.584742 ip-10-0-140-31 systemd[1]: Starting Kubernetes Kubelet... Jul 16 08:54:32.025304 ip-10-0-140-31 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 08:54:32.025304 ip-10-0-140-31 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 08:54:32.025304 ip-10-0-140-31 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 08:54:32.025304 ip-10-0-140-31 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 08:54:32.025304 ip-10-0-140-31 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 08:54:32.027421 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.027352 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 08:54:32.033245 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033230 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 08:54:32.033245 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033245 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 16 08:54:32.033304 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033248 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 08:54:32.033304 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033251 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 08:54:32.033304 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033254 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 08:54:32.033304 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033257 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 08:54:32.033304 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033260 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 08:54:32.033304 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033264 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 08:54:32.033304 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033267 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 08:54:32.033304 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033270 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 08:54:32.033304 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033273 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 08:54:32.033304 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033275 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 08:54:32.033304 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033277 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 08:54:32.033304 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033280 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 08:54:32.033304 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033283 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 08:54:32.033304 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033285 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 08:54:32.033304 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033287 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 08:54:32.033304 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033290 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 08:54:32.033304 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033292 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 08:54:32.033304 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033295 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 08:54:32.033304 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033302 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 08:54:32.033304 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033305 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 08:54:32.033809 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033308 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 08:54:32.033809 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033310 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 08:54:32.033809 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033313 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 08:54:32.033809 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033335 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 08:54:32.033809 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033338 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 08:54:32.033809 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033340 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 08:54:32.033809 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033343 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 08:54:32.033809 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033345 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 08:54:32.033809 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033348 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 08:54:32.033809 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033350 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 08:54:32.033809 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033352 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 08:54:32.033809 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033355 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 08:54:32.033809 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033357 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 08:54:32.033809 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033360 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 08:54:32.033809 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033362 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 08:54:32.033809 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033365 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 08:54:32.033809 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033367 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 08:54:32.033809 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033370 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 08:54:32.033809 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033373 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 08:54:32.033809 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033375 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 08:54:32.034286 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033377 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 08:54:32.034286 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033380 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 08:54:32.034286 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033383 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 08:54:32.034286 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033385 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 08:54:32.034286 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033388 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 08:54:32.034286 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033391 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 08:54:32.034286 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033393 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 08:54:32.034286 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033396 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 08:54:32.034286 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033398 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 08:54:32.034286 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033400 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 08:54:32.034286 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033403 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 08:54:32.034286 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033407 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 08:54:32.034286 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033411 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 08:54:32.034286 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033415 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 08:54:32.034286 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033418 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 08:54:32.034286 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033420 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 08:54:32.034286 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033423 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 08:54:32.034286 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033426 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 08:54:32.034286 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033428 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 08:54:32.034807 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033431 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 08:54:32.034807 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033434 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 08:54:32.034807 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033438 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 08:54:32.034807 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033441 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 08:54:32.034807 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033444 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 08:54:32.034807 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033446 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 08:54:32.034807 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033449 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 08:54:32.034807 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033451 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 08:54:32.034807 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033454 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 08:54:32.034807 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033456 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 08:54:32.034807 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033459 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 08:54:32.034807 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033461 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 08:54:32.034807 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033464 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 08:54:32.034807 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033481 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 08:54:32.034807 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033485 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 08:54:32.034807 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033490 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 08:54:32.034807 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033494 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 08:54:32.034807 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033497 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 08:54:32.034807 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033499 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 08:54:32.035277 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033502 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 08:54:32.035277 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033504 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 08:54:32.035277 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033507 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 08:54:32.035277 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033510 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 08:54:32.035277 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033513 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 08:54:32.035277 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033515 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 08:54:32.035277 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033518 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 08:54:32.035277 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033524 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 08:54:32.035277 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033527 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 08:54:32.035277 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033530 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 08:54:32.035277 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033532 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 08:54:32.035277 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033535 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 08:54:32.035277 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033539 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 08:54:32.035277 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033541 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 08:54:32.035277 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033543 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 08:54:32.035277 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033546 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 08:54:32.035277 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033548 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 08:54:32.035277 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033551 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 08:54:32.035277 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.033553 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 08:54:32.035763 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034288 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 08:54:32.035763 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034295 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 08:54:32.035763 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034298 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 08:54:32.035763 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034302 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 08:54:32.035763 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034304 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 08:54:32.035763 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034310 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 08:54:32.035763 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034313 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 08:54:32.035763 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034316 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 08:54:32.035763 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034318 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 08:54:32.035763 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034321 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 08:54:32.035763 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034324 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 08:54:32.035763 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034326 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 08:54:32.035763 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034328 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 08:54:32.035763 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034331 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 08:54:32.035763 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034334 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 08:54:32.035763 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034336 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 08:54:32.035763 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034339 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 08:54:32.035763 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034341 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 08:54:32.035763 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034344 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 08:54:32.035763 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034347 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 08:54:32.036289 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034352 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 08:54:32.036289 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034355 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 08:54:32.036289 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034358 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 08:54:32.036289 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034362 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 08:54:32.036289 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034364 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 08:54:32.036289 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034367 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 08:54:32.036289 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034369 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 08:54:32.036289 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034373 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 08:54:32.036289 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034377 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 08:54:32.036289 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034379 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 08:54:32.036289 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034382 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 08:54:32.036289 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034385 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 08:54:32.036289 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034388 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 08:54:32.036289 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034391 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 08:54:32.036289 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034394 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 08:54:32.036289 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034396 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 08:54:32.036289 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034399 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 08:54:32.036289 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034401 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 08:54:32.036289 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034404 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 08:54:32.036797 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034407 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 08:54:32.036797 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034410 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 08:54:32.036797 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034412 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 08:54:32.036797 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034416 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 08:54:32.036797 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034418 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 08:54:32.036797 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034421 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 08:54:32.036797 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034424 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 08:54:32.036797 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034426 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 08:54:32.036797 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034429 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 08:54:32.036797 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034431 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 08:54:32.036797 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034434 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 08:54:32.036797 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034437 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 08:54:32.036797 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034439 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 08:54:32.036797 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034443 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 08:54:32.036797 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034446 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 08:54:32.036797 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034448 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 08:54:32.036797 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034451 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 08:54:32.036797 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034454 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 08:54:32.036797 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034458 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 08:54:32.036797 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034461 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 08:54:32.037267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034463 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 08:54:32.037267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034466 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 08:54:32.037267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034497 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 08:54:32.037267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034501 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 08:54:32.037267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034503 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 08:54:32.037267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034506 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 08:54:32.037267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034508 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 08:54:32.037267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034511 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 08:54:32.037267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034514 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 08:54:32.037267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034516 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 08:54:32.037267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034519 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 08:54:32.037267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034521 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 08:54:32.037267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034527 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 08:54:32.037267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034530 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 08:54:32.037267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034532 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 08:54:32.037267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034535 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 08:54:32.037267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034537 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 08:54:32.037267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034539 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 08:54:32.037267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034542 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 08:54:32.037267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034544 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 08:54:32.037787 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034547 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 08:54:32.037787 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034550 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 08:54:32.037787 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034552 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 08:54:32.037787 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034555 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 08:54:32.037787 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034558 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 08:54:32.037787 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034560 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 08:54:32.037787 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034563 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 08:54:32.037787 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034566 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 08:54:32.037787 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034568 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 08:54:32.037787 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034571 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 08:54:32.037787 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034573 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 08:54:32.037787 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034575 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 08:54:32.037787 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034578 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 16 08:54:32.037787 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034580 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 08:54:32.037787 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034582 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 08:54:32.037787 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034585 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 08:54:32.037787 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034587 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 08:54:32.037787 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034589 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 08:54:32.037787 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034592 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 08:54:32.037787 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034594 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 08:54:32.038266 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.034999 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 08:54:32.038266 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035004 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 08:54:32.038266 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035007 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 08:54:32.038266 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035011 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 08:54:32.038266 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035014 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 08:54:32.038266 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035017 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 08:54:32.038266 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035019 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 08:54:32.038266 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035022 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 08:54:32.038266 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035024 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 08:54:32.038266 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035027 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 08:54:32.038266 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035029 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 08:54:32.038266 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035032 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 08:54:32.038266 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035034 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 08:54:32.038266 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035037 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 08:54:32.038266 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035040 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 08:54:32.038266 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035043 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 08:54:32.038266 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035046 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 08:54:32.038266 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035049 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 08:54:32.038266 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035051 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 08:54:32.038739 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035054 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 08:54:32.038739 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035056 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 08:54:32.038739 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035059 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 08:54:32.038739 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035061 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 08:54:32.038739 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035064 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 08:54:32.038739 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035067 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 08:54:32.038739 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035069 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 08:54:32.038739 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035072 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 08:54:32.038739 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035074 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 08:54:32.038739 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035077 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 08:54:32.038739 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035079 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 08:54:32.038739 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035082 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 08:54:32.038739 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035084 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 08:54:32.038739 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035087 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 08:54:32.038739 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035090 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 08:54:32.038739 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035093 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 08:54:32.038739 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035095 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 08:54:32.038739 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035097 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 08:54:32.038739 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035100 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 08:54:32.038739 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035103 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 08:54:32.039212 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035105 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 08:54:32.039212 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035108 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 08:54:32.039212 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035110 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 08:54:32.039212 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035112 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 08:54:32.039212 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035115 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 08:54:32.039212 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035117 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 08:54:32.039212 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035122 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 08:54:32.039212 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035125 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 08:54:32.039212 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035128 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 08:54:32.039212 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035130 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 08:54:32.039212 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035133 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 08:54:32.039212 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035135 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 08:54:32.039212 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035138 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 08:54:32.039212 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035141 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 08:54:32.039212 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035144 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 08:54:32.039212 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035146 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 08:54:32.039212 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035149 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 08:54:32.039212 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035151 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 08:54:32.039212 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035154 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 08:54:32.039212 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035157 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 08:54:32.039720 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035161 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 08:54:32.039720 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035164 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 08:54:32.039720 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035166 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 08:54:32.039720 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035169 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 08:54:32.039720 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035171 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 08:54:32.039720 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035174 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 08:54:32.039720 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035177 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 08:54:32.039720 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035179 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 08:54:32.039720 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035181 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 08:54:32.039720 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035184 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 08:54:32.039720 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035186 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 08:54:32.039720 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035189 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 08:54:32.039720 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035192 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 08:54:32.039720 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035194 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 08:54:32.039720 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035197 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 08:54:32.039720 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035199 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 08:54:32.039720 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035202 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 08:54:32.039720 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035204 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 08:54:32.039720 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035208 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 08:54:32.039720 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035211 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 08:54:32.040200 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035215 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 08:54:32.040200 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035219 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 08:54:32.040200 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035223 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 16 08:54:32.040200 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035226 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 08:54:32.040200 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035228 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 08:54:32.040200 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035231 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 08:54:32.040200 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035234 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 08:54:32.040200 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035236 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 08:54:32.040200 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035239 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 08:54:32.040200 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035242 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 08:54:32.040200 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035244 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 08:54:32.040200 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035246 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 08:54:32.040200 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035249 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 08:54:32.040200 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035252 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 08:54:32.040200 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035254 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 08:54:32.040200 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035256 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 08:54:32.040200 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035259 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 08:54:32.040200 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035261 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 08:54:32.040200 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035263 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035266 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035333 2559 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035340 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035345 2559 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035349 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035361 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035364 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035368 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035372 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035375 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035378 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035381 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035385 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035389 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035392 2559 flags.go:64] FLAG: --cgroup-root="" Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035394 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035397 2559 flags.go:64] FLAG: --client-ca-file="" Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035400 2559 flags.go:64] FLAG: --cloud-provider="external" Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035403 2559 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035407 2559 flags.go:64] FLAG: --cluster-domain="" Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035410 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035413 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035416 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 08:54:32.040699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035419 2559 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035422 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035425 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035428 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035431 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035434 2559 flags.go:64] FLAG: --contention-profiling="false" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035437 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035440 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035443 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035445 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035449 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035452 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035455 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035458 2559 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035460 2559 flags.go:64] FLAG: --enable-server="true" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035463 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035484 2559 flags.go:64] FLAG: --event-burst="100" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035489 2559 flags.go:64] FLAG: --event-qps="50" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035494 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035498 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035502 2559 flags.go:64] FLAG: --eviction-hard="" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035505 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035509 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035512 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035515 2559 flags.go:64] FLAG: --eviction-soft="" Jul 16 08:54:32.041326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035518 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 08:54:32.041933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035520 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 08:54:32.041933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035523 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 08:54:32.041933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035526 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 08:54:32.041933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035529 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 08:54:32.041933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035532 2559 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 08:54:32.041933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035534 2559 flags.go:64] FLAG: --feature-gates="" Jul 16 08:54:32.041933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035538 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 08:54:32.041933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035541 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 08:54:32.041933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035544 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 08:54:32.041933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035547 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 08:54:32.041933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035550 2559 flags.go:64] FLAG: --healthz-port="10248" Jul 16 08:54:32.041933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035553 2559 flags.go:64] FLAG: --help="false" Jul 16 08:54:32.041933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035555 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-140-31.ec2.internal" Jul 16 08:54:32.041933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035559 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 08:54:32.041933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035561 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 08:54:32.041933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035564 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 08:54:32.041933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035567 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 08:54:32.041933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035570 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 08:54:32.041933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035573 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 08:54:32.041933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035576 2559 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 08:54:32.041933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035578 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 08:54:32.041933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035581 2559 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 08:54:32.041933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035585 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035588 2559 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035591 2559 flags.go:64] FLAG: --kube-reserved="" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035593 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035596 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035599 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035603 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035605 2559 flags.go:64] FLAG: --lock-file="" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035608 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035611 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035614 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035619 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035622 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035625 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035628 2559 flags.go:64] FLAG: --logging-format="text" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035630 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035634 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035636 2559 flags.go:64] FLAG: --manifest-url="" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035639 2559 flags.go:64] FLAG: --manifest-url-header="" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035644 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035646 2559 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035660 2559 flags.go:64] FLAG: --max-pods="110" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035665 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035668 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035671 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 08:54:32.042541 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035674 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035677 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035680 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035683 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035689 2559 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035692 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035695 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035698 2559 flags.go:64] FLAG: --pod-cidr="" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035702 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035707 2559 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035710 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035713 2559 flags.go:64] FLAG: --pods-per-core="0" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035716 2559 flags.go:64] FLAG: --port="10250" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035719 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035721 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05e7d4f95b0f343b0" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035724 2559 flags.go:64] FLAG: --qos-reserved="" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035727 2559 flags.go:64] FLAG: --read-only-port="10255" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035730 2559 flags.go:64] FLAG: --register-node="true" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035733 2559 flags.go:64] FLAG: --register-with-taints="" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035736 2559 flags.go:64] FLAG: --registry-burst="10" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035739 2559 flags.go:64] FLAG: --registry-qps="5" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035742 2559 flags.go:64] FLAG: --reserved-cpus="" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035744 2559 flags.go:64] FLAG: --reserved-memory="" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035748 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035750 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 08:54:32.043144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035753 2559 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035756 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035759 2559 flags.go:64] FLAG: --runonce="false" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035761 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035764 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035767 2559 flags.go:64] FLAG: --seccomp-default="false" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035770 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035773 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035776 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035779 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035781 2559 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035784 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035787 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035790 2559 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035792 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035797 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035800 2559 flags.go:64] FLAG: --system-cgroups="" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035803 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035809 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035812 2559 flags.go:64] FLAG: --tls-cert-file="" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035816 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035821 2559 flags.go:64] FLAG: --tls-min-version="" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035824 2559 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035826 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035829 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 08:54:32.043778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035832 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 08:54:32.044382 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035835 2559 flags.go:64] FLAG: --v="2" Jul 16 08:54:32.044382 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035838 2559 flags.go:64] FLAG: --version="false" Jul 16 08:54:32.044382 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035842 2559 flags.go:64] FLAG: --vmodule="" Jul 16 08:54:32.044382 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035846 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 08:54:32.044382 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.035849 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 08:54:32.044382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035978 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 08:54:32.044382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035982 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 08:54:32.044382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035985 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 08:54:32.044382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035988 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 08:54:32.044382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035990 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 08:54:32.044382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035992 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 08:54:32.044382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035995 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 08:54:32.044382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.035997 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 08:54:32.044382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036000 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 08:54:32.044382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036003 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 08:54:32.044382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036006 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 08:54:32.044382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036008 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 08:54:32.044382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036011 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 08:54:32.044382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036013 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 08:54:32.044382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036016 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 08:54:32.044382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036018 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 08:54:32.044929 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036022 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 08:54:32.044929 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036025 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 08:54:32.044929 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036028 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 08:54:32.044929 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036030 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 08:54:32.044929 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036033 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 08:54:32.044929 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036037 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 08:54:32.044929 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036040 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 08:54:32.044929 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036042 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 08:54:32.044929 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036045 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 08:54:32.044929 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036047 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 08:54:32.044929 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036049 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 08:54:32.044929 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036052 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 08:54:32.044929 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036056 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 08:54:32.044929 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036060 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 08:54:32.044929 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036063 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 08:54:32.044929 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036066 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 08:54:32.044929 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036069 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 08:54:32.044929 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036071 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 08:54:32.044929 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036074 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 08:54:32.045382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036076 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 08:54:32.045382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036079 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 08:54:32.045382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036081 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 08:54:32.045382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036084 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 08:54:32.045382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036087 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 08:54:32.045382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036089 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 08:54:32.045382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036091 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 08:54:32.045382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036094 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 08:54:32.045382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036096 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 08:54:32.045382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036098 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 08:54:32.045382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036101 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 08:54:32.045382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036103 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 08:54:32.045382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036107 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 08:54:32.045382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036112 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 08:54:32.045382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036115 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 08:54:32.045382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036118 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 08:54:32.045382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036121 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 08:54:32.045382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036123 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 08:54:32.045382 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036127 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 08:54:32.045862 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036130 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 08:54:32.045862 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036132 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 08:54:32.045862 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036135 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 08:54:32.045862 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036137 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 08:54:32.045862 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036139 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 08:54:32.045862 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036142 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 08:54:32.045862 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036144 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 08:54:32.045862 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036147 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 08:54:32.045862 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036149 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 08:54:32.045862 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036151 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 08:54:32.045862 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036154 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 08:54:32.045862 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036156 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 08:54:32.045862 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036158 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 08:54:32.045862 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036161 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 08:54:32.045862 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036163 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 08:54:32.045862 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036166 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 08:54:32.045862 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036169 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 08:54:32.045862 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036171 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 08:54:32.045862 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036175 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 08:54:32.045862 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036178 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 08:54:32.046335 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036181 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 08:54:32.046335 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036184 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 08:54:32.046335 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036187 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 08:54:32.046335 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036189 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 08:54:32.046335 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036192 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 08:54:32.046335 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036195 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 08:54:32.046335 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036199 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 08:54:32.046335 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036202 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 08:54:32.046335 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036204 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 08:54:32.046335 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036207 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 08:54:32.046335 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036216 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 08:54:32.046335 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036221 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 08:54:32.046335 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036224 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 08:54:32.046335 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036226 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 08:54:32.046335 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036229 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 16 08:54:32.046335 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036232 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 08:54:32.046335 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036234 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 08:54:32.046335 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036237 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 08:54:32.046335 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036240 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 08:54:32.046335 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036243 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 08:54:32.046861 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036245 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 08:54:32.046861 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036248 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 08:54:32.046861 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036250 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 08:54:32.046861 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036253 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 08:54:32.046861 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.036255 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 08:54:32.046861 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.037210 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 08:54:32.046861 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.044159 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 08:54:32.046861 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.044173 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 08:54:32.046861 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.045865 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 08:54:32.046861 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.045873 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 08:54:32.046861 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.045939 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 08:54:32.046861 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.045944 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 08:54:32.046861 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.045947 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 08:54:32.046861 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.045951 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 08:54:32.046861 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.045954 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 08:54:32.047433 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.045957 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 08:54:32.047433 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.045960 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 08:54:32.047433 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.045963 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 08:54:32.047433 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.045966 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 08:54:32.047433 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.045968 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 08:54:32.047433 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.045971 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 08:54:32.047433 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.045973 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 08:54:32.047433 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.045976 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 08:54:32.047433 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.045979 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 08:54:32.047433 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.045982 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 08:54:32.047433 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.045984 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 08:54:32.047433 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.045987 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 08:54:32.047433 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.045989 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 08:54:32.047433 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.045992 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 08:54:32.047433 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.045995 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 08:54:32.047433 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.045997 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 08:54:32.047433 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.045999 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 08:54:32.047433 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046002 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 08:54:32.047433 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046005 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 16 08:54:32.047433 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046007 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 08:54:32.048160 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046010 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 08:54:32.048160 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046012 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 08:54:32.048160 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046014 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 08:54:32.048160 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046017 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 08:54:32.048160 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046021 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 08:54:32.048160 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046023 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 08:54:32.048160 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046026 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 08:54:32.048160 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046028 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 08:54:32.048160 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046031 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 08:54:32.048160 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046034 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 08:54:32.048160 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046036 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 08:54:32.048160 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046038 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 08:54:32.048160 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046041 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 08:54:32.048160 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046043 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 08:54:32.048160 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046045 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 08:54:32.048160 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046048 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 08:54:32.048160 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046050 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 08:54:32.048160 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046053 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 08:54:32.048160 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046055 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 08:54:32.048160 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046057 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 08:54:32.048657 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046060 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 08:54:32.048657 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046062 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 08:54:32.048657 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046064 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 08:54:32.048657 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046067 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 08:54:32.048657 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046069 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 08:54:32.048657 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046072 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 08:54:32.048657 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046074 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 08:54:32.048657 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046077 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 08:54:32.048657 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046079 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 08:54:32.048657 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046082 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 08:54:32.048657 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046084 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 08:54:32.048657 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046087 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 08:54:32.048657 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046089 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 08:54:32.048657 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046091 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 08:54:32.048657 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046094 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 08:54:32.048657 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046097 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 08:54:32.048657 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046099 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 08:54:32.048657 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046103 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 08:54:32.048657 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046105 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 08:54:32.048657 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046108 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 08:54:32.049140 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046111 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 08:54:32.049140 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046113 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 08:54:32.049140 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046116 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 08:54:32.049140 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046118 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 08:54:32.049140 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046121 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 08:54:32.049140 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046123 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 08:54:32.049140 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046126 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 08:54:32.049140 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046128 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 08:54:32.049140 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046131 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 08:54:32.049140 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046133 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 08:54:32.049140 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046137 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 08:54:32.049140 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046141 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 08:54:32.049140 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046143 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 08:54:32.049140 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046147 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 08:54:32.049140 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046151 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 08:54:32.049140 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046154 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 08:54:32.049140 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046157 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 08:54:32.049140 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046160 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 08:54:32.049597 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046163 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 08:54:32.049597 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046166 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 08:54:32.049597 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046169 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 08:54:32.049597 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046171 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 08:54:32.049597 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046174 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 08:54:32.049597 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046177 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 08:54:32.049597 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046180 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 08:54:32.049597 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046182 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 08:54:32.049597 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046185 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 08:54:32.049597 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046188 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 08:54:32.049597 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046191 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 08:54:32.049597 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046194 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 08:54:32.049597 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046200 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 08:54:32.049597 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046203 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 08:54:32.049597 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046205 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 08:54:32.049597 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046208 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 08:54:32.049981 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.046213 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 08:54:32.049981 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046357 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 08:54:32.049981 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046363 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 08:54:32.049981 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046368 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 08:54:32.049981 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046371 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 08:54:32.049981 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046374 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 08:54:32.049981 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046378 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 08:54:32.049981 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046381 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 08:54:32.049981 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046383 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 08:54:32.049981 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046386 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 08:54:32.049981 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046389 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 08:54:32.049981 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046392 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 08:54:32.049981 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046407 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 08:54:32.049981 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046410 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 08:54:32.049981 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046413 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 08:54:32.050353 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046415 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 08:54:32.050353 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046418 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 08:54:32.050353 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046420 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 08:54:32.050353 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046422 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 08:54:32.050353 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046425 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 08:54:32.050353 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046427 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 08:54:32.050353 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046429 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 08:54:32.050353 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046432 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 08:54:32.050353 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046434 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 08:54:32.050353 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046437 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 08:54:32.050353 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046439 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 08:54:32.050353 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046442 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 08:54:32.050353 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046445 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 08:54:32.050353 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046447 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 08:54:32.050353 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046451 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 08:54:32.050353 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046453 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 08:54:32.050353 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046455 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 08:54:32.050353 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046458 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 08:54:32.050353 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046460 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 08:54:32.050353 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046463 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 08:54:32.050838 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046465 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 08:54:32.050838 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046486 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 08:54:32.050838 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046490 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 08:54:32.050838 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046492 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 08:54:32.050838 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046496 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 08:54:32.050838 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046499 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 08:54:32.050838 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046502 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 08:54:32.050838 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046506 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 08:54:32.050838 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046508 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 08:54:32.050838 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046510 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 08:54:32.050838 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046513 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 08:54:32.050838 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046515 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 08:54:32.050838 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046517 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 08:54:32.050838 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046520 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 08:54:32.050838 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046522 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 08:54:32.050838 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046525 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 08:54:32.050838 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046527 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 08:54:32.050838 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046530 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 08:54:32.050838 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046532 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 08:54:32.051267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046535 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 08:54:32.051267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046538 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 08:54:32.051267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046541 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 08:54:32.051267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046544 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 08:54:32.051267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046548 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 08:54:32.051267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046551 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 08:54:32.051267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046553 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 08:54:32.051267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046556 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 08:54:32.051267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046558 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 08:54:32.051267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046561 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 08:54:32.051267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046564 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 08:54:32.051267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046566 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 08:54:32.051267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046568 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 08:54:32.051267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046571 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 08:54:32.051267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046573 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 08:54:32.051267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046576 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 08:54:32.051267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046578 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 08:54:32.051267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046580 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 08:54:32.051267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046582 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 08:54:32.051267 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046585 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 08:54:32.051837 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046587 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 08:54:32.051837 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046589 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 16 08:54:32.051837 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046592 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 08:54:32.051837 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046594 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 08:54:32.051837 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046596 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 08:54:32.051837 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046599 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 08:54:32.051837 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046601 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 08:54:32.051837 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046603 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 08:54:32.051837 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046605 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 08:54:32.051837 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046608 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 08:54:32.051837 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046610 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 08:54:32.051837 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046612 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 08:54:32.051837 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046614 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 08:54:32.051837 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046617 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 08:54:32.051837 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046619 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 08:54:32.051837 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046621 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 08:54:32.051837 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046624 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 08:54:32.051837 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046627 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 08:54:32.051837 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046629 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 08:54:32.052288 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046631 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 08:54:32.052288 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046633 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 08:54:32.052288 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046636 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 08:54:32.052288 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046639 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 08:54:32.052288 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046641 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 08:54:32.052288 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046643 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 08:54:32.052288 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:32.046645 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 08:54:32.052288 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.046650 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 08:54:32.052288 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.050016 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 08:54:32.052517 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.052363 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 08:54:32.054339 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.054327 2559 server.go:1019] "Starting client certificate rotation" Jul 16 08:54:32.054439 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.054423 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 08:54:32.054481 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.054463 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 08:54:32.057521 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.057508 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 08:54:32.062436 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.062418 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 08:54:32.076312 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.076292 2559 log.go:25] "Validated CRI v1 runtime API" Jul 16 08:54:32.078626 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.078611 2559 log.go:25] "Validated CRI v1 image API" Jul 16 08:54:32.079486 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.079458 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 08:54:32.082029 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.082011 2559 fs.go:135] Filesystem UUIDs: map[2b59242c-5644-4c22-9c48-5a44cb9c06e7:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f36a6d98-aa43-4c32-a8a9-722d06bcff77:/dev/nvme0n1p3] Jul 16 08:54:32.082076 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.082029 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 08:54:32.085695 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.085679 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 08:54:32.088707 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.088597 2559 manager.go:216] Machine: {Timestamp:2026-07-16 08:54:32.086239974 +0000 UTC m=+0.375690225 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3174429 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29feb806c4d98f739be41c25f17c81 SystemUUID:ec29feb8-06c4-d98f-739b-e41c25f17c81 BootID:f35a9aa5-bfaf-44a6-adf2-ac159fb8f14a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fb:16:73:2b:61 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fb:16:73:2b:61 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:dd:d4:99:e6:38 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 08:54:32.088707 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.088700 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 08:54:32.088831 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.088766 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 08:54:32.092256 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.092235 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 08:54:32.092381 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.092261 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-31.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 08:54:32.093141 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.093131 2559 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 08:54:32.093170 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.093143 2559 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 08:54:32.093170 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.093150 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 08:54:32.094009 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.093998 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 08:54:32.095884 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.095874 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 08:54:32.099758 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.099747 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 16 08:54:32.099865 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.099856 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 08:54:32.099907 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.099884 2559 kubelet.go:486] "Attempting to sync node with API server" Jul 16 08:54:32.099907 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.099893 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 08:54:32.099907 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.099903 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 08:54:32.100004 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.099911 2559 kubelet.go:398] "Adding apiserver pod source" Jul 16 08:54:32.100004 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.099920 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 08:54:32.100342 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.100323 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 08:54:32.100395 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.100358 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 08:54:32.103953 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.103922 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 08:54:32.106571 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.106557 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 08:54:32.106637 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.106587 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 08:54:32.106749 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.106739 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 08:54:32.106822 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.106755 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 08:54:32.106822 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.106762 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 08:54:32.106822 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.106768 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 08:54:32.106822 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.106777 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 08:54:32.106822 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.106783 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 08:54:32.107447 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.107438 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 08:54:32.107493 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.107448 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 08:54:32.107493 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.107456 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 08:54:32.107493 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.107463 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 08:54:32.107493 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.107484 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 08:54:32.107493 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.107493 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 08:54:32.108454 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.108442 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 08:54:32.108454 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.108452 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 08:54:32.110763 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.110744 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-31.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 16 08:54:32.111227 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:32.111204 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 16 08:54:32.111271 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:32.111204 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-31.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 16 08:54:32.112092 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.112079 2559 server.go:1268] "Started kubelet" Jul 16 08:54:32.112170 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.112146 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 08:54:32.112232 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.112150 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 08:54:32.112292 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.112254 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 08:54:32.113021 ip-10-0-140-31 systemd[1]: Started Kubernetes Kubelet. Jul 16 08:54:32.113907 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.113887 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 08:54:32.114173 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.114154 2559 server.go:310] "Adding debug handlers to kubelet server" Jul 16 08:54:32.117648 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:32.117629 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 08:54:32.119796 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:32.118557 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-31.ec2.internal.18c2b93c8d4e9518 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-31.ec2.internal,UID:ip-10-0-140-31.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-31.ec2.internal,},FirstTimestamp:2026-07-16 08:54:32.11205148 +0000 UTC m=+0.401501731,LastTimestamp:2026-07-16 08:54:32.11205148 +0000 UTC m=+0.401501731,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-31.ec2.internal,}" Jul 16 08:54:32.121675 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.121661 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 08:54:32.121734 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.121677 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 08:54:32.121734 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:32.121723 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-31.ec2.internal\" not found" Jul 16 08:54:32.122362 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.122346 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 08:54:32.122447 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.122419 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 08:54:32.122518 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.122453 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 08:54:32.122577 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.122542 2559 reconstruct.go:97] "Volume reconstruction finished" Jul 16 08:54:32.122577 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.122552 2559 reconciler.go:29] "Reconciler: start to sync state" Jul 16 08:54:32.123255 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.123242 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 08:54:32.123297 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.123257 2559 factory.go:55] Registering systemd factory Jul 16 08:54:32.123297 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.123263 2559 factory.go:223] Registration of the systemd container factory successfully Jul 16 08:54:32.123496 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.123465 2559 factory.go:153] Registering CRI-O factory Jul 16 08:54:32.123535 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.123500 2559 factory.go:223] Registration of the crio container factory successfully Jul 16 08:54:32.123535 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.123524 2559 factory.go:103] Registering Raw factory Jul 16 08:54:32.123665 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.123537 2559 manager.go:1196] Started watching for new ooms in manager Jul 16 08:54:32.123921 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.123907 2559 manager.go:349] Starting recovery of all containers Jul 16 08:54:32.124675 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:32.124635 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-31.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 16 08:54:32.124751 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:32.124696 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 16 08:54:32.134861 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.134762 2559 manager.go:354] Recovery completed Jul 16 08:54:32.136890 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:32.136854 2559 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 16 08:54:32.137441 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.137422 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g4rbr" Jul 16 08:54:32.139931 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.139917 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 08:54:32.141679 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.141664 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-31.ec2.internal" event="NodeHasSufficientMemory" Jul 16 08:54:32.141739 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.141700 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 08:54:32.141739 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.141716 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-31.ec2.internal" event="NodeHasSufficientPID" Jul 16 08:54:32.142209 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.142197 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 08:54:32.142209 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.142205 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 08:54:32.142297 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.142207 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 08:54:32.142297 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.142237 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 16 08:54:32.142848 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.142833 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-31.ec2.internal" event="NodeHasSufficientMemory" Jul 16 08:54:32.142891 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.142859 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 08:54:32.142891 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.142863 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g4rbr" Jul 16 08:54:32.142891 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.142870 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-31.ec2.internal" event="NodeHasSufficientPID" Jul 16 08:54:32.143432 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.143421 2559 policy_none.go:49] "None policy: Start" Jul 16 08:54:32.143487 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.143435 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 08:54:32.143487 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.143446 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 08:54:32.143818 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:32.143763 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-31.ec2.internal.18c2b93c8f12b3ef default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-31.ec2.internal,UID:ip-10-0-140-31.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-31.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-31.ec2.internal,},FirstTimestamp:2026-07-16 08:54:32.141681647 +0000 UTC m=+0.431131907,LastTimestamp:2026-07-16 08:54:32.141681647 +0000 UTC m=+0.431131907,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-31.ec2.internal,}" Jul 16 08:54:32.144391 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.144380 2559 policy_none.go:47] "Start" Jul 16 08:54:32.176112 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.176098 2559 manager.go:337] "Starting Device Plugin manager" Jul 16 08:54:32.176232 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:32.176125 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 08:54:32.176232 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.176133 2559 server.go:87] "Starting device plugin registration server" Jul 16 08:54:32.176431 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.176336 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 08:54:32.176431 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.176352 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 08:54:32.176431 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.176413 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 08:54:32.176618 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.176520 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 08:54:32.176618 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.176543 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 08:54:32.177070 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:32.177048 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 08:54:32.177158 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:32.177104 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-31.ec2.internal\" not found" Jul 16 08:54:32.235754 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.235731 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 08:54:32.236985 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.236965 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 08:54:32.237073 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.237005 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 08:54:32.237073 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.237028 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 08:54:32.237236 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:32.237066 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 08:54:32.239405 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.239384 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 08:54:32.277253 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.277206 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 08:54:32.278043 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.278030 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-31.ec2.internal" event="NodeHasSufficientMemory" Jul 16 08:54:32.278111 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.278054 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 08:54:32.278111 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.278066 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-31.ec2.internal" event="NodeHasSufficientPID" Jul 16 08:54:32.278111 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.278093 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-31.ec2.internal" Jul 16 08:54:32.288204 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.288185 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-31.ec2.internal" Jul 16 08:54:32.288248 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:32.288209 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-31.ec2.internal\": node \"ip-10-0-140-31.ec2.internal\" not found" Jul 16 08:54:32.310295 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:32.310279 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-31.ec2.internal\" not found" Jul 16 08:54:32.337982 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.337964 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-31.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-31.ec2.internal"] Jul 16 08:54:32.338027 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.338016 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 08:54:32.338679 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.338665 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-31.ec2.internal" event="NodeHasSufficientMemory" Jul 16 08:54:32.338736 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.338687 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 08:54:32.338736 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.338696 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-31.ec2.internal" event="NodeHasSufficientPID" Jul 16 08:54:32.339928 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.339916 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 08:54:32.340045 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.340034 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-31.ec2.internal" Jul 16 08:54:32.340080 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.340061 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 08:54:32.340517 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.340503 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-31.ec2.internal" event="NodeHasSufficientMemory" Jul 16 08:54:32.340580 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.340530 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 08:54:32.340580 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.340541 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-31.ec2.internal" event="NodeHasSufficientPID" Jul 16 08:54:32.340580 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.340510 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-31.ec2.internal" event="NodeHasSufficientMemory" Jul 16 08:54:32.340662 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.340590 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 08:54:32.340662 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.340600 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-31.ec2.internal" event="NodeHasSufficientPID" Jul 16 08:54:32.341709 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.341694 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-31.ec2.internal" Jul 16 08:54:32.341771 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.341723 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 08:54:32.342298 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.342281 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-31.ec2.internal" event="NodeHasSufficientMemory" Jul 16 08:54:32.342372 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.342305 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-31.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 08:54:32.342372 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.342315 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-31.ec2.internal" event="NodeHasSufficientPID" Jul 16 08:54:32.369986 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:32.369964 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-31.ec2.internal\" not found" node="ip-10-0-140-31.ec2.internal" Jul 16 08:54:32.377737 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:32.377723 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-31.ec2.internal\" not found" node="ip-10-0-140-31.ec2.internal" Jul 16 08:54:32.411220 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:32.411201 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-31.ec2.internal\" not found" Jul 16 08:54:32.424895 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.424880 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5009e491d0a04275defe06b16b9f3398-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-31.ec2.internal\" (UID: \"5009e491d0a04275defe06b16b9f3398\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-31.ec2.internal" Jul 16 08:54:32.425319 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.425305 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5009e491d0a04275defe06b16b9f3398-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-31.ec2.internal\" (UID: \"5009e491d0a04275defe06b16b9f3398\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-31.ec2.internal" Jul 16 08:54:32.425363 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.425326 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fb396c0835f4deca175bfbe7b025b3ae-config\") pod \"kube-apiserver-proxy-ip-10-0-140-31.ec2.internal\" (UID: \"fb396c0835f4deca175bfbe7b025b3ae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-31.ec2.internal" Jul 16 08:54:32.512028 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:32.512009 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-31.ec2.internal\" not found" Jul 16 08:54:32.526395 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.526377 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fb396c0835f4deca175bfbe7b025b3ae-config\") pod \"kube-apiserver-proxy-ip-10-0-140-31.ec2.internal\" (UID: \"fb396c0835f4deca175bfbe7b025b3ae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-31.ec2.internal" Jul 16 08:54:32.526446 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.526399 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5009e491d0a04275defe06b16b9f3398-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-31.ec2.internal\" (UID: \"5009e491d0a04275defe06b16b9f3398\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-31.ec2.internal" Jul 16 08:54:32.526446 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.526415 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5009e491d0a04275defe06b16b9f3398-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-31.ec2.internal\" (UID: \"5009e491d0a04275defe06b16b9f3398\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-31.ec2.internal" Jul 16 08:54:32.526446 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.526437 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5009e491d0a04275defe06b16b9f3398-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-31.ec2.internal\" (UID: \"5009e491d0a04275defe06b16b9f3398\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-31.ec2.internal" Jul 16 08:54:32.526588 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.526504 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fb396c0835f4deca175bfbe7b025b3ae-config\") pod \"kube-apiserver-proxy-ip-10-0-140-31.ec2.internal\" (UID: \"fb396c0835f4deca175bfbe7b025b3ae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-31.ec2.internal" Jul 16 08:54:32.526588 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.526508 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5009e491d0a04275defe06b16b9f3398-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-31.ec2.internal\" (UID: \"5009e491d0a04275defe06b16b9f3398\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-31.ec2.internal" Jul 16 08:54:32.612794 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:32.612747 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-31.ec2.internal\" not found" Jul 16 08:54:32.672251 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.672229 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-31.ec2.internal" Jul 16 08:54:32.681760 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:32.681741 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-31.ec2.internal" Jul 16 08:54:32.713837 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:32.713815 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-31.ec2.internal\" not found" Jul 16 08:54:32.814386 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:32.814349 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-31.ec2.internal\" not found" Jul 16 08:54:32.914890 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:32.914828 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-31.ec2.internal\" not found" Jul 16 08:54:33.015376 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:33.015353 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-31.ec2.internal\" not found" Jul 16 08:54:33.052840 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:33.052817 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 08:54:33.053410 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:33.052955 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 08:54:33.115942 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:33.115926 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-31.ec2.internal\" not found" Jul 16 08:54:33.146355 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:33.146324 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 08:49:32 +0000 UTC" deadline="2027-12-29 17:50:45.16289989 +0000 UTC" Jul 16 08:54:33.146355 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:33.146352 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12752h56m12.016551148s" Jul 16 08:54:33.157228 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:33.157206 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 08:54:33.195019 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:33.194997 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb396c0835f4deca175bfbe7b025b3ae.slice/crio-4a8e6da93bdce64e7aabfdc00ab3336477a07e088da0ffdc97d8d782be73a749 WatchSource:0}: Error finding container 4a8e6da93bdce64e7aabfdc00ab3336477a07e088da0ffdc97d8d782be73a749: Status 404 returned error can't find the container with id 4a8e6da93bdce64e7aabfdc00ab3336477a07e088da0ffdc97d8d782be73a749 Jul 16 08:54:33.199427 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:33.199408 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 08:54:33.216499 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:33.216452 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-31.ec2.internal\" not found" Jul 16 08:54:33.229628 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:33.229607 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5009e491d0a04275defe06b16b9f3398.slice/crio-7a13229785dfad1144ab7d2ed9f073b5e57a066e6ee80be69a353a1ad118798d WatchSource:0}: Error finding container 7a13229785dfad1144ab7d2ed9f073b5e57a066e6ee80be69a353a1ad118798d: Status 404 returned error can't find the container with id 7a13229785dfad1144ab7d2ed9f073b5e57a066e6ee80be69a353a1ad118798d Jul 16 08:54:33.243538 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:33.243502 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-31.ec2.internal" event={"ID":"5009e491d0a04275defe06b16b9f3398","Type":"ContainerStarted","Data":"7a13229785dfad1144ab7d2ed9f073b5e57a066e6ee80be69a353a1ad118798d"} Jul 16 08:54:33.244657 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:33.244637 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-31.ec2.internal" event={"ID":"fb396c0835f4deca175bfbe7b025b3ae","Type":"ContainerStarted","Data":"4a8e6da93bdce64e7aabfdc00ab3336477a07e088da0ffdc97d8d782be73a749"} Jul 16 08:54:33.316883 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:33.316863 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-31.ec2.internal\" not found" Jul 16 08:54:33.417400 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:33.417376 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-31.ec2.internal\" not found" Jul 16 08:54:33.515131 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:33.515068 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 08:54:33.518069 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:33.518055 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-31.ec2.internal\" not found" Jul 16 08:54:33.574317 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:33.574295 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 08:54:33.622484 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:33.622456 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-31.ec2.internal" Jul 16 08:54:33.636183 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:33.636166 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 08:54:33.636937 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:33.636925 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-31.ec2.internal" Jul 16 08:54:33.645812 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:33.645798 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 08:54:33.955513 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:33.955468 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 08:54:34.100385 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.100354 2559 apiserver.go:52] "Watching apiserver" Jul 16 08:54:34.111403 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.111366 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 08:54:34.111815 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.111787 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-czllj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w","openshift-dns/node-resolver-46vpz","openshift-image-registry/node-ca-bmrd2","openshift-network-diagnostics/network-check-target-6z2sg","openshift-network-operator/iptables-alerter-npjnt","openshift-ovn-kubernetes/ovnkube-node-sb2b7","kube-system/global-pull-secret-syncer-m448k","kube-system/konnectivity-agent-ktm4b","kube-system/kube-apiserver-proxy-ip-10-0-140-31.ec2.internal","openshift-cluster-node-tuning-operator/tuned-lcn9c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-31.ec2.internal","openshift-multus/multus-additional-cni-plugins-x7tqv","openshift-multus/multus-x8qvw"] Jul 16 08:54:34.113801 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.113781 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.115449 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.115147 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.116467 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.116448 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-46vpz" Jul 16 08:54:34.117184 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.117168 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 08:54:34.117326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.117304 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 08:54:34.117388 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.117309 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 08:54:34.117388 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.117368 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 08:54:34.117458 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.117309 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 08:54:34.117777 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.117751 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bmrd2" Jul 16 08:54:34.117949 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.117930 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 08:54:34.118231 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.118210 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 08:54:34.118327 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.118255 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 08:54:34.118327 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.118298 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-msdnz\"" Jul 16 08:54:34.118327 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.118308 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 08:54:34.118609 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.118591 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 08:54:34.118707 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.118672 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 08:54:34.118773 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.118750 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v5qpc\"" Jul 16 08:54:34.118978 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.118959 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 08:54:34.119070 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.119054 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:54:34.119147 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:34.119122 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2sg" podUID="9bf029e2-2742-493c-b99a-dc4660744827" Jul 16 08:54:34.121175 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.120325 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-npjnt" Jul 16 08:54:34.121175 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.120396 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 08:54:34.121175 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.120624 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 08:54:34.121175 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.120844 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 08:54:34.121175 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.120885 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m5hqm\"" Jul 16 08:54:34.121175 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.120930 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 08:54:34.121175 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.121050 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kdsms\"" Jul 16 08:54:34.122439 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.122420 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 08:54:34.123090 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.122794 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 08:54:34.123152 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.123098 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-72l49\"" Jul 16 08:54:34.123209 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.123171 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 08:54:34.123417 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.123400 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 08:54:34.124013 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.123984 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ktm4b" Jul 16 08:54:34.125250 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.125232 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:54:34.125362 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:34.125300 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czllj" podUID="7589804c-eb08-481e-a23c-431f53d6e559" Jul 16 08:54:34.126444 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.126426 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 08:54:34.126551 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.126531 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zw8jd\"" Jul 16 08:54:34.126675 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.126639 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 08:54:34.126946 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.126930 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" Jul 16 08:54:34.130320 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.129414 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 08:54:34.130320 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.129506 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.130320 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.129979 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 08:54:34.130320 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.130021 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pqvpg\"" Jul 16 08:54:34.130320 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.130207 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 08:54:34.132442 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.132423 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5k9zn\"" Jul 16 08:54:34.132597 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.132577 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 08:54:34.133908 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.133888 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.135058 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135037 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdd96\" (UniqueName: \"kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96\") pod \"network-check-target-6z2sg\" (UID: \"9bf029e2-2742-493c-b99a-dc4660744827\") " pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:54:34.135168 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135068 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.135168 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135089 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:34.135168 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135095 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/896dc882-3406-4b26-ba10-9f9d47ae9e3a-host-slash\") pod \"iptables-alerter-npjnt\" (UID: \"896dc882-3406-4b26-ba10-9f9d47ae9e3a\") " pod="openshift-network-operator/iptables-alerter-npjnt" Jul 16 08:54:34.135168 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135121 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-os-release\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.135168 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135138 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-host-kubelet\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.135168 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:34.135145 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m448k" podUID="d5a0fba0-4c13-4592-a836-4f1f9d20c663" Jul 16 08:54:34.135168 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135152 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4aa01755-587c-4e81-bf62-974df0ddbf82-ovn-node-metrics-cert\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.135546 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135196 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca239b38-b1b7-410e-9ef2-2de2ea8c432f-host\") pod \"node-ca-bmrd2\" (UID: \"ca239b38-b1b7-410e-9ef2-2de2ea8c432f\") " pod="openshift-image-registry/node-ca-bmrd2" Jul 16 08:54:34.135546 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135263 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/896dc882-3406-4b26-ba10-9f9d47ae9e3a-iptables-alerter-script\") pod \"iptables-alerter-npjnt\" (UID: \"896dc882-3406-4b26-ba10-9f9d47ae9e3a\") " pod="openshift-network-operator/iptables-alerter-npjnt" Jul 16 08:54:34.135546 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135292 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-run-openvswitch\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.135546 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135322 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.135546 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135347 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-systemd-units\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.135546 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135372 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-run-systemd\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.135546 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135396 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-var-lib-openvswitch\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.135546 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135422 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.135546 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135447 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbvj7\" (UniqueName: \"kubernetes.io/projected/ca239b38-b1b7-410e-9ef2-2de2ea8c432f-kube-api-access-qbvj7\") pod \"node-ca-bmrd2\" (UID: \"ca239b38-b1b7-410e-9ef2-2de2ea8c432f\") " pod="openshift-image-registry/node-ca-bmrd2" Jul 16 08:54:34.135546 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135472 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-host-slash\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.135546 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135520 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-host-cni-bin\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.136068 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135553 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4aa01755-587c-4e81-bf62-974df0ddbf82-ovnkube-config\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.136068 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135580 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2eb4d12-f3cb-47eb-8b13-12c907658c4e-tmp-dir\") pod \"node-resolver-46vpz\" (UID: \"b2eb4d12-f3cb-47eb-8b13-12c907658c4e\") " pod="openshift-dns/node-resolver-46vpz" Jul 16 08:54:34.136068 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135618 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7-agent-certs\") pod \"konnectivity-agent-ktm4b\" (UID: \"81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7\") " pod="kube-system/konnectivity-agent-ktm4b" Jul 16 08:54:34.136068 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135696 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-cnibin\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.136068 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135739 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-host-run-netns\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.136068 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135764 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-run-ovn\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.136068 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135809 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-log-socket\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.136068 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135838 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 08:54:34.136068 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135841 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-host-cni-netd\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.136068 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz4h4\" (UniqueName: \"kubernetes.io/projected/b2eb4d12-f3cb-47eb-8b13-12c907658c4e-kube-api-access-xz4h4\") pod \"node-resolver-46vpz\" (UID: \"b2eb4d12-f3cb-47eb-8b13-12c907658c4e\") " pod="openshift-dns/node-resolver-46vpz" Jul 16 08:54:34.136068 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135924 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-cni-binary-copy\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.136068 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135948 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7-konnectivity-ca\") pod \"konnectivity-agent-ktm4b\" (UID: \"81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7\") " pod="kube-system/konnectivity-agent-ktm4b" Jul 16 08:54:34.136068 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.135984 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-node-log\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.136068 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.136017 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs8xh\" (UniqueName: \"kubernetes.io/projected/896dc882-3406-4b26-ba10-9f9d47ae9e3a-kube-api-access-bs8xh\") pod \"iptables-alerter-npjnt\" (UID: \"896dc882-3406-4b26-ba10-9f9d47ae9e3a\") " pod="openshift-network-operator/iptables-alerter-npjnt" Jul 16 08:54:34.136751 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.136119 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-system-cni-dir\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.136751 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.136153 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.136751 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.136176 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4aa01755-587c-4e81-bf62-974df0ddbf82-env-overrides\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.136751 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.136192 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4aa01755-587c-4e81-bf62-974df0ddbf82-ovnkube-script-lib\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.136751 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.136206 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b2eb4d12-f3cb-47eb-8b13-12c907658c4e-hosts-file\") pod \"node-resolver-46vpz\" (UID: \"b2eb4d12-f3cb-47eb-8b13-12c907658c4e\") " pod="openshift-dns/node-resolver-46vpz" Jul 16 08:54:34.136751 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.136223 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpnhw\" (UniqueName: \"kubernetes.io/projected/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-kube-api-access-vpnhw\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.136751 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.136264 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-etc-openvswitch\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.136751 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.136292 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 08:54:34.136751 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.136297 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-host-run-ovn-kubernetes\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.136751 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.136325 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5996r\" (UniqueName: \"kubernetes.io/projected/4aa01755-587c-4e81-bf62-974df0ddbf82-kube-api-access-5996r\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.136751 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.136351 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ca239b38-b1b7-410e-9ef2-2de2ea8c432f-serviceca\") pod \"node-ca-bmrd2\" (UID: \"ca239b38-b1b7-410e-9ef2-2de2ea8c432f\") " pod="openshift-image-registry/node-ca-bmrd2" Jul 16 08:54:34.136751 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.136470 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 08:54:34.136751 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.136554 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jfcl2\"" Jul 16 08:54:34.224170 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.224144 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 08:54:34.237132 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237105 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-system-cni-dir\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.237286 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237141 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4aa01755-587c-4e81-bf62-974df0ddbf82-env-overrides\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.237286 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237171 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4aa01755-587c-4e81-bf62-974df0ddbf82-ovnkube-script-lib\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.237286 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237196 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b2eb4d12-f3cb-47eb-8b13-12c907658c4e-hosts-file\") pod \"node-resolver-46vpz\" (UID: \"b2eb4d12-f3cb-47eb-8b13-12c907658c4e\") " pod="openshift-dns/node-resolver-46vpz" Jul 16 08:54:34.237286 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237215 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-system-cni-dir\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.237286 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237223 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-multus-cni-dir\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.237286 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237276 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-os-release\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.237674 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237293 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-etc-kubernetes\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.237674 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237314 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-etc-openvswitch\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.237674 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237331 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-host-run-ovn-kubernetes\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.237674 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237348 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs\") pod \"network-metrics-daemon-czllj\" (UID: \"7589804c-eb08-481e-a23c-431f53d6e559\") " pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:54:34.237674 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237369 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b2eb4d12-f3cb-47eb-8b13-12c907658c4e-hosts-file\") pod \"node-resolver-46vpz\" (UID: \"b2eb4d12-f3cb-47eb-8b13-12c907658c4e\") " pod="openshift-dns/node-resolver-46vpz" Jul 16 08:54:34.237674 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237373 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-multus-socket-dir-parent\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.237674 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237398 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.237674 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237416 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/896dc882-3406-4b26-ba10-9f9d47ae9e3a-host-slash\") pod \"iptables-alerter-npjnt\" (UID: \"896dc882-3406-4b26-ba10-9f9d47ae9e3a\") " pod="openshift-network-operator/iptables-alerter-npjnt" Jul 16 08:54:34.237674 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237431 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5a0fba0-4c13-4592-a836-4f1f9d20c663-dbus\") pod \"global-pull-secret-syncer-m448k\" (UID: \"d5a0fba0-4c13-4592-a836-4f1f9d20c663\") " pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:34.237674 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237447 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-hostroot\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.237674 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237462 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-os-release\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.237674 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237478 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-host-kubelet\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.237674 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237492 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca239b38-b1b7-410e-9ef2-2de2ea8c432f-host\") pod \"node-ca-bmrd2\" (UID: \"ca239b38-b1b7-410e-9ef2-2de2ea8c432f\") " pod="openshift-image-registry/node-ca-bmrd2" Jul 16 08:54:34.237674 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237527 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-host-var-lib-cni-bin\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.237674 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237553 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-host-var-lib-kubelet\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.237674 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237579 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-multus-conf-dir\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.237674 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237616 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-etc-sysconfig\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.238626 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237640 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-run-openvswitch\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.238626 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237657 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-run-systemd\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.238626 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237673 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.238626 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237719 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbvj7\" (UniqueName: \"kubernetes.io/projected/ca239b38-b1b7-410e-9ef2-2de2ea8c432f-kube-api-access-qbvj7\") pod \"node-ca-bmrd2\" (UID: \"ca239b38-b1b7-410e-9ef2-2de2ea8c432f\") " pod="openshift-image-registry/node-ca-bmrd2" Jul 16 08:54:34.238626 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237742 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f48acdda-801c-4b05-b8e1-573f6195e999-kubelet-dir\") pod \"aws-ebs-csi-driver-node-crl8w\" (UID: \"f48acdda-801c-4b05-b8e1-573f6195e999\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" Jul 16 08:54:34.238626 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237770 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f48acdda-801c-4b05-b8e1-573f6195e999-etc-selinux\") pod \"aws-ebs-csi-driver-node-crl8w\" (UID: \"f48acdda-801c-4b05-b8e1-573f6195e999\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" Jul 16 08:54:34.238626 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237795 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-var-lib-kubelet\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.238626 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237820 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2eb4d12-f3cb-47eb-8b13-12c907658c4e-tmp-dir\") pod \"node-resolver-46vpz\" (UID: \"b2eb4d12-f3cb-47eb-8b13-12c907658c4e\") " pod="openshift-dns/node-resolver-46vpz" Jul 16 08:54:34.238626 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237847 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5a0fba0-4c13-4592-a836-4f1f9d20c663-kubelet-config\") pod \"global-pull-secret-syncer-m448k\" (UID: \"d5a0fba0-4c13-4592-a836-4f1f9d20c663\") " pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:34.238626 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237855 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4aa01755-587c-4e81-bf62-974df0ddbf82-env-overrides\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.238626 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237892 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-host-var-lib-cni-multus\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.238626 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237917 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-etc-modprobe-d\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.238626 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237949 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-cnibin\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.238626 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237972 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-etc-openvswitch\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.238626 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237981 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-run-ovn\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.238626 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.238011 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz4h4\" (UniqueName: \"kubernetes.io/projected/b2eb4d12-f3cb-47eb-8b13-12c907658c4e-kube-api-access-xz4h4\") pod \"node-resolver-46vpz\" (UID: \"b2eb4d12-f3cb-47eb-8b13-12c907658c4e\") " pod="openshift-dns/node-resolver-46vpz" Jul 16 08:54:34.238626 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.238037 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-run-ovn\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.239610 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.238080 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-host-run-ovn-kubernetes\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.239610 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.238258 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-os-release\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.239610 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.238319 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-run-openvswitch\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.239610 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.238361 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-run-systemd\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.239610 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.238408 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.239610 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.238522 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-cnibin\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.239610 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.238042 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-sys\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.239610 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.238735 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-host-run-netns\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.239610 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.238786 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7-konnectivity-ca\") pod \"konnectivity-agent-ktm4b\" (UID: \"81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7\") " pod="kube-system/konnectivity-agent-ktm4b" Jul 16 08:54:34.239610 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.238804 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2eb4d12-f3cb-47eb-8b13-12c907658c4e-tmp-dir\") pod \"node-resolver-46vpz\" (UID: \"b2eb4d12-f3cb-47eb-8b13-12c907658c4e\") " pod="openshift-dns/node-resolver-46vpz" Jul 16 08:54:34.239610 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.238814 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f48acdda-801c-4b05-b8e1-573f6195e999-device-dir\") pod \"aws-ebs-csi-driver-node-crl8w\" (UID: \"f48acdda-801c-4b05-b8e1-573f6195e999\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" Jul 16 08:54:34.239610 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.237918 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4aa01755-587c-4e81-bf62-974df0ddbf82-ovnkube-script-lib\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.239610 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.238848 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/896dc882-3406-4b26-ba10-9f9d47ae9e3a-host-slash\") pod \"iptables-alerter-npjnt\" (UID: \"896dc882-3406-4b26-ba10-9f9d47ae9e3a\") " pod="openshift-network-operator/iptables-alerter-npjnt" Jul 16 08:54:34.239610 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.238842 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mr2l\" (UniqueName: \"kubernetes.io/projected/f48acdda-801c-4b05-b8e1-573f6195e999-kube-api-access-8mr2l\") pod \"aws-ebs-csi-driver-node-crl8w\" (UID: \"f48acdda-801c-4b05-b8e1-573f6195e999\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" Jul 16 08:54:34.239610 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.238880 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca239b38-b1b7-410e-9ef2-2de2ea8c432f-host\") pod \"node-ca-bmrd2\" (UID: \"ca239b38-b1b7-410e-9ef2-2de2ea8c432f\") " pod="openshift-image-registry/node-ca-bmrd2" Jul 16 08:54:34.239610 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.238885 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-etc-sysctl-d\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.239610 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.238929 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-host-kubelet\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.240522 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.238974 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-etc-sysctl-conf\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.240522 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.238999 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-etc-systemd\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.240522 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239023 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93797f20-8cc3-4c41-8c40-af09de1f954d-tmp\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.240522 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239059 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.240522 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239134 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grdlj\" (UniqueName: \"kubernetes.io/projected/93797f20-8cc3-4c41-8c40-af09de1f954d-kube-api-access-grdlj\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.240522 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239174 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-system-cni-dir\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.240522 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239221 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-host-run-k8s-cni-cncf-io\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.240522 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239354 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7-konnectivity-ca\") pod \"konnectivity-agent-ktm4b\" (UID: \"81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7\") " pod="kube-system/konnectivity-agent-ktm4b" Jul 16 08:54:34.240522 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239390 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.240522 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239409 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0cbf6d91-52de-4250-9f07-dd1223a2e533-multus-daemon-config\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.240522 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239449 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpnhw\" (UniqueName: \"kubernetes.io/projected/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-kube-api-access-vpnhw\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.240522 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239484 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5996r\" (UniqueName: \"kubernetes.io/projected/4aa01755-587c-4e81-bf62-974df0ddbf82-kube-api-access-5996r\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.240522 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239579 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ca239b38-b1b7-410e-9ef2-2de2ea8c432f-serviceca\") pod \"node-ca-bmrd2\" (UID: \"ca239b38-b1b7-410e-9ef2-2de2ea8c432f\") " pod="openshift-image-registry/node-ca-bmrd2" Jul 16 08:54:34.240522 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239605 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdd96\" (UniqueName: \"kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96\") pod \"network-check-target-6z2sg\" (UID: \"9bf029e2-2742-493c-b99a-dc4660744827\") " pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:54:34.240522 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239633 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4aa01755-587c-4e81-bf62-974df0ddbf82-ovn-node-metrics-cert\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.240522 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239666 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/896dc882-3406-4b26-ba10-9f9d47ae9e3a-iptables-alerter-script\") pod \"iptables-alerter-npjnt\" (UID: \"896dc882-3406-4b26-ba10-9f9d47ae9e3a\") " pod="openshift-network-operator/iptables-alerter-npjnt" Jul 16 08:54:34.240522 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239700 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-host\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.241506 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239717 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93797f20-8cc3-4c41-8c40-af09de1f954d-etc-tuned\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.241506 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239747 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret\") pod \"global-pull-secret-syncer-m448k\" (UID: \"d5a0fba0-4c13-4592-a836-4f1f9d20c663\") " pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:34.241506 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239763 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-etc-kubernetes\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.241506 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239767 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.241506 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239780 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.241506 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239810 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-systemd-units\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.241506 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239827 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-var-lib-openvswitch\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.241506 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239859 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-host-slash\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.241506 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239878 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-host-cni-bin\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.241506 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239914 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4aa01755-587c-4e81-bf62-974df0ddbf82-ovnkube-config\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.241506 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.239981 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-var-lib-openvswitch\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.241506 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.240016 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f48acdda-801c-4b05-b8e1-573f6195e999-socket-dir\") pod \"aws-ebs-csi-driver-node-crl8w\" (UID: \"f48acdda-801c-4b05-b8e1-573f6195e999\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" Jul 16 08:54:34.241506 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.240047 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f48acdda-801c-4b05-b8e1-573f6195e999-registration-dir\") pod \"aws-ebs-csi-driver-node-crl8w\" (UID: \"f48acdda-801c-4b05-b8e1-573f6195e999\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" Jul 16 08:54:34.241506 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.240073 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-lib-modules\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.241506 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.240098 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-cnibin\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.241506 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.240152 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7-agent-certs\") pod \"konnectivity-agent-ktm4b\" (UID: \"81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7\") " pod="kube-system/konnectivity-agent-ktm4b" Jul 16 08:54:34.241506 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.240233 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-systemd-units\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.242394 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.240236 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-host-cni-bin\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.242394 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.240313 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-host-run-netns\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.242394 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.240323 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 08:54:34.242394 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.240347 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-log-socket\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.242394 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.240390 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-host-slash\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.242394 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.240394 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-log-socket\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.242394 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.240822 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.242394 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.240865 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-host-run-netns\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.242394 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.240957 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-host-cni-netd\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.242394 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.240994 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjhk6\" (UniqueName: \"kubernetes.io/projected/7589804c-eb08-481e-a23c-431f53d6e559-kube-api-access-bjhk6\") pod \"network-metrics-daemon-czllj\" (UID: \"7589804c-eb08-481e-a23c-431f53d6e559\") " pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:54:34.242394 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.241012 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/896dc882-3406-4b26-ba10-9f9d47ae9e3a-iptables-alerter-script\") pod \"iptables-alerter-npjnt\" (UID: \"896dc882-3406-4b26-ba10-9f9d47ae9e3a\") " pod="openshift-network-operator/iptables-alerter-npjnt" Jul 16 08:54:34.242394 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.241026 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f48acdda-801c-4b05-b8e1-573f6195e999-sys-fs\") pod \"aws-ebs-csi-driver-node-crl8w\" (UID: \"f48acdda-801c-4b05-b8e1-573f6195e999\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" Jul 16 08:54:34.242394 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.241062 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-host-cni-netd\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.242394 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.241304 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ca239b38-b1b7-410e-9ef2-2de2ea8c432f-serviceca\") pod \"node-ca-bmrd2\" (UID: \"ca239b38-b1b7-410e-9ef2-2de2ea8c432f\") " pod="openshift-image-registry/node-ca-bmrd2" Jul 16 08:54:34.242394 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.241357 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4aa01755-587c-4e81-bf62-974df0ddbf82-ovnkube-config\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.242394 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.241575 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-host-run-multus-certs\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.242394 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.241612 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-cni-binary-copy\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.243091 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.241680 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-node-log\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.243091 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.241734 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs8xh\" (UniqueName: \"kubernetes.io/projected/896dc882-3406-4b26-ba10-9f9d47ae9e3a-kube-api-access-bs8xh\") pod \"iptables-alerter-npjnt\" (UID: \"896dc882-3406-4b26-ba10-9f9d47ae9e3a\") " pod="openshift-network-operator/iptables-alerter-npjnt" Jul 16 08:54:34.243091 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.241775 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-run\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.243091 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.241807 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0cbf6d91-52de-4250-9f07-dd1223a2e533-cni-binary-copy\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.243091 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.241823 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qq8d\" (UniqueName: \"kubernetes.io/projected/0cbf6d91-52de-4250-9f07-dd1223a2e533-kube-api-access-6qq8d\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.243091 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.241903 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4aa01755-587c-4e81-bf62-974df0ddbf82-node-log\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.243091 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.242721 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-cni-binary-copy\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.247506 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:34.246863 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 08:54:34.247506 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:34.246888 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 08:54:34.247506 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:34.246902 2559 projected.go:196] Error preparing data for projected volume kube-api-access-hdd96 for pod openshift-network-diagnostics/network-check-target-6z2sg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 08:54:34.247506 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:34.246963 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96 podName:9bf029e2-2742-493c-b99a-dc4660744827 nodeName:}" failed. No retries permitted until 2026-07-16 08:54:34.746946579 +0000 UTC m=+3.036396842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hdd96" (UniqueName: "kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96") pod "network-check-target-6z2sg" (UID: "9bf029e2-2742-493c-b99a-dc4660744827") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 08:54:34.247506 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.247417 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4aa01755-587c-4e81-bf62-974df0ddbf82-ovn-node-metrics-cert\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.249618 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.248767 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpnhw\" (UniqueName: \"kubernetes.io/projected/b88636c3-8f04-4ea8-9753-bc53ee9e8aca-kube-api-access-vpnhw\") pod \"multus-additional-cni-plugins-x7tqv\" (UID: \"b88636c3-8f04-4ea8-9753-bc53ee9e8aca\") " pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.249618 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.248948 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbvj7\" (UniqueName: \"kubernetes.io/projected/ca239b38-b1b7-410e-9ef2-2de2ea8c432f-kube-api-access-qbvj7\") pod \"node-ca-bmrd2\" (UID: \"ca239b38-b1b7-410e-9ef2-2de2ea8c432f\") " pod="openshift-image-registry/node-ca-bmrd2" Jul 16 08:54:34.249618 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.248999 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz4h4\" (UniqueName: \"kubernetes.io/projected/b2eb4d12-f3cb-47eb-8b13-12c907658c4e-kube-api-access-xz4h4\") pod \"node-resolver-46vpz\" (UID: \"b2eb4d12-f3cb-47eb-8b13-12c907658c4e\") " pod="openshift-dns/node-resolver-46vpz" Jul 16 08:54:34.249618 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.249280 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7-agent-certs\") pod \"konnectivity-agent-ktm4b\" (UID: \"81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7\") " pod="kube-system/konnectivity-agent-ktm4b" Jul 16 08:54:34.249618 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.249445 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5996r\" (UniqueName: \"kubernetes.io/projected/4aa01755-587c-4e81-bf62-974df0ddbf82-kube-api-access-5996r\") pod \"ovnkube-node-sb2b7\" (UID: \"4aa01755-587c-4e81-bf62-974df0ddbf82\") " pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.250620 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.250601 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs8xh\" (UniqueName: \"kubernetes.io/projected/896dc882-3406-4b26-ba10-9f9d47ae9e3a-kube-api-access-bs8xh\") pod \"iptables-alerter-npjnt\" (UID: \"896dc882-3406-4b26-ba10-9f9d47ae9e3a\") " pod="openshift-network-operator/iptables-alerter-npjnt" Jul 16 08:54:34.278340 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.278289 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-r8wf5" Jul 16 08:54:34.286760 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.286740 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-r8wf5" Jul 16 08:54:34.342083 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342061 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-etc-kubernetes\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.342205 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342103 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f48acdda-801c-4b05-b8e1-573f6195e999-socket-dir\") pod \"aws-ebs-csi-driver-node-crl8w\" (UID: \"f48acdda-801c-4b05-b8e1-573f6195e999\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" Jul 16 08:54:34.342205 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342131 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f48acdda-801c-4b05-b8e1-573f6195e999-registration-dir\") pod \"aws-ebs-csi-driver-node-crl8w\" (UID: \"f48acdda-801c-4b05-b8e1-573f6195e999\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" Jul 16 08:54:34.342205 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342160 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-lib-modules\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.342205 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342185 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-cnibin\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.342412 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342217 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjhk6\" (UniqueName: \"kubernetes.io/projected/7589804c-eb08-481e-a23c-431f53d6e559-kube-api-access-bjhk6\") pod \"network-metrics-daemon-czllj\" (UID: \"7589804c-eb08-481e-a23c-431f53d6e559\") " pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:54:34.342412 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342223 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f48acdda-801c-4b05-b8e1-573f6195e999-registration-dir\") pod \"aws-ebs-csi-driver-node-crl8w\" (UID: \"f48acdda-801c-4b05-b8e1-573f6195e999\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" Jul 16 08:54:34.342412 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342242 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f48acdda-801c-4b05-b8e1-573f6195e999-sys-fs\") pod \"aws-ebs-csi-driver-node-crl8w\" (UID: \"f48acdda-801c-4b05-b8e1-573f6195e999\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" Jul 16 08:54:34.342412 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342268 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f48acdda-801c-4b05-b8e1-573f6195e999-socket-dir\") pod \"aws-ebs-csi-driver-node-crl8w\" (UID: \"f48acdda-801c-4b05-b8e1-573f6195e999\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" Jul 16 08:54:34.342412 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342280 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-host-run-multus-certs\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.342412 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342214 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-etc-kubernetes\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.342412 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342301 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f48acdda-801c-4b05-b8e1-573f6195e999-sys-fs\") pod \"aws-ebs-csi-driver-node-crl8w\" (UID: \"f48acdda-801c-4b05-b8e1-573f6195e999\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" Jul 16 08:54:34.342412 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342313 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-run\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.342412 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342341 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0cbf6d91-52de-4250-9f07-dd1223a2e533-cni-binary-copy\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.342412 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342347 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-host-run-multus-certs\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.342412 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342340 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-lib-modules\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.342412 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342378 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-run\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.342412 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342340 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-cnibin\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.342412 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342403 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qq8d\" (UniqueName: \"kubernetes.io/projected/0cbf6d91-52de-4250-9f07-dd1223a2e533-kube-api-access-6qq8d\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.343184 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342426 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-multus-cni-dir\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.343184 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342441 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-os-release\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.343184 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342463 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-etc-kubernetes\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.343184 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342522 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs\") pod \"network-metrics-daemon-czllj\" (UID: \"7589804c-eb08-481e-a23c-431f53d6e559\") " pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:54:34.343184 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342528 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-multus-cni-dir\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.343184 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342522 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-etc-kubernetes\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.343184 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342561 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-multus-socket-dir-parent\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.343184 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342577 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-os-release\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.343184 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342589 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5a0fba0-4c13-4592-a836-4f1f9d20c663-dbus\") pod \"global-pull-secret-syncer-m448k\" (UID: \"d5a0fba0-4c13-4592-a836-4f1f9d20c663\") " pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:34.343184 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:34.342616 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 08:54:34.343184 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342627 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-hostroot\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.343184 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342628 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-multus-socket-dir-parent\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.343184 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342653 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-hostroot\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.343184 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:34.342670 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs podName:7589804c-eb08-481e-a23c-431f53d6e559 nodeName:}" failed. No retries permitted until 2026-07-16 08:54:34.842652192 +0000 UTC m=+3.132102448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs") pod "network-metrics-daemon-czllj" (UID: "7589804c-eb08-481e-a23c-431f53d6e559") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 08:54:34.343184 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342688 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-host-var-lib-cni-bin\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.343184 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342696 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5a0fba0-4c13-4592-a836-4f1f9d20c663-dbus\") pod \"global-pull-secret-syncer-m448k\" (UID: \"d5a0fba0-4c13-4592-a836-4f1f9d20c663\") " pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:34.343184 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342704 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-host-var-lib-cni-bin\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.343184 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342715 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-host-var-lib-kubelet\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.344128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342737 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-multus-conf-dir\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.344128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342752 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-etc-sysconfig\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.344128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342772 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f48acdda-801c-4b05-b8e1-573f6195e999-kubelet-dir\") pod \"aws-ebs-csi-driver-node-crl8w\" (UID: \"f48acdda-801c-4b05-b8e1-573f6195e999\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" Jul 16 08:54:34.344128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342817 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f48acdda-801c-4b05-b8e1-573f6195e999-etc-selinux\") pod \"aws-ebs-csi-driver-node-crl8w\" (UID: \"f48acdda-801c-4b05-b8e1-573f6195e999\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" Jul 16 08:54:34.344128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342829 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-etc-sysconfig\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.344128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342828 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-multus-conf-dir\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.344128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342842 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-var-lib-kubelet\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.344128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342864 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0cbf6d91-52de-4250-9f07-dd1223a2e533-cni-binary-copy\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.344128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342870 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-host-var-lib-kubelet\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.344128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342869 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5a0fba0-4c13-4592-a836-4f1f9d20c663-kubelet-config\") pod \"global-pull-secret-syncer-m448k\" (UID: \"d5a0fba0-4c13-4592-a836-4f1f9d20c663\") " pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:34.344128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342899 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-host-var-lib-cni-multus\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.344128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342902 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f48acdda-801c-4b05-b8e1-573f6195e999-kubelet-dir\") pod \"aws-ebs-csi-driver-node-crl8w\" (UID: \"f48acdda-801c-4b05-b8e1-573f6195e999\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" Jul 16 08:54:34.344128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342912 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5a0fba0-4c13-4592-a836-4f1f9d20c663-kubelet-config\") pod \"global-pull-secret-syncer-m448k\" (UID: \"d5a0fba0-4c13-4592-a836-4f1f9d20c663\") " pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:34.344128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342917 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-etc-modprobe-d\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.344128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342932 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-host-var-lib-cni-multus\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.344128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342936 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-var-lib-kubelet\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.344128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342943 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f48acdda-801c-4b05-b8e1-573f6195e999-etc-selinux\") pod \"aws-ebs-csi-driver-node-crl8w\" (UID: \"f48acdda-801c-4b05-b8e1-573f6195e999\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" Jul 16 08:54:34.345048 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342950 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-sys\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.345048 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.342985 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-sys\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.345048 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343011 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-etc-modprobe-d\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.345048 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343011 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-host-run-netns\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.345048 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343059 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f48acdda-801c-4b05-b8e1-573f6195e999-device-dir\") pod \"aws-ebs-csi-driver-node-crl8w\" (UID: \"f48acdda-801c-4b05-b8e1-573f6195e999\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" Jul 16 08:54:34.345048 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343029 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-host-run-netns\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.345048 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343088 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mr2l\" (UniqueName: \"kubernetes.io/projected/f48acdda-801c-4b05-b8e1-573f6195e999-kube-api-access-8mr2l\") pod \"aws-ebs-csi-driver-node-crl8w\" (UID: \"f48acdda-801c-4b05-b8e1-573f6195e999\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" Jul 16 08:54:34.345048 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343116 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-etc-sysctl-d\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.345048 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343120 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f48acdda-801c-4b05-b8e1-573f6195e999-device-dir\") pod \"aws-ebs-csi-driver-node-crl8w\" (UID: \"f48acdda-801c-4b05-b8e1-573f6195e999\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" Jul 16 08:54:34.345048 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343141 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-etc-sysctl-conf\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.345048 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343168 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-etc-systemd\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.345048 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343192 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93797f20-8cc3-4c41-8c40-af09de1f954d-tmp\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.345048 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343217 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grdlj\" (UniqueName: \"kubernetes.io/projected/93797f20-8cc3-4c41-8c40-af09de1f954d-kube-api-access-grdlj\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.345048 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343257 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-system-cni-dir\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.345048 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343263 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-etc-sysctl-d\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.345048 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343273 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-etc-systemd\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.345048 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343282 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-host-run-k8s-cni-cncf-io\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.345048 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343292 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-etc-sysctl-conf\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.346075 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343325 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-system-cni-dir\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.346075 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343329 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0cbf6d91-52de-4250-9f07-dd1223a2e533-host-run-k8s-cni-cncf-io\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.346075 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343355 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0cbf6d91-52de-4250-9f07-dd1223a2e533-multus-daemon-config\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.346075 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343387 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-host\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.346075 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343402 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93797f20-8cc3-4c41-8c40-af09de1f954d-etc-tuned\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.346075 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343417 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret\") pod \"global-pull-secret-syncer-m448k\" (UID: \"d5a0fba0-4c13-4592-a836-4f1f9d20c663\") " pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:34.346075 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343460 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93797f20-8cc3-4c41-8c40-af09de1f954d-host\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.346075 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:34.343490 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 08:54:34.346075 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:34.343563 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret podName:d5a0fba0-4c13-4592-a836-4f1f9d20c663 nodeName:}" failed. No retries permitted until 2026-07-16 08:54:34.843544629 +0000 UTC m=+3.132994884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret") pod "global-pull-secret-syncer-m448k" (UID: "d5a0fba0-4c13-4592-a836-4f1f9d20c663") : object "kube-system"/"original-pull-secret" not registered Jul 16 08:54:34.346075 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.343792 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0cbf6d91-52de-4250-9f07-dd1223a2e533-multus-daemon-config\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.346075 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.345960 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/93797f20-8cc3-4c41-8c40-af09de1f954d-etc-tuned\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.346075 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.345977 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93797f20-8cc3-4c41-8c40-af09de1f954d-tmp\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.359059 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.359034 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjhk6\" (UniqueName: \"kubernetes.io/projected/7589804c-eb08-481e-a23c-431f53d6e559-kube-api-access-bjhk6\") pod \"network-metrics-daemon-czllj\" (UID: \"7589804c-eb08-481e-a23c-431f53d6e559\") " pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:54:34.360765 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.360746 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qq8d\" (UniqueName: \"kubernetes.io/projected/0cbf6d91-52de-4250-9f07-dd1223a2e533-kube-api-access-6qq8d\") pod \"multus-x8qvw\" (UID: \"0cbf6d91-52de-4250-9f07-dd1223a2e533\") " pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.361064 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.361043 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mr2l\" (UniqueName: \"kubernetes.io/projected/f48acdda-801c-4b05-b8e1-573f6195e999-kube-api-access-8mr2l\") pod \"aws-ebs-csi-driver-node-crl8w\" (UID: \"f48acdda-801c-4b05-b8e1-573f6195e999\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" Jul 16 08:54:34.361312 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.361288 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grdlj\" (UniqueName: \"kubernetes.io/projected/93797f20-8cc3-4c41-8c40-af09de1f954d-kube-api-access-grdlj\") pod \"tuned-lcn9c\" (UID: \"93797f20-8cc3-4c41-8c40-af09de1f954d\") " pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.427551 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.427468 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:54:34.434850 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.434831 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x7tqv" Jul 16 08:54:34.437245 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:34.437227 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aa01755_587c_4e81_bf62_974df0ddbf82.slice/crio-871087b92ce8e1c8c3b012d1058c2e68cedf831acf0feffb1468f1d4f4024287 WatchSource:0}: Error finding container 871087b92ce8e1c8c3b012d1058c2e68cedf831acf0feffb1468f1d4f4024287: Status 404 returned error can't find the container with id 871087b92ce8e1c8c3b012d1058c2e68cedf831acf0feffb1468f1d4f4024287 Jul 16 08:54:34.443166 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:34.443146 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb88636c3_8f04_4ea8_9753_bc53ee9e8aca.slice/crio-abaad02d2e8b6cac0b14081843aa686c4ea1d18155f1c850a816832a6ef1933e WatchSource:0}: Error finding container abaad02d2e8b6cac0b14081843aa686c4ea1d18155f1c850a816832a6ef1933e: Status 404 returned error can't find the container with id abaad02d2e8b6cac0b14081843aa686c4ea1d18155f1c850a816832a6ef1933e Jul 16 08:54:34.444651 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.444634 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-46vpz" Jul 16 08:54:34.450526 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.450508 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bmrd2" Jul 16 08:54:34.452501 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:34.452467 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2eb4d12_f3cb_47eb_8b13_12c907658c4e.slice/crio-ae182ccdc2cf3e782cf88fe801b4ad0d822f2260ac15123e58ce473f57a87422 WatchSource:0}: Error finding container ae182ccdc2cf3e782cf88fe801b4ad0d822f2260ac15123e58ce473f57a87422: Status 404 returned error can't find the container with id ae182ccdc2cf3e782cf88fe801b4ad0d822f2260ac15123e58ce473f57a87422 Jul 16 08:54:34.457559 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.457302 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-npjnt" Jul 16 08:54:34.461609 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:34.461588 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca239b38_b1b7_410e_9ef2_2de2ea8c432f.slice/crio-2d446351d5a434f7aa23b9ed76c2629a9402e52267002b5fee0e775f6a7fff26 WatchSource:0}: Error finding container 2d446351d5a434f7aa23b9ed76c2629a9402e52267002b5fee0e775f6a7fff26: Status 404 returned error can't find the container with id 2d446351d5a434f7aa23b9ed76c2629a9402e52267002b5fee0e775f6a7fff26 Jul 16 08:54:34.464689 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.464666 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ktm4b" Jul 16 08:54:34.466170 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:34.466143 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod896dc882_3406_4b26_ba10_9f9d47ae9e3a.slice/crio-bf0565eeb5aca00e1379bcdcd5caf9c62ef3d2f17fe549adf87488fa1fd0bf98 WatchSource:0}: Error finding container bf0565eeb5aca00e1379bcdcd5caf9c62ef3d2f17fe549adf87488fa1fd0bf98: Status 404 returned error can't find the container with id bf0565eeb5aca00e1379bcdcd5caf9c62ef3d2f17fe549adf87488fa1fd0bf98 Jul 16 08:54:34.473726 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.473703 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" Jul 16 08:54:34.473977 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:34.473945 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d0c1f9_5da8_4b91_9e3d_ebeaf9df84f7.slice/crio-3ec0b952dbb0f93618d82606eba4ec2e67d6bf35e9b62fab5fe03fec3feaaa4c WatchSource:0}: Error finding container 3ec0b952dbb0f93618d82606eba4ec2e67d6bf35e9b62fab5fe03fec3feaaa4c: Status 404 returned error can't find the container with id 3ec0b952dbb0f93618d82606eba4ec2e67d6bf35e9b62fab5fe03fec3feaaa4c Jul 16 08:54:34.480078 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.480045 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x8qvw" Jul 16 08:54:34.482211 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:34.482049 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf48acdda_801c_4b05_b8e1_573f6195e999.slice/crio-c0fae51431c50aff248a21f969a297310bcfe00a54625bc2c4465774dc42314f WatchSource:0}: Error finding container c0fae51431c50aff248a21f969a297310bcfe00a54625bc2c4465774dc42314f: Status 404 returned error can't find the container with id c0fae51431c50aff248a21f969a297310bcfe00a54625bc2c4465774dc42314f Jul 16 08:54:34.487471 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.487454 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" Jul 16 08:54:34.496113 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:54:34.496091 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93797f20_8cc3_4c41_8c40_af09de1f954d.slice/crio-d2969e20a100935aa53d773902e28ad44f7c1d1516b4aaab5c6d0c1ef4606a96 WatchSource:0}: Error finding container d2969e20a100935aa53d773902e28ad44f7c1d1516b4aaab5c6d0c1ef4606a96: Status 404 returned error can't find the container with id d2969e20a100935aa53d773902e28ad44f7c1d1516b4aaab5c6d0c1ef4606a96 Jul 16 08:54:34.847113 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.847082 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdd96\" (UniqueName: \"kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96\") pod \"network-check-target-6z2sg\" (UID: \"9bf029e2-2742-493c-b99a-dc4660744827\") " pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:54:34.847277 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.847122 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret\") pod \"global-pull-secret-syncer-m448k\" (UID: \"d5a0fba0-4c13-4592-a836-4f1f9d20c663\") " pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:34.847277 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:34.847267 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 08:54:34.847432 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:34.847301 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs\") pod \"network-metrics-daemon-czllj\" (UID: \"7589804c-eb08-481e-a23c-431f53d6e559\") " pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:54:34.847432 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:34.847322 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret podName:d5a0fba0-4c13-4592-a836-4f1f9d20c663 nodeName:}" failed. No retries permitted until 2026-07-16 08:54:35.847308498 +0000 UTC m=+4.136758773 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret") pod "global-pull-secret-syncer-m448k" (UID: "d5a0fba0-4c13-4592-a836-4f1f9d20c663") : object "kube-system"/"original-pull-secret" not registered Jul 16 08:54:34.847432 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:34.847270 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 08:54:34.847432 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:34.847376 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 08:54:34.847432 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:34.847407 2559 projected.go:196] Error preparing data for projected volume kube-api-access-hdd96 for pod openshift-network-diagnostics/network-check-target-6z2sg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 08:54:34.847432 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:34.847387 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 08:54:34.847821 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:34.847445 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96 podName:9bf029e2-2742-493c-b99a-dc4660744827 nodeName:}" failed. No retries permitted until 2026-07-16 08:54:35.847433569 +0000 UTC m=+4.136883825 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hdd96" (UniqueName: "kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96") pod "network-check-target-6z2sg" (UID: "9bf029e2-2742-493c-b99a-dc4660744827") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 08:54:34.847821 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:34.847471 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs podName:7589804c-eb08-481e-a23c-431f53d6e559 nodeName:}" failed. No retries permitted until 2026-07-16 08:54:35.847452438 +0000 UTC m=+4.136902703 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs") pod "network-metrics-daemon-czllj" (UID: "7589804c-eb08-481e-a23c-431f53d6e559") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 08:54:35.284427 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:35.284384 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7tqv" event={"ID":"b88636c3-8f04-4ea8-9753-bc53ee9e8aca","Type":"ContainerStarted","Data":"abaad02d2e8b6cac0b14081843aa686c4ea1d18155f1c850a816832a6ef1933e"} Jul 16 08:54:35.288199 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:35.288167 2559 generic.go:356] "Generic (PLEG): container finished" podID="5009e491d0a04275defe06b16b9f3398" containerID="5e4bbc54a3243ddc11296ea7f3272b5b8f18c4857b758033964446cf6200d9d9" exitCode=0 Jul 16 08:54:35.288339 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:35.288249 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-31.ec2.internal" event={"ID":"5009e491d0a04275defe06b16b9f3398","Type":"ContainerDied","Data":"5e4bbc54a3243ddc11296ea7f3272b5b8f18c4857b758033964446cf6200d9d9"} Jul 16 08:54:35.290018 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:35.289985 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 08:49:35 +0000 UTC" deadline="2027-12-17 22:19:28.115572083 +0000 UTC" Jul 16 08:54:35.290111 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:35.290019 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12469h24m52.825556902s" Jul 16 08:54:35.301411 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:35.301382 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x8qvw" event={"ID":"0cbf6d91-52de-4250-9f07-dd1223a2e533","Type":"ContainerStarted","Data":"045865f6be8a46ab9afee0fbba5941896e30f7575ed1b8c1eb19bf37c8d06735"} Jul 16 08:54:35.321709 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:35.321679 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" event={"ID":"f48acdda-801c-4b05-b8e1-573f6195e999","Type":"ContainerStarted","Data":"c0fae51431c50aff248a21f969a297310bcfe00a54625bc2c4465774dc42314f"} Jul 16 08:54:35.333190 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:35.333119 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bmrd2" event={"ID":"ca239b38-b1b7-410e-9ef2-2de2ea8c432f","Type":"ContainerStarted","Data":"2d446351d5a434f7aa23b9ed76c2629a9402e52267002b5fee0e775f6a7fff26"} Jul 16 08:54:35.352913 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:35.352839 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-46vpz" event={"ID":"b2eb4d12-f3cb-47eb-8b13-12c907658c4e","Type":"ContainerStarted","Data":"ae182ccdc2cf3e782cf88fe801b4ad0d822f2260ac15123e58ce473f57a87422"} Jul 16 08:54:35.357180 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:35.357153 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" event={"ID":"4aa01755-587c-4e81-bf62-974df0ddbf82","Type":"ContainerStarted","Data":"871087b92ce8e1c8c3b012d1058c2e68cedf831acf0feffb1468f1d4f4024287"} Jul 16 08:54:35.366595 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:35.364132 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" event={"ID":"93797f20-8cc3-4c41-8c40-af09de1f954d","Type":"ContainerStarted","Data":"d2969e20a100935aa53d773902e28ad44f7c1d1516b4aaab5c6d0c1ef4606a96"} Jul 16 08:54:35.379098 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:35.379024 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ktm4b" event={"ID":"81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7","Type":"ContainerStarted","Data":"3ec0b952dbb0f93618d82606eba4ec2e67d6bf35e9b62fab5fe03fec3feaaa4c"} Jul 16 08:54:35.413559 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:35.413499 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-npjnt" event={"ID":"896dc882-3406-4b26-ba10-9f9d47ae9e3a","Type":"ContainerStarted","Data":"bf0565eeb5aca00e1379bcdcd5caf9c62ef3d2f17fe549adf87488fa1fd0bf98"} Jul 16 08:54:35.857915 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:35.857819 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs\") pod \"network-metrics-daemon-czllj\" (UID: \"7589804c-eb08-481e-a23c-431f53d6e559\") " pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:54:35.857915 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:35.857895 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdd96\" (UniqueName: \"kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96\") pod \"network-check-target-6z2sg\" (UID: \"9bf029e2-2742-493c-b99a-dc4660744827\") " pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:54:35.858189 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:35.857925 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret\") pod \"global-pull-secret-syncer-m448k\" (UID: \"d5a0fba0-4c13-4592-a836-4f1f9d20c663\") " pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:35.858189 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:35.858052 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 08:54:35.858189 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:35.858114 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret podName:d5a0fba0-4c13-4592-a836-4f1f9d20c663 nodeName:}" failed. No retries permitted until 2026-07-16 08:54:37.858094757 +0000 UTC m=+6.147545016 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret") pod "global-pull-secret-syncer-m448k" (UID: "d5a0fba0-4c13-4592-a836-4f1f9d20c663") : object "kube-system"/"original-pull-secret" not registered Jul 16 08:54:35.858676 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:35.858655 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 08:54:35.858774 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:35.858715 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs podName:7589804c-eb08-481e-a23c-431f53d6e559 nodeName:}" failed. No retries permitted until 2026-07-16 08:54:37.858698292 +0000 UTC m=+6.148148541 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs") pod "network-metrics-daemon-czllj" (UID: "7589804c-eb08-481e-a23c-431f53d6e559") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 08:54:35.858851 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:35.858828 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 08:54:35.858851 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:35.858846 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 08:54:35.858954 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:35.858860 2559 projected.go:196] Error preparing data for projected volume kube-api-access-hdd96 for pod openshift-network-diagnostics/network-check-target-6z2sg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 08:54:35.858954 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:35.858903 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96 podName:9bf029e2-2742-493c-b99a-dc4660744827 nodeName:}" failed. No retries permitted until 2026-07-16 08:54:37.858890608 +0000 UTC m=+6.148340850 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hdd96" (UniqueName: "kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96") pod "network-check-target-6z2sg" (UID: "9bf029e2-2742-493c-b99a-dc4660744827") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 08:54:36.238709 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:36.238676 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:36.238878 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:36.238826 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m448k" podUID="d5a0fba0-4c13-4592-a836-4f1f9d20c663" Jul 16 08:54:36.239291 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:36.239270 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:54:36.239401 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:36.239378 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2sg" podUID="9bf029e2-2742-493c-b99a-dc4660744827" Jul 16 08:54:36.239726 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:36.239707 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:54:36.239847 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:36.239825 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czllj" podUID="7589804c-eb08-481e-a23c-431f53d6e559" Jul 16 08:54:36.291157 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:36.291073 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 08:49:35 +0000 UTC" deadline="2028-01-05 13:02:12.452518006 +0000 UTC" Jul 16 08:54:36.291157 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:36.291133 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12916h7m36.161390458s" Jul 16 08:54:36.453253 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:36.453164 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-31.ec2.internal" event={"ID":"5009e491d0a04275defe06b16b9f3398","Type":"ContainerStarted","Data":"6101bac8e4c3eae6ebafe8b5c298cd68486cbcc5c88e8ab52d75dc98cff14879"} Jul 16 08:54:36.474950 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:36.474883 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-31.ec2.internal" podStartSLOduration=2.474861248 podStartE2EDuration="2.474861248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:54:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:54:36.474588977 +0000 UTC m=+4.764039239" watchObservedRunningTime="2026-07-16 08:54:36.474861248 +0000 UTC m=+4.764311515" Jul 16 08:54:37.883578 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:37.882546 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdd96\" (UniqueName: \"kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96\") pod \"network-check-target-6z2sg\" (UID: \"9bf029e2-2742-493c-b99a-dc4660744827\") " pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:54:37.883578 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:37.882600 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret\") pod \"global-pull-secret-syncer-m448k\" (UID: \"d5a0fba0-4c13-4592-a836-4f1f9d20c663\") " pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:37.883578 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:37.882658 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs\") pod \"network-metrics-daemon-czllj\" (UID: \"7589804c-eb08-481e-a23c-431f53d6e559\") " pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:54:37.883578 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:37.882806 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 08:54:37.883578 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:37.882870 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs podName:7589804c-eb08-481e-a23c-431f53d6e559 nodeName:}" failed. No retries permitted until 2026-07-16 08:54:41.882851006 +0000 UTC m=+10.172301250 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs") pod "network-metrics-daemon-czllj" (UID: "7589804c-eb08-481e-a23c-431f53d6e559") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 08:54:37.883578 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:37.883327 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 08:54:37.883578 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:37.883397 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 08:54:37.883578 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:37.883413 2559 projected.go:196] Error preparing data for projected volume kube-api-access-hdd96 for pod openshift-network-diagnostics/network-check-target-6z2sg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 08:54:37.883578 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:37.883463 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96 podName:9bf029e2-2742-493c-b99a-dc4660744827 nodeName:}" failed. No retries permitted until 2026-07-16 08:54:41.883446286 +0000 UTC m=+10.172896530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hdd96" (UniqueName: "kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96") pod "network-check-target-6z2sg" (UID: "9bf029e2-2742-493c-b99a-dc4660744827") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 08:54:37.883578 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:37.883541 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 08:54:37.884437 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:37.883599 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret podName:d5a0fba0-4c13-4592-a836-4f1f9d20c663 nodeName:}" failed. No retries permitted until 2026-07-16 08:54:41.883583877 +0000 UTC m=+10.173034141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret") pod "global-pull-secret-syncer-m448k" (UID: "d5a0fba0-4c13-4592-a836-4f1f9d20c663") : object "kube-system"/"original-pull-secret" not registered Jul 16 08:54:38.240099 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:38.238664 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:54:38.240099 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:38.238700 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:54:38.240099 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:38.238664 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:38.240099 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:38.238820 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czllj" podUID="7589804c-eb08-481e-a23c-431f53d6e559" Jul 16 08:54:38.240099 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:38.238924 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m448k" podUID="d5a0fba0-4c13-4592-a836-4f1f9d20c663" Jul 16 08:54:38.240099 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:38.239006 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2sg" podUID="9bf029e2-2742-493c-b99a-dc4660744827" Jul 16 08:54:40.237462 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:40.237397 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:40.237882 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:40.237668 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m448k" podUID="d5a0fba0-4c13-4592-a836-4f1f9d20c663" Jul 16 08:54:40.237882 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:40.237702 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:54:40.237882 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:40.237770 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:54:40.237997 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:40.237901 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czllj" podUID="7589804c-eb08-481e-a23c-431f53d6e559" Jul 16 08:54:40.237997 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:40.237986 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2sg" podUID="9bf029e2-2742-493c-b99a-dc4660744827" Jul 16 08:54:41.921712 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:41.921677 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdd96\" (UniqueName: \"kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96\") pod \"network-check-target-6z2sg\" (UID: \"9bf029e2-2742-493c-b99a-dc4660744827\") " pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:54:41.921712 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:41.921717 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret\") pod \"global-pull-secret-syncer-m448k\" (UID: \"d5a0fba0-4c13-4592-a836-4f1f9d20c663\") " pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:41.922185 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:41.921753 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs\") pod \"network-metrics-daemon-czllj\" (UID: \"7589804c-eb08-481e-a23c-431f53d6e559\") " pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:54:41.922185 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:41.921864 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 08:54:41.922185 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:41.921912 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs podName:7589804c-eb08-481e-a23c-431f53d6e559 nodeName:}" failed. No retries permitted until 2026-07-16 08:54:49.921898055 +0000 UTC m=+18.211348295 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs") pod "network-metrics-daemon-czllj" (UID: "7589804c-eb08-481e-a23c-431f53d6e559") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 08:54:41.922324 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:41.922243 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 08:54:41.922324 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:41.922259 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 08:54:41.922324 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:41.922272 2559 projected.go:196] Error preparing data for projected volume kube-api-access-hdd96 for pod openshift-network-diagnostics/network-check-target-6z2sg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 08:54:41.922324 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:41.922308 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96 podName:9bf029e2-2742-493c-b99a-dc4660744827 nodeName:}" failed. No retries permitted until 2026-07-16 08:54:49.922297437 +0000 UTC m=+18.211747676 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hdd96" (UniqueName: "kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96") pod "network-check-target-6z2sg" (UID: "9bf029e2-2742-493c-b99a-dc4660744827") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 08:54:41.922502 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:41.922352 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 08:54:41.922502 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:41.922381 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret podName:d5a0fba0-4c13-4592-a836-4f1f9d20c663 nodeName:}" failed. No retries permitted until 2026-07-16 08:54:49.922373695 +0000 UTC m=+18.211823935 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret") pod "global-pull-secret-syncer-m448k" (UID: "d5a0fba0-4c13-4592-a836-4f1f9d20c663") : object "kube-system"/"original-pull-secret" not registered Jul 16 08:54:42.240412 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:42.238652 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:54:42.240412 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:42.238806 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czllj" podUID="7589804c-eb08-481e-a23c-431f53d6e559" Jul 16 08:54:42.240412 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:42.239233 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:42.240412 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:42.239336 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m448k" podUID="d5a0fba0-4c13-4592-a836-4f1f9d20c663" Jul 16 08:54:42.240412 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:42.239392 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:54:42.240412 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:42.239467 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2sg" podUID="9bf029e2-2742-493c-b99a-dc4660744827" Jul 16 08:54:44.238634 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:44.238578 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:54:44.238634 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:44.238594 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:54:44.239090 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:44.238711 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2sg" podUID="9bf029e2-2742-493c-b99a-dc4660744827" Jul 16 08:54:44.239090 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:44.238784 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czllj" podUID="7589804c-eb08-481e-a23c-431f53d6e559" Jul 16 08:54:44.239090 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:44.238828 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:44.239090 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:44.238964 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m448k" podUID="d5a0fba0-4c13-4592-a836-4f1f9d20c663" Jul 16 08:54:46.237345 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:46.237313 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:54:46.237845 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:46.237316 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:46.237845 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:46.237502 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:54:46.237845 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:46.237496 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czllj" podUID="7589804c-eb08-481e-a23c-431f53d6e559" Jul 16 08:54:46.237845 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:46.237594 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m448k" podUID="d5a0fba0-4c13-4592-a836-4f1f9d20c663" Jul 16 08:54:46.237845 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:46.237677 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2sg" podUID="9bf029e2-2742-493c-b99a-dc4660744827" Jul 16 08:54:48.238042 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:48.238006 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:54:48.238539 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:48.238007 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:48.238539 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:48.238129 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czllj" podUID="7589804c-eb08-481e-a23c-431f53d6e559" Jul 16 08:54:48.238539 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:48.238010 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:54:48.238539 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:48.238220 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m448k" podUID="d5a0fba0-4c13-4592-a836-4f1f9d20c663" Jul 16 08:54:48.238539 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:48.238273 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2sg" podUID="9bf029e2-2742-493c-b99a-dc4660744827" Jul 16 08:54:49.985821 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:49.985775 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdd96\" (UniqueName: \"kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96\") pod \"network-check-target-6z2sg\" (UID: \"9bf029e2-2742-493c-b99a-dc4660744827\") " pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:54:49.985821 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:49.985827 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret\") pod \"global-pull-secret-syncer-m448k\" (UID: \"d5a0fba0-4c13-4592-a836-4f1f9d20c663\") " pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:49.986298 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:49.985864 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs\") pod \"network-metrics-daemon-czllj\" (UID: \"7589804c-eb08-481e-a23c-431f53d6e559\") " pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:54:49.986298 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:49.985965 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 08:54:49.986298 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:49.985976 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 08:54:49.986298 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:49.985993 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 08:54:49.986298 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:49.986006 2559 projected.go:196] Error preparing data for projected volume kube-api-access-hdd96 for pod openshift-network-diagnostics/network-check-target-6z2sg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 08:54:49.986298 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:49.986045 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs podName:7589804c-eb08-481e-a23c-431f53d6e559 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:05.986025453 +0000 UTC m=+34.275475714 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs") pod "network-metrics-daemon-czllj" (UID: "7589804c-eb08-481e-a23c-431f53d6e559") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 08:54:49.986298 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:49.985971 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 08:54:49.986298 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:49.986062 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96 podName:9bf029e2-2742-493c-b99a-dc4660744827 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:05.986053607 +0000 UTC m=+34.275503844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hdd96" (UniqueName: "kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96") pod "network-check-target-6z2sg" (UID: "9bf029e2-2742-493c-b99a-dc4660744827") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 08:54:49.986298 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:49.986087 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret podName:d5a0fba0-4c13-4592-a836-4f1f9d20c663 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:05.986071203 +0000 UTC m=+34.275521454 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret") pod "global-pull-secret-syncer-m448k" (UID: "d5a0fba0-4c13-4592-a836-4f1f9d20c663") : object "kube-system"/"original-pull-secret" not registered Jul 16 08:54:50.237907 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:50.237815 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:54:50.238070 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:50.237815 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:50.238070 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:50.237957 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czllj" podUID="7589804c-eb08-481e-a23c-431f53d6e559" Jul 16 08:54:50.238070 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:50.237815 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:54:50.238070 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:50.238031 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m448k" podUID="d5a0fba0-4c13-4592-a836-4f1f9d20c663" Jul 16 08:54:50.238259 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:50.238082 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2sg" podUID="9bf029e2-2742-493c-b99a-dc4660744827" Jul 16 08:54:52.238687 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:52.238655 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:54:52.239115 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:52.238738 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2sg" podUID="9bf029e2-2742-493c-b99a-dc4660744827" Jul 16 08:54:52.239115 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:52.238837 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:54:52.239115 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:52.238957 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czllj" podUID="7589804c-eb08-481e-a23c-431f53d6e559" Jul 16 08:54:52.239115 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:52.239012 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:52.239115 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:52.239068 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m448k" podUID="d5a0fba0-4c13-4592-a836-4f1f9d20c663" Jul 16 08:54:54.238160 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:54.237713 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:54:54.238160 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:54.237760 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:54.238160 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:54.237719 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:54:54.238160 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:54.237852 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2sg" podUID="9bf029e2-2742-493c-b99a-dc4660744827" Jul 16 08:54:54.238160 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:54.237948 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czllj" podUID="7589804c-eb08-481e-a23c-431f53d6e559" Jul 16 08:54:54.238160 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:54.238020 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m448k" podUID="d5a0fba0-4c13-4592-a836-4f1f9d20c663" Jul 16 08:54:55.498344 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:55.498071 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ktm4b" event={"ID":"81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7","Type":"ContainerStarted","Data":"c992bafee95732caf02e368536b006b2c430267e5c31095ccc1d97a061503d48"} Jul 16 08:54:55.499795 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:55.499768 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7tqv" event={"ID":"b88636c3-8f04-4ea8-9753-bc53ee9e8aca","Type":"ContainerStarted","Data":"a8f18c5fdd9ff859aad35cd4f81b2ce2dc8fa5b127f5fbc364f11d5b14161de0"} Jul 16 08:54:55.501619 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:55.501278 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-31.ec2.internal" event={"ID":"fb396c0835f4deca175bfbe7b025b3ae","Type":"ContainerStarted","Data":"0da546fa81f943b1bbe399a01805bf0b44ab94090e8eb3277e2c116bb66625a8"} Jul 16 08:54:55.503285 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:55.503235 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x8qvw" event={"ID":"0cbf6d91-52de-4250-9f07-dd1223a2e533","Type":"ContainerStarted","Data":"d219d898c1fcb8c1a61ce2a1a73229fefcbcaec0ee54e818de8e79c31d479c05"} Jul 16 08:54:55.505296 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:55.505273 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" event={"ID":"f48acdda-801c-4b05-b8e1-573f6195e999","Type":"ContainerStarted","Data":"884d44c4d829ed0e0377325057de2d7b82fe4778a1718cc1b17a15815136600a"} Jul 16 08:54:55.506713 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:55.506690 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bmrd2" event={"ID":"ca239b38-b1b7-410e-9ef2-2de2ea8c432f","Type":"ContainerStarted","Data":"51f9cbe214366853c03fb89dd09672f2ea11537928ebbb8f7b2370f94943438a"} Jul 16 08:54:55.508299 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:55.508244 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-46vpz" event={"ID":"b2eb4d12-f3cb-47eb-8b13-12c907658c4e","Type":"ContainerStarted","Data":"eefeb6dd93a154a0da5bf14ef6ac157d1c1cc088cc200df61504e635c1d2316e"} Jul 16 08:54:55.510038 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:55.510021 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sb2b7_4aa01755-587c-4e81-bf62-974df0ddbf82/ovn-acl-logging/0.log" Jul 16 08:54:55.510421 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:55.510402 2559 generic.go:356] "Generic (PLEG): container finished" podID="4aa01755-587c-4e81-bf62-974df0ddbf82" containerID="56edccc8afa8bc23b3ed20014fef96894d3288b417f996a220c60f9555d36120" exitCode=1 Jul 16 08:54:55.510532 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:55.510501 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" event={"ID":"4aa01755-587c-4e81-bf62-974df0ddbf82","Type":"ContainerDied","Data":"56edccc8afa8bc23b3ed20014fef96894d3288b417f996a220c60f9555d36120"} Jul 16 08:54:55.510597 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:55.510582 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" event={"ID":"4aa01755-587c-4e81-bf62-974df0ddbf82","Type":"ContainerStarted","Data":"6647b17d9ff572df00a0bb309431c650dacb8d3bbe1a885bfe54b9cf6972be29"} Jul 16 08:54:55.511938 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:55.511893 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" event={"ID":"93797f20-8cc3-4c41-8c40-af09de1f954d","Type":"ContainerStarted","Data":"0969b6fc443a5351f3c49d382e30468e36c9cf14aa73bb1f05e7c9da7f073ca5"} Jul 16 08:54:55.515821 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:55.515785 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ktm4b" podStartSLOduration=1.840098995 podStartE2EDuration="22.51577406s" totalImagesPullingTime="20.675675065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:54:55.515639621 +0000 UTC m=+23.805089884" watchObservedRunningTime="2026-07-16 08:54:55.51577406 +0000 UTC m=+23.805224320" Jul 16 08:54:55.554158 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:55.554111 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bmrd2" podStartSLOduration=1.863991414 podStartE2EDuration="22.554095977s" totalImagesPullingTime="20.690104563s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:54:55.553778165 +0000 UTC m=+23.843228422" watchObservedRunningTime="2026-07-16 08:54:55.554095977 +0000 UTC m=+23.843546235" Jul 16 08:54:55.569504 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:55.569438 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-46vpz" podStartSLOduration=1.8716125890000002 podStartE2EDuration="22.569423209s" totalImagesPullingTime="20.69781062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:54:55.569228751 +0000 UTC m=+23.858679011" watchObservedRunningTime="2026-07-16 08:54:55.569423209 +0000 UTC m=+23.858873468" Jul 16 08:54:55.588508 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:55.588446 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-x8qvw" podStartSLOduration=1.874083568 podStartE2EDuration="22.588431825s" totalImagesPullingTime="20.714348257s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:54:55.587712706 +0000 UTC m=+23.877162966" watchObservedRunningTime="2026-07-16 08:54:55.588431825 +0000 UTC m=+23.877882084" Jul 16 08:54:55.608899 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:55.608851 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lcn9c" podStartSLOduration=1.925790586 podStartE2EDuration="22.608833414s" totalImagesPullingTime="20.683042828s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:54:55.608800638 +0000 UTC m=+23.898250899" watchObservedRunningTime="2026-07-16 08:54:55.608833414 +0000 UTC m=+23.898283675" Jul 16 08:54:55.622722 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:55.622660 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-31.ec2.internal" podStartSLOduration=21.622645465 podStartE2EDuration="21.622645465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:54:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:54:55.622549804 +0000 UTC m=+23.912000063" watchObservedRunningTime="2026-07-16 08:54:55.622645465 +0000 UTC m=+23.912095725" Jul 16 08:54:56.238279 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:56.238110 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:54:56.238441 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:56.238113 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:54:56.238441 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:56.238356 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czllj" podUID="7589804c-eb08-481e-a23c-431f53d6e559" Jul 16 08:54:56.238441 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:56.238117 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:56.238644 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:56.238419 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2sg" podUID="9bf029e2-2742-493c-b99a-dc4660744827" Jul 16 08:54:56.238644 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:56.238509 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m448k" podUID="d5a0fba0-4c13-4592-a836-4f1f9d20c663" Jul 16 08:54:56.516546 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:56.516523 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sb2b7_4aa01755-587c-4e81-bf62-974df0ddbf82/ovn-acl-logging/0.log" Jul 16 08:54:56.516904 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:56.516886 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" event={"ID":"4aa01755-587c-4e81-bf62-974df0ddbf82","Type":"ContainerStarted","Data":"02f18b0011cf1edfe0a09a50b70c9530702f28120010dad34e9f4183dbb9ea24"} Jul 16 08:54:56.516967 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:56.516954 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" event={"ID":"4aa01755-587c-4e81-bf62-974df0ddbf82","Type":"ContainerStarted","Data":"a941dc849978ce8f08ca9d40f21585fab3174475a202d3992c9cf74b0606f5b5"} Jul 16 08:54:56.517015 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:56.516989 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" event={"ID":"4aa01755-587c-4e81-bf62-974df0ddbf82","Type":"ContainerStarted","Data":"7dd17dfd51dbbc583681c413c55eb426c33d011fe23c270f11d0ae37ed06ad21"} Jul 16 08:54:56.517051 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:56.517027 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" event={"ID":"4aa01755-587c-4e81-bf62-974df0ddbf82","Type":"ContainerStarted","Data":"22ce2f2766d965a9d7f1cec5d121c67b68b0a1e98c1c407b9438ae254c2217ce"} Jul 16 08:54:56.518240 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:56.518214 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-npjnt" event={"ID":"896dc882-3406-4b26-ba10-9f9d47ae9e3a","Type":"ContainerStarted","Data":"3d063dd56eb5583eef6e3b9eedce3d56b442b0a8160fb2297444e80948ce5ee2"} Jul 16 08:54:56.519551 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:56.519532 2559 generic.go:356] "Generic (PLEG): container finished" podID="b88636c3-8f04-4ea8-9753-bc53ee9e8aca" containerID="a8f18c5fdd9ff859aad35cd4f81b2ce2dc8fa5b127f5fbc364f11d5b14161de0" exitCode=0 Jul 16 08:54:56.519645 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:56.519596 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7tqv" event={"ID":"b88636c3-8f04-4ea8-9753-bc53ee9e8aca","Type":"ContainerDied","Data":"a8f18c5fdd9ff859aad35cd4f81b2ce2dc8fa5b127f5fbc364f11d5b14161de0"} Jul 16 08:54:56.535182 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:56.535149 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-npjnt" podStartSLOduration=2.850332693 podStartE2EDuration="23.535119579s" totalImagesPullingTime="20.684786886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:54:56.534366531 +0000 UTC m=+24.823816789" watchObservedRunningTime="2026-07-16 08:54:56.535119579 +0000 UTC m=+24.824569838" Jul 16 08:54:56.739384 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:56.739363 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 08:54:57.189379 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:57.189146 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T08:54:56.739379191Z","UUID":"b84d8924-5885-4a11-8bde-58ded51a9b5c","Handler":null,"Name":"","Endpoint":""} Jul 16 08:54:57.190748 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:57.190732 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 08:54:57.190853 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:57.190763 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 08:54:57.524910 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:57.524550 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" event={"ID":"f48acdda-801c-4b05-b8e1-573f6195e999","Type":"ContainerStarted","Data":"19da07a516246a1105691540fb45e742a8303d43203112f99332fe49cdc14abf"} Jul 16 08:54:57.705189 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:57.705157 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ktm4b" Jul 16 08:54:57.705831 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:57.705809 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ktm4b" Jul 16 08:54:58.237799 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:58.237767 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:54:58.237799 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:58.237784 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:54:58.238022 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:58.237767 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:54:58.238022 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:58.237903 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czllj" podUID="7589804c-eb08-481e-a23c-431f53d6e559" Jul 16 08:54:58.238022 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:58.237976 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m448k" podUID="d5a0fba0-4c13-4592-a836-4f1f9d20c663" Jul 16 08:54:58.238022 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:54:58.238012 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2sg" podUID="9bf029e2-2742-493c-b99a-dc4660744827" Jul 16 08:54:58.528895 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:58.528858 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" event={"ID":"f48acdda-801c-4b05-b8e1-573f6195e999","Type":"ContainerStarted","Data":"a4f5807e43b08b882437d13ba99333c2a2061d1e6bee073953ca6eb5db90198d"} Jul 16 08:54:58.532429 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:58.532408 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sb2b7_4aa01755-587c-4e81-bf62-974df0ddbf82/ovn-acl-logging/0.log" Jul 16 08:54:58.532905 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:58.532881 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" event={"ID":"4aa01755-587c-4e81-bf62-974df0ddbf82","Type":"ContainerStarted","Data":"d92b0eafff5a9e205ed79bd841be1b5529bddb59ad1013471a66df5036e6fbde"} Jul 16 08:54:58.533066 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:58.533050 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ktm4b" Jul 16 08:54:58.533514 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:58.533492 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ktm4b" Jul 16 08:54:58.571993 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:54:58.571944 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crl8w" podStartSLOduration=2.624210026 podStartE2EDuration="25.571925195s" totalImagesPullingTime="22.947715169s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:54:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:54:58.555147068 +0000 UTC m=+26.844597326" watchObservedRunningTime="2026-07-16 08:54:58.571925195 +0000 UTC m=+26.861375481" Jul 16 08:55:00.241217 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:00.241189 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:55:00.241958 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:00.241189 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:55:00.241958 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:00.241327 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czllj" podUID="7589804c-eb08-481e-a23c-431f53d6e559" Jul 16 08:55:00.241958 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:00.241189 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:55:00.241958 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:00.241361 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2sg" podUID="9bf029e2-2742-493c-b99a-dc4660744827" Jul 16 08:55:00.241958 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:00.241413 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m448k" podUID="d5a0fba0-4c13-4592-a836-4f1f9d20c663" Jul 16 08:55:01.542006 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:01.541760 2559 generic.go:356] "Generic (PLEG): container finished" podID="b88636c3-8f04-4ea8-9753-bc53ee9e8aca" containerID="896e156e422e9913d5d51e175b23b6dd10ffd3d272cfefd55c832c74d41eeeda" exitCode=0 Jul 16 08:55:01.542627 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:01.541846 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7tqv" event={"ID":"b88636c3-8f04-4ea8-9753-bc53ee9e8aca","Type":"ContainerDied","Data":"896e156e422e9913d5d51e175b23b6dd10ffd3d272cfefd55c832c74d41eeeda"} Jul 16 08:55:01.545973 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:01.545948 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sb2b7_4aa01755-587c-4e81-bf62-974df0ddbf82/ovn-acl-logging/0.log" Jul 16 08:55:01.546374 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:01.546346 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" event={"ID":"4aa01755-587c-4e81-bf62-974df0ddbf82","Type":"ContainerStarted","Data":"3c40f1c92ccc4edccdab1155bcab0e62e5f6e5737c86c0bfb73846238787c9e2"} Jul 16 08:55:01.546686 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:01.546668 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:55:01.546774 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:01.546739 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:55:01.546774 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:01.546756 2559 scope.go:117] "RemoveContainer" containerID="56edccc8afa8bc23b3ed20014fef96894d3288b417f996a220c60f9555d36120" Jul 16 08:55:01.546900 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:01.546787 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:55:01.564673 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:01.564652 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:55:01.565253 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:01.565236 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:55:02.240892 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:02.240867 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:55:02.241081 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:02.240906 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:55:02.241081 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:02.240906 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:55:02.241081 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:02.240978 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2sg" podUID="9bf029e2-2742-493c-b99a-dc4660744827" Jul 16 08:55:02.241238 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:02.241076 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m448k" podUID="d5a0fba0-4c13-4592-a836-4f1f9d20c663" Jul 16 08:55:02.241238 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:02.241204 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czllj" podUID="7589804c-eb08-481e-a23c-431f53d6e559" Jul 16 08:55:02.553178 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:02.553110 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sb2b7_4aa01755-587c-4e81-bf62-974df0ddbf82/ovn-acl-logging/0.log" Jul 16 08:55:02.553678 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:02.553532 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" event={"ID":"4aa01755-587c-4e81-bf62-974df0ddbf82","Type":"ContainerStarted","Data":"6aef731ecec28c5e6c6a4e3c0e64803c7a85a4efb83f0c9be907288988696fea"} Jul 16 08:55:02.589761 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:02.589708 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" podStartSLOduration=8.790099312 podStartE2EDuration="29.589674653s" totalImagesPullingTime="20.799575341s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:55:02.588532839 +0000 UTC m=+30.877983101" watchObservedRunningTime="2026-07-16 08:55:02.589674653 +0000 UTC m=+30.879124914" Jul 16 08:55:02.662413 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:02.662386 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-czllj"] Jul 16 08:55:02.662584 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:02.662549 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:55:02.662704 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:02.662686 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czllj" podUID="7589804c-eb08-481e-a23c-431f53d6e559" Jul 16 08:55:02.665101 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:02.665077 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m448k"] Jul 16 08:55:02.665208 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:02.665160 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:55:02.665251 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:02.665225 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m448k" podUID="d5a0fba0-4c13-4592-a836-4f1f9d20c663" Jul 16 08:55:02.668809 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:02.668788 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6z2sg"] Jul 16 08:55:02.668896 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:02.668874 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:55:02.668959 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:02.668940 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2sg" podUID="9bf029e2-2742-493c-b99a-dc4660744827" Jul 16 08:55:03.558154 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:03.557969 2559 generic.go:356] "Generic (PLEG): container finished" podID="b88636c3-8f04-4ea8-9753-bc53ee9e8aca" containerID="f6baa8f3484f7dce2736520364cb8c8e82879d857398fe90c4e02f24e2deeef6" exitCode=0 Jul 16 08:55:03.558154 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:03.558056 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7tqv" event={"ID":"b88636c3-8f04-4ea8-9753-bc53ee9e8aca","Type":"ContainerDied","Data":"f6baa8f3484f7dce2736520364cb8c8e82879d857398fe90c4e02f24e2deeef6"} Jul 16 08:55:04.239811 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:04.239790 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:55:04.239924 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:04.239881 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:55:04.239924 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:04.239887 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2sg" podUID="9bf029e2-2742-493c-b99a-dc4660744827" Jul 16 08:55:04.240014 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:04.239973 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czllj" podUID="7589804c-eb08-481e-a23c-431f53d6e559" Jul 16 08:55:04.240014 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:04.240012 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:55:04.240104 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:04.240079 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m448k" podUID="d5a0fba0-4c13-4592-a836-4f1f9d20c663" Jul 16 08:55:05.564452 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:05.564427 2559 generic.go:356] "Generic (PLEG): container finished" podID="b88636c3-8f04-4ea8-9753-bc53ee9e8aca" containerID="9ed2f4157d753020dd68ad1229406b7db4497ef3a3d0fe56ffe6315057c4af5a" exitCode=0 Jul 16 08:55:05.565174 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:05.564461 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7tqv" event={"ID":"b88636c3-8f04-4ea8-9753-bc53ee9e8aca","Type":"ContainerDied","Data":"9ed2f4157d753020dd68ad1229406b7db4497ef3a3d0fe56ffe6315057c4af5a"} Jul 16 08:55:06.008911 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:06.008888 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdd96\" (UniqueName: \"kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96\") pod \"network-check-target-6z2sg\" (UID: \"9bf029e2-2742-493c-b99a-dc4660744827\") " pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:55:06.009055 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:06.008920 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret\") pod \"global-pull-secret-syncer-m448k\" (UID: \"d5a0fba0-4c13-4592-a836-4f1f9d20c663\") " pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:55:06.009055 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:06.008948 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs\") pod \"network-metrics-daemon-czllj\" (UID: \"7589804c-eb08-481e-a23c-431f53d6e559\") " pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:55:06.009055 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:06.009032 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 08:55:06.009055 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:06.009035 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 08:55:06.009186 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:06.009061 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 08:55:06.009186 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:06.009035 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 08:55:06.009186 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:06.009071 2559 projected.go:196] Error preparing data for projected volume kube-api-access-hdd96 for pod openshift-network-diagnostics/network-check-target-6z2sg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 08:55:06.009186 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:06.009096 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret podName:d5a0fba0-4c13-4592-a836-4f1f9d20c663 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:38.009078953 +0000 UTC m=+66.298529206 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret") pod "global-pull-secret-syncer-m448k" (UID: "d5a0fba0-4c13-4592-a836-4f1f9d20c663") : object "kube-system"/"original-pull-secret" not registered Jul 16 08:55:06.009186 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:06.009115 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96 podName:9bf029e2-2742-493c-b99a-dc4660744827 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:38.009104365 +0000 UTC m=+66.298554618 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hdd96" (UniqueName: "kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96") pod "network-check-target-6z2sg" (UID: "9bf029e2-2742-493c-b99a-dc4660744827") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 08:55:06.009186 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:06.009128 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs podName:7589804c-eb08-481e-a23c-431f53d6e559 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:38.009122056 +0000 UTC m=+66.298572294 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs") pod "network-metrics-daemon-czllj" (UID: "7589804c-eb08-481e-a23c-431f53d6e559") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 08:55:06.240235 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:06.240211 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:55:06.240370 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:06.240217 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:55:06.240370 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:06.240290 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m448k" podUID="d5a0fba0-4c13-4592-a836-4f1f9d20c663" Jul 16 08:55:06.240451 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:06.240217 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:55:06.240451 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:06.240377 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-czllj" podUID="7589804c-eb08-481e-a23c-431f53d6e559" Jul 16 08:55:06.240539 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:06.240448 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6z2sg" podUID="9bf029e2-2742-493c-b99a-dc4660744827" Jul 16 08:55:08.080403 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.080330 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-31.ec2.internal" event="NodeReady" Jul 16 08:55:08.080948 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.080451 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 08:55:08.116021 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.115991 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7fdffc7fb-rkfxv"] Jul 16 08:55:08.118666 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.118647 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.122426 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.122403 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 16 08:55:08.122553 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.122442 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 16 08:55:08.122553 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.122524 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 16 08:55:08.122975 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.122953 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-certificates\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.123072 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.122994 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-bound-sa-token\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.123072 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.123025 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/908e56d4-2d21-4ce2-aecf-14845af0e5a5-installation-pull-secrets\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.123072 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.123061 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zggx9\"" Jul 16 08:55:08.123264 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.123060 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v77rc\" (UniqueName: \"kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-kube-api-access-v77rc\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.123264 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.123165 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/908e56d4-2d21-4ce2-aecf-14845af0e5a5-image-registry-private-configuration\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.123264 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.123194 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.123264 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.123243 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/908e56d4-2d21-4ce2-aecf-14845af0e5a5-ca-trust-extracted\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.123462 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.123273 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/908e56d4-2d21-4ce2-aecf-14845af0e5a5-trusted-ca\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.131873 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.131047 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 16 08:55:08.143784 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.143757 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jz65z"] Jul 16 08:55:08.145656 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.145635 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-75c9m"] Jul 16 08:55:08.145777 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.145758 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jz65z" Jul 16 08:55:08.147858 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.147840 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fdffc7fb-rkfxv"] Jul 16 08:55:08.147955 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.147933 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-75c9m" Jul 16 08:55:08.148779 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.148760 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 08:55:08.148941 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.148922 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 08:55:08.149064 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.148981 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8tdqp\"" Jul 16 08:55:08.149064 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.148988 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 08:55:08.150887 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.150866 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 08:55:08.151033 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.151013 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 08:55:08.151149 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.151052 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wm6pc\"" Jul 16 08:55:08.159193 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.159165 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jz65z"] Jul 16 08:55:08.165388 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.165371 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-75c9m"] Jul 16 08:55:08.224052 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.223879 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2176e0d-3fed-4101-9978-2794784b401f-tmp-dir\") pod \"dns-default-75c9m\" (UID: \"f2176e0d-3fed-4101-9978-2794784b401f\") " pod="openshift-dns/dns-default-75c9m" Jul 16 08:55:08.224183 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.224063 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b87a93e0-5fb5-4172-81ec-762bc4c51643-cert\") pod \"ingress-canary-jz65z\" (UID: \"b87a93e0-5fb5-4172-81ec-762bc4c51643\") " pod="openshift-ingress-canary/ingress-canary-jz65z" Jul 16 08:55:08.224183 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.224092 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-bound-sa-token\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.224183 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.224124 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/908e56d4-2d21-4ce2-aecf-14845af0e5a5-installation-pull-secrets\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.224338 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.224184 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mflsd\" (UniqueName: \"kubernetes.io/projected/f2176e0d-3fed-4101-9978-2794784b401f-kube-api-access-mflsd\") pod \"dns-default-75c9m\" (UID: \"f2176e0d-3fed-4101-9978-2794784b401f\") " pod="openshift-dns/dns-default-75c9m" Jul 16 08:55:08.224338 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.224226 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v77rc\" (UniqueName: \"kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-kube-api-access-v77rc\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.224338 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.224277 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/908e56d4-2d21-4ce2-aecf-14845af0e5a5-image-registry-private-configuration\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.224338 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.224303 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.224534 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.224388 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/908e56d4-2d21-4ce2-aecf-14845af0e5a5-ca-trust-extracted\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.224534 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:08.224402 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 08:55:08.224534 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:08.224416 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fdffc7fb-rkfxv: secret "image-registry-tls" not found Jul 16 08:55:08.224534 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.224430 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/908e56d4-2d21-4ce2-aecf-14845af0e5a5-trusted-ca\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.224534 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:08.224465 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls podName:908e56d4-2d21-4ce2-aecf-14845af0e5a5 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:08.724447362 +0000 UTC m=+37.013897615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls") pod "image-registry-7fdffc7fb-rkfxv" (UID: "908e56d4-2d21-4ce2-aecf-14845af0e5a5") : secret "image-registry-tls" not found Jul 16 08:55:08.224791 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.224596 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t84cm\" (UniqueName: \"kubernetes.io/projected/b87a93e0-5fb5-4172-81ec-762bc4c51643-kube-api-access-t84cm\") pod \"ingress-canary-jz65z\" (UID: \"b87a93e0-5fb5-4172-81ec-762bc4c51643\") " pod="openshift-ingress-canary/ingress-canary-jz65z" Jul 16 08:55:08.224791 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.224667 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-certificates\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.224791 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.224715 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f2176e0d-3fed-4101-9978-2794784b401f-config-volume\") pod \"dns-default-75c9m\" (UID: \"f2176e0d-3fed-4101-9978-2794784b401f\") " pod="openshift-dns/dns-default-75c9m" Jul 16 08:55:08.224791 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.224744 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls\") pod \"dns-default-75c9m\" (UID: \"f2176e0d-3fed-4101-9978-2794784b401f\") " pod="openshift-dns/dns-default-75c9m" Jul 16 08:55:08.224924 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.224794 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/908e56d4-2d21-4ce2-aecf-14845af0e5a5-ca-trust-extracted\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.225219 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.225185 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-certificates\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.225400 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.225379 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/908e56d4-2d21-4ce2-aecf-14845af0e5a5-trusted-ca\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.228511 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.228463 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/908e56d4-2d21-4ce2-aecf-14845af0e5a5-installation-pull-secrets\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.228590 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.228575 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/908e56d4-2d21-4ce2-aecf-14845af0e5a5-image-registry-private-configuration\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.235280 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.235261 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v77rc\" (UniqueName: \"kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-kube-api-access-v77rc\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.236690 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.236671 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-bound-sa-token\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.237656 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.237636 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:55:08.237732 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.237673 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:55:08.237769 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.237731 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:55:08.240253 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.240233 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 08:55:08.240253 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.240254 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rgclf\"" Jul 16 08:55:08.240530 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.240513 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 08:55:08.240659 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.240593 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 08:55:08.240829 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.240816 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s7ks4\"" Jul 16 08:55:08.240910 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.240849 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 08:55:08.303519 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.303489 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktm4b_81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7/konnectivity-agent/0.log" limit=1024 Jul 16 08:55:08.325658 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.325634 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t84cm\" (UniqueName: \"kubernetes.io/projected/b87a93e0-5fb5-4172-81ec-762bc4c51643-kube-api-access-t84cm\") pod \"ingress-canary-jz65z\" (UID: \"b87a93e0-5fb5-4172-81ec-762bc4c51643\") " pod="openshift-ingress-canary/ingress-canary-jz65z" Jul 16 08:55:08.325785 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.325687 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f2176e0d-3fed-4101-9978-2794784b401f-config-volume\") pod \"dns-default-75c9m\" (UID: \"f2176e0d-3fed-4101-9978-2794784b401f\") " pod="openshift-dns/dns-default-75c9m" Jul 16 08:55:08.325785 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.325714 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls\") pod \"dns-default-75c9m\" (UID: \"f2176e0d-3fed-4101-9978-2794784b401f\") " pod="openshift-dns/dns-default-75c9m" Jul 16 08:55:08.325785 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.325740 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2176e0d-3fed-4101-9978-2794784b401f-tmp-dir\") pod \"dns-default-75c9m\" (UID: \"f2176e0d-3fed-4101-9978-2794784b401f\") " pod="openshift-dns/dns-default-75c9m" Jul 16 08:55:08.325785 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.325764 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b87a93e0-5fb5-4172-81ec-762bc4c51643-cert\") pod \"ingress-canary-jz65z\" (UID: \"b87a93e0-5fb5-4172-81ec-762bc4c51643\") " pod="openshift-ingress-canary/ingress-canary-jz65z" Jul 16 08:55:08.325988 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:08.325857 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 08:55:08.325988 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.325885 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mflsd\" (UniqueName: \"kubernetes.io/projected/f2176e0d-3fed-4101-9978-2794784b401f-kube-api-access-mflsd\") pod \"dns-default-75c9m\" (UID: \"f2176e0d-3fed-4101-9978-2794784b401f\") " pod="openshift-dns/dns-default-75c9m" Jul 16 08:55:08.325988 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:08.325912 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls podName:f2176e0d-3fed-4101-9978-2794784b401f nodeName:}" failed. No retries permitted until 2026-07-16 08:55:08.825894871 +0000 UTC m=+37.115345114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls") pod "dns-default-75c9m" (UID: "f2176e0d-3fed-4101-9978-2794784b401f") : secret "dns-default-metrics-tls" not found Jul 16 08:55:08.326202 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.326176 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2176e0d-3fed-4101-9978-2794784b401f-tmp-dir\") pod \"dns-default-75c9m\" (UID: \"f2176e0d-3fed-4101-9978-2794784b401f\") " pod="openshift-dns/dns-default-75c9m" Jul 16 08:55:08.326451 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.326430 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f2176e0d-3fed-4101-9978-2794784b401f-config-volume\") pod \"dns-default-75c9m\" (UID: \"f2176e0d-3fed-4101-9978-2794784b401f\") " pod="openshift-dns/dns-default-75c9m" Jul 16 08:55:08.328742 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.328720 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b87a93e0-5fb5-4172-81ec-762bc4c51643-cert\") pod \"ingress-canary-jz65z\" (UID: \"b87a93e0-5fb5-4172-81ec-762bc4c51643\") " pod="openshift-ingress-canary/ingress-canary-jz65z" Jul 16 08:55:08.337159 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.337091 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t84cm\" (UniqueName: \"kubernetes.io/projected/b87a93e0-5fb5-4172-81ec-762bc4c51643-kube-api-access-t84cm\") pod \"ingress-canary-jz65z\" (UID: \"b87a93e0-5fb5-4172-81ec-762bc4c51643\") " pod="openshift-ingress-canary/ingress-canary-jz65z" Jul 16 08:55:08.337159 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.337080 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mflsd\" (UniqueName: \"kubernetes.io/projected/f2176e0d-3fed-4101-9978-2794784b401f-kube-api-access-mflsd\") pod \"dns-default-75c9m\" (UID: \"f2176e0d-3fed-4101-9978-2794784b401f\") " pod="openshift-dns/dns-default-75c9m" Jul 16 08:55:08.457349 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.457313 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jz65z" Jul 16 08:55:08.729307 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.729237 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:08.729457 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:08.729371 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 08:55:08.729457 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:08.729398 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fdffc7fb-rkfxv: secret "image-registry-tls" not found Jul 16 08:55:08.729562 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:08.729465 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls podName:908e56d4-2d21-4ce2-aecf-14845af0e5a5 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:09.729440204 +0000 UTC m=+38.018890456 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls") pod "image-registry-7fdffc7fb-rkfxv" (UID: "908e56d4-2d21-4ce2-aecf-14845af0e5a5") : secret "image-registry-tls" not found Jul 16 08:55:08.829935 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:08.829906 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls\") pod \"dns-default-75c9m\" (UID: \"f2176e0d-3fed-4101-9978-2794784b401f\") " pod="openshift-dns/dns-default-75c9m" Jul 16 08:55:08.830100 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:08.830078 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 08:55:08.830162 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:08.830153 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls podName:f2176e0d-3fed-4101-9978-2794784b401f nodeName:}" failed. No retries permitted until 2026-07-16 08:55:09.830133442 +0000 UTC m=+38.119583684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls") pod "dns-default-75c9m" (UID: "f2176e0d-3fed-4101-9978-2794784b401f") : secret "dns-default-metrics-tls" not found Jul 16 08:55:09.737502 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:09.737446 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:09.737841 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:09.737565 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 08:55:09.737841 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:09.737582 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fdffc7fb-rkfxv: secret "image-registry-tls" not found Jul 16 08:55:09.737841 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:09.737631 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls podName:908e56d4-2d21-4ce2-aecf-14845af0e5a5 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:11.73761638 +0000 UTC m=+40.027066618 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls") pod "image-registry-7fdffc7fb-rkfxv" (UID: "908e56d4-2d21-4ce2-aecf-14845af0e5a5") : secret "image-registry-tls" not found Jul 16 08:55:09.831738 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:09.831709 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jz65z"] Jul 16 08:55:09.835154 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:55:09.835129 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb87a93e0_5fb5_4172_81ec_762bc4c51643.slice/crio-94c05f9d76ff7f39d9ec66ca032506c9e673172880fd9b116de2e5b409101d9d WatchSource:0}: Error finding container 94c05f9d76ff7f39d9ec66ca032506c9e673172880fd9b116de2e5b409101d9d: Status 404 returned error can't find the container with id 94c05f9d76ff7f39d9ec66ca032506c9e673172880fd9b116de2e5b409101d9d Jul 16 08:55:09.838603 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:09.838582 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls\") pod \"dns-default-75c9m\" (UID: \"f2176e0d-3fed-4101-9978-2794784b401f\") " pod="openshift-dns/dns-default-75c9m" Jul 16 08:55:09.838700 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:09.838693 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 08:55:09.838748 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:09.838735 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls podName:f2176e0d-3fed-4101-9978-2794784b401f nodeName:}" failed. No retries permitted until 2026-07-16 08:55:11.838722026 +0000 UTC m=+40.128172264 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls") pod "dns-default-75c9m" (UID: "f2176e0d-3fed-4101-9978-2794784b401f") : secret "dns-default-metrics-tls" not found Jul 16 08:55:09.943683 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:09.943653 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktm4b_81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7/konnectivity-agent/0.log" limit=1024 Jul 16 08:55:10.501401 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:10.501372 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktm4b_81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7/konnectivity-agent/0.log" limit=1024 Jul 16 08:55:10.576148 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:10.576118 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jz65z" event={"ID":"b87a93e0-5fb5-4172-81ec-762bc4c51643","Type":"ContainerStarted","Data":"94c05f9d76ff7f39d9ec66ca032506c9e673172880fd9b116de2e5b409101d9d"} Jul 16 08:55:10.579287 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:10.579257 2559 generic.go:356] "Generic (PLEG): container finished" podID="b88636c3-8f04-4ea8-9753-bc53ee9e8aca" containerID="de3de7a73da587f64883ccb55c0948bc943c4b83002e077844b72ff03be2d39d" exitCode=0 Jul 16 08:55:10.579419 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:10.579294 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7tqv" event={"ID":"b88636c3-8f04-4ea8-9753-bc53ee9e8aca","Type":"ContainerDied","Data":"de3de7a73da587f64883ccb55c0948bc943c4b83002e077844b72ff03be2d39d"} Jul 16 08:55:10.610296 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:10.610245 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktm4b_81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7/konnectivity-agent/0.log" limit=1024 Jul 16 08:55:10.678537 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:10.678117 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktm4b_81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7/konnectivity-agent/0.log" limit=1024 Jul 16 08:55:11.484732 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:11.484695 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktm4b_81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7/konnectivity-agent/0.log" limit=1024 Jul 16 08:55:11.585245 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:11.585160 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktm4b_81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7/konnectivity-agent/0.log" limit=1024 Jul 16 08:55:11.585548 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:11.585519 2559 generic.go:356] "Generic (PLEG): container finished" podID="b88636c3-8f04-4ea8-9753-bc53ee9e8aca" containerID="c4ec6e9ba7d8aba46bf7b5516e168733ec1dbeaf262394480e815dded6d9df68" exitCode=0 Jul 16 08:55:11.585668 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:11.585588 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7tqv" event={"ID":"b88636c3-8f04-4ea8-9753-bc53ee9e8aca","Type":"ContainerDied","Data":"c4ec6e9ba7d8aba46bf7b5516e168733ec1dbeaf262394480e815dded6d9df68"} Jul 16 08:55:11.753698 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:11.753668 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:11.753854 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:11.753796 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 08:55:11.753854 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:11.753814 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fdffc7fb-rkfxv: secret "image-registry-tls" not found Jul 16 08:55:11.753953 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:11.753875 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls podName:908e56d4-2d21-4ce2-aecf-14845af0e5a5 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:15.753855495 +0000 UTC m=+44.043305752 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls") pod "image-registry-7fdffc7fb-rkfxv" (UID: "908e56d4-2d21-4ce2-aecf-14845af0e5a5") : secret "image-registry-tls" not found Jul 16 08:55:11.854951 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:11.854925 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls\") pod \"dns-default-75c9m\" (UID: \"f2176e0d-3fed-4101-9978-2794784b401f\") " pod="openshift-dns/dns-default-75c9m" Jul 16 08:55:11.855104 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:11.855065 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 08:55:11.855155 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:11.855130 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls podName:f2176e0d-3fed-4101-9978-2794784b401f nodeName:}" failed. No retries permitted until 2026-07-16 08:55:15.855112957 +0000 UTC m=+44.144563210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls") pod "dns-default-75c9m" (UID: "f2176e0d-3fed-4101-9978-2794784b401f") : secret "dns-default-metrics-tls" not found Jul 16 08:55:12.590764 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:12.590672 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x7tqv" event={"ID":"b88636c3-8f04-4ea8-9753-bc53ee9e8aca","Type":"ContainerStarted","Data":"e76bf694c8bcb67a2b64e960765c36393654aa696f607df5e586ccd9c711cde2"} Jul 16 08:55:12.613876 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:12.613835 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-x7tqv" podStartSLOduration=8.068700712 podStartE2EDuration="39.613822464s" totalImagesPullingTime="31.545121752s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:54:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:55:12.61227601 +0000 UTC m=+40.901726279" watchObservedRunningTime="2026-07-16 08:55:12.613822464 +0000 UTC m=+40.903272723" Jul 16 08:55:12.735957 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:12.735935 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktm4b_81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7/konnectivity-agent/0.log" limit=1024 Jul 16 08:55:12.836492 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:12.836445 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktm4b_81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7/konnectivity-agent/0.log" limit=1024 Jul 16 08:55:12.936046 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:12.935956 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktm4b_81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7/konnectivity-agent/0.log" limit=1024 Jul 16 08:55:13.073695 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:13.073635 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktm4b_81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7/konnectivity-agent/0.log" limit=1024 Jul 16 08:55:13.129758 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:13.129713 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktm4b_81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7/konnectivity-agent/0.log" limit=1024 Jul 16 08:55:13.428374 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:13.428349 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktm4b_81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7/konnectivity-agent/0.log" limit=1024 Jul 16 08:55:13.594334 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:13.594299 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jz65z" event={"ID":"b87a93e0-5fb5-4172-81ec-762bc4c51643","Type":"ContainerStarted","Data":"205f12392dc7d844c06cf786f346e0f30aac23de82a6f74ac07d6e73626b2227"} Jul 16 08:55:13.611213 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:13.611164 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jz65z" podStartSLOduration=2.722349512 podStartE2EDuration="5.611148089s" totalImagesPullingTime="2.888798577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:55:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:55:13.609448456 +0000 UTC m=+41.898898716" watchObservedRunningTime="2026-07-16 08:55:13.611148089 +0000 UTC m=+41.900598375" Jul 16 08:55:15.784911 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:15.784878 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:15.785374 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:15.785054 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 08:55:15.785374 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:15.785076 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fdffc7fb-rkfxv: secret "image-registry-tls" not found Jul 16 08:55:15.785374 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:15.785141 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls podName:908e56d4-2d21-4ce2-aecf-14845af0e5a5 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:23.78512036 +0000 UTC m=+52.074570613 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls") pod "image-registry-7fdffc7fb-rkfxv" (UID: "908e56d4-2d21-4ce2-aecf-14845af0e5a5") : secret "image-registry-tls" not found Jul 16 08:55:15.886142 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:15.886110 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls\") pod \"dns-default-75c9m\" (UID: \"f2176e0d-3fed-4101-9978-2794784b401f\") " pod="openshift-dns/dns-default-75c9m" Jul 16 08:55:15.886262 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:15.886245 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 08:55:15.886307 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:15.886298 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls podName:f2176e0d-3fed-4101-9978-2794784b401f nodeName:}" failed. No retries permitted until 2026-07-16 08:55:23.886285187 +0000 UTC m=+52.175735430 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls") pod "dns-default-75c9m" (UID: "f2176e0d-3fed-4101-9978-2794784b401f") : secret "dns-default-metrics-tls" not found Jul 16 08:55:22.752620 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:22.752588 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktm4b_81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7/konnectivity-agent/0.log" limit=1024 Jul 16 08:55:22.814384 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:22.814361 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktm4b_81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7/konnectivity-agent/0.log" limit=1024 Jul 16 08:55:23.841610 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:23.841572 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:23.841968 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:23.841708 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 08:55:23.841968 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:23.841725 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fdffc7fb-rkfxv: secret "image-registry-tls" not found Jul 16 08:55:23.841968 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:23.841797 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls podName:908e56d4-2d21-4ce2-aecf-14845af0e5a5 nodeName:}" failed. No retries permitted until 2026-07-16 08:55:39.841783335 +0000 UTC m=+68.131233598 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls") pod "image-registry-7fdffc7fb-rkfxv" (UID: "908e56d4-2d21-4ce2-aecf-14845af0e5a5") : secret "image-registry-tls" not found Jul 16 08:55:23.942829 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:23.942808 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls\") pod \"dns-default-75c9m\" (UID: \"f2176e0d-3fed-4101-9978-2794784b401f\") " pod="openshift-dns/dns-default-75c9m" Jul 16 08:55:23.942919 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:23.942900 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 08:55:23.942950 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:23.942943 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls podName:f2176e0d-3fed-4101-9978-2794784b401f nodeName:}" failed. No retries permitted until 2026-07-16 08:55:39.942929631 +0000 UTC m=+68.232379868 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls") pod "dns-default-75c9m" (UID: "f2176e0d-3fed-4101-9978-2794784b401f") : secret "dns-default-metrics-tls" not found Jul 16 08:55:26.663700 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:26.663670 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktm4b_81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7/konnectivity-agent/0.log" limit=1024 Jul 16 08:55:26.763325 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:26.763287 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ktm4b_81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7/konnectivity-agent/0.log" limit=1024 Jul 16 08:55:33.569524 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:33.569500 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sb2b7" Jul 16 08:55:38.043136 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:38.043097 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs\") pod \"network-metrics-daemon-czllj\" (UID: \"7589804c-eb08-481e-a23c-431f53d6e559\") " pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:55:38.043589 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:38.043155 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdd96\" (UniqueName: \"kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96\") pod \"network-check-target-6z2sg\" (UID: \"9bf029e2-2742-493c-b99a-dc4660744827\") " pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:55:38.043589 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:38.043183 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret\") pod \"global-pull-secret-syncer-m448k\" (UID: \"d5a0fba0-4c13-4592-a836-4f1f9d20c663\") " pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:55:38.045944 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:38.045925 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 08:55:38.046046 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:38.046030 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 08:55:38.046118 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:38.046064 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 08:55:38.054183 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:38.054161 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 16 08:55:38.054296 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:38.054218 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs podName:7589804c-eb08-481e-a23c-431f53d6e559 nodeName:}" failed. No retries permitted until 2026-07-16 08:56:42.054199796 +0000 UTC m=+130.343650033 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs") pod "network-metrics-daemon-czllj" (UID: "7589804c-eb08-481e-a23c-431f53d6e559") : secret "metrics-daemon-secret" not found Jul 16 08:55:38.056542 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:38.056528 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 08:55:38.057680 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:38.057661 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a0fba0-4c13-4592-a836-4f1f9d20c663-original-pull-secret\") pod \"global-pull-secret-syncer-m448k\" (UID: \"d5a0fba0-4c13-4592-a836-4f1f9d20c663\") " pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:55:38.066813 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:38.066793 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdd96\" (UniqueName: \"kubernetes.io/projected/9bf029e2-2742-493c-b99a-dc4660744827-kube-api-access-hdd96\") pod \"network-check-target-6z2sg\" (UID: \"9bf029e2-2742-493c-b99a-dc4660744827\") " pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:55:38.257284 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:38.257265 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rgclf\"" Jul 16 08:55:38.261521 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:38.261510 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m448k" Jul 16 08:55:38.265193 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:38.265173 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:55:38.427513 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:38.427465 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6z2sg"] Jul 16 08:55:38.430178 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:55:38.430153 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bf029e2_2742_493c_b99a_dc4660744827.slice/crio-89c9dd68bb502315a9f66845a21d70e46e037b7216f9c3f6af650a61c999911f WatchSource:0}: Error finding container 89c9dd68bb502315a9f66845a21d70e46e037b7216f9c3f6af650a61c999911f: Status 404 returned error can't find the container with id 89c9dd68bb502315a9f66845a21d70e46e037b7216f9c3f6af650a61c999911f Jul 16 08:55:38.434241 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:38.434220 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m448k"] Jul 16 08:55:38.437399 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:55:38.437370 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a0fba0_4c13_4592_a836_4f1f9d20c663.slice/crio-1cfe107bde9daab7694d9ef0955595804a0b7a7db29d5028940da3edae50cebb WatchSource:0}: Error finding container 1cfe107bde9daab7694d9ef0955595804a0b7a7db29d5028940da3edae50cebb: Status 404 returned error can't find the container with id 1cfe107bde9daab7694d9ef0955595804a0b7a7db29d5028940da3edae50cebb Jul 16 08:55:38.652578 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:38.652500 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6z2sg" event={"ID":"9bf029e2-2742-493c-b99a-dc4660744827","Type":"ContainerStarted","Data":"89c9dd68bb502315a9f66845a21d70e46e037b7216f9c3f6af650a61c999911f"} Jul 16 08:55:38.653775 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:38.653733 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m448k" event={"ID":"d5a0fba0-4c13-4592-a836-4f1f9d20c663","Type":"ContainerStarted","Data":"1cfe107bde9daab7694d9ef0955595804a0b7a7db29d5028940da3edae50cebb"} Jul 16 08:55:39.854311 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:39.854274 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:55:39.854984 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:39.854411 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 08:55:39.854984 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:39.854426 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fdffc7fb-rkfxv: secret "image-registry-tls" not found Jul 16 08:55:39.854984 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:39.854500 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls podName:908e56d4-2d21-4ce2-aecf-14845af0e5a5 nodeName:}" failed. No retries permitted until 2026-07-16 08:56:11.854462223 +0000 UTC m=+100.143912480 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls") pod "image-registry-7fdffc7fb-rkfxv" (UID: "908e56d4-2d21-4ce2-aecf-14845af0e5a5") : secret "image-registry-tls" not found Jul 16 08:55:39.955524 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:39.955486 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls\") pod \"dns-default-75c9m\" (UID: \"f2176e0d-3fed-4101-9978-2794784b401f\") " pod="openshift-dns/dns-default-75c9m" Jul 16 08:55:39.955679 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:39.955622 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 08:55:39.955679 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:39.955678 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls podName:f2176e0d-3fed-4101-9978-2794784b401f nodeName:}" failed. No retries permitted until 2026-07-16 08:56:11.955660735 +0000 UTC m=+100.245110975 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls") pod "dns-default-75c9m" (UID: "f2176e0d-3fed-4101-9978-2794784b401f") : secret "dns-default-metrics-tls" not found Jul 16 08:55:44.672684 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:44.672634 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6z2sg" event={"ID":"9bf029e2-2742-493c-b99a-dc4660744827","Type":"ContainerStarted","Data":"5118f8cb3f737c8500c858ca55247a2c109270edd318757816ce7f9eab78dda3"} Jul 16 08:55:44.673164 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:44.672724 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:55:44.674087 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:44.674064 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m448k" event={"ID":"d5a0fba0-4c13-4592-a836-4f1f9d20c663","Type":"ContainerStarted","Data":"c81878147d94b882ace901ba74e8dee5a4502fb3467158db61f48172f4110ba0"} Jul 16 08:55:44.712737 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:44.712680 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6z2sg" podStartSLOduration=66.475994186 podStartE2EDuration="1m11.712668022s" totalImagesPullingTime="5.236673836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:55:44.693818391 +0000 UTC m=+72.983268653" watchObservedRunningTime="2026-07-16 08:55:44.712668022 +0000 UTC m=+73.002118273" Jul 16 08:55:44.712988 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:44.712960 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-m448k" podStartSLOduration=66.468208246 podStartE2EDuration="1m11.712955372s" totalImagesPullingTime="5.244747126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:55:44.712638077 +0000 UTC m=+73.002088335" watchObservedRunningTime="2026-07-16 08:55:44.712955372 +0000 UTC m=+73.002405632" Jul 16 08:55:46.782292 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:46.782267 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-sxhqk"] Jul 16 08:55:46.783887 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:46.783872 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-sxhqk" Jul 16 08:55:46.786380 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:46.786355 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 16 08:55:46.787617 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:46.786549 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 16 08:55:46.790933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:46.790914 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 16 08:55:46.790933 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:46.790929 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 16 08:55:46.791068 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:46.791005 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-mr4qk\"" Jul 16 08:55:46.792107 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:46.792091 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 16 08:55:46.795358 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:46.795337 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-sxhqk"] Jul 16 08:55:46.881407 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:46.881383 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-7lvrl"] Jul 16 08:55:46.883267 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:46.883249 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-7lvrl" Jul 16 08:55:46.885718 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:46.885698 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-x2gww\"" Jul 16 08:55:46.899507 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:46.899456 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-7lvrl"] Jul 16 08:55:46.905988 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:46.905970 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc91df41-e89e-4bbc-9a7c-9ffff3904a71-serving-cert\") pod \"console-operator-7866497494-sxhqk\" (UID: \"dc91df41-e89e-4bbc-9a7c-9ffff3904a71\") " pod="openshift-console-operator/console-operator-7866497494-sxhqk" Jul 16 08:55:46.906098 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:46.905997 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc91df41-e89e-4bbc-9a7c-9ffff3904a71-config\") pod \"console-operator-7866497494-sxhqk\" (UID: \"dc91df41-e89e-4bbc-9a7c-9ffff3904a71\") " pod="openshift-console-operator/console-operator-7866497494-sxhqk" Jul 16 08:55:46.906098 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:46.906049 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrdzk\" (UniqueName: \"kubernetes.io/projected/dc91df41-e89e-4bbc-9a7c-9ffff3904a71-kube-api-access-jrdzk\") pod \"console-operator-7866497494-sxhqk\" (UID: \"dc91df41-e89e-4bbc-9a7c-9ffff3904a71\") " pod="openshift-console-operator/console-operator-7866497494-sxhqk" Jul 16 08:55:46.906171 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:46.906143 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc91df41-e89e-4bbc-9a7c-9ffff3904a71-trusted-ca\") pod \"console-operator-7866497494-sxhqk\" (UID: \"dc91df41-e89e-4bbc-9a7c-9ffff3904a71\") " pod="openshift-console-operator/console-operator-7866497494-sxhqk" Jul 16 08:55:47.007281 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:47.007254 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mxhg\" (UniqueName: \"kubernetes.io/projected/4a323d0f-19ac-4d6f-828f-8b3720613784-kube-api-access-5mxhg\") pod \"network-check-source-869dcfcdcd-7lvrl\" (UID: \"4a323d0f-19ac-4d6f-828f-8b3720613784\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-7lvrl" Jul 16 08:55:47.007374 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:47.007318 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc91df41-e89e-4bbc-9a7c-9ffff3904a71-trusted-ca\") pod \"console-operator-7866497494-sxhqk\" (UID: \"dc91df41-e89e-4bbc-9a7c-9ffff3904a71\") " pod="openshift-console-operator/console-operator-7866497494-sxhqk" Jul 16 08:55:47.007374 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:47.007346 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc91df41-e89e-4bbc-9a7c-9ffff3904a71-serving-cert\") pod \"console-operator-7866497494-sxhqk\" (UID: \"dc91df41-e89e-4bbc-9a7c-9ffff3904a71\") " pod="openshift-console-operator/console-operator-7866497494-sxhqk" Jul 16 08:55:47.007374 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:47.007366 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc91df41-e89e-4bbc-9a7c-9ffff3904a71-config\") pod \"console-operator-7866497494-sxhqk\" (UID: \"dc91df41-e89e-4bbc-9a7c-9ffff3904a71\") " pod="openshift-console-operator/console-operator-7866497494-sxhqk" Jul 16 08:55:47.007523 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:47.007393 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrdzk\" (UniqueName: \"kubernetes.io/projected/dc91df41-e89e-4bbc-9a7c-9ffff3904a71-kube-api-access-jrdzk\") pod \"console-operator-7866497494-sxhqk\" (UID: \"dc91df41-e89e-4bbc-9a7c-9ffff3904a71\") " pod="openshift-console-operator/console-operator-7866497494-sxhqk" Jul 16 08:55:47.008059 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:47.008029 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dc91df41-e89e-4bbc-9a7c-9ffff3904a71-config\") pod \"console-operator-7866497494-sxhqk\" (UID: \"dc91df41-e89e-4bbc-9a7c-9ffff3904a71\") " pod="openshift-console-operator/console-operator-7866497494-sxhqk" Jul 16 08:55:47.008307 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:47.008290 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dc91df41-e89e-4bbc-9a7c-9ffff3904a71-trusted-ca\") pod \"console-operator-7866497494-sxhqk\" (UID: \"dc91df41-e89e-4bbc-9a7c-9ffff3904a71\") " pod="openshift-console-operator/console-operator-7866497494-sxhqk" Jul 16 08:55:47.009737 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:47.009720 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dc91df41-e89e-4bbc-9a7c-9ffff3904a71-serving-cert\") pod \"console-operator-7866497494-sxhqk\" (UID: \"dc91df41-e89e-4bbc-9a7c-9ffff3904a71\") " pod="openshift-console-operator/console-operator-7866497494-sxhqk" Jul 16 08:55:47.016463 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:47.016445 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrdzk\" (UniqueName: \"kubernetes.io/projected/dc91df41-e89e-4bbc-9a7c-9ffff3904a71-kube-api-access-jrdzk\") pod \"console-operator-7866497494-sxhqk\" (UID: \"dc91df41-e89e-4bbc-9a7c-9ffff3904a71\") " pod="openshift-console-operator/console-operator-7866497494-sxhqk" Jul 16 08:55:47.095277 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:47.095204 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-sxhqk" Jul 16 08:55:47.108459 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:47.108435 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mxhg\" (UniqueName: \"kubernetes.io/projected/4a323d0f-19ac-4d6f-828f-8b3720613784-kube-api-access-5mxhg\") pod \"network-check-source-869dcfcdcd-7lvrl\" (UID: \"4a323d0f-19ac-4d6f-828f-8b3720613784\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-7lvrl" Jul 16 08:55:47.119974 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:47.119949 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mxhg\" (UniqueName: \"kubernetes.io/projected/4a323d0f-19ac-4d6f-828f-8b3720613784-kube-api-access-5mxhg\") pod \"network-check-source-869dcfcdcd-7lvrl\" (UID: \"4a323d0f-19ac-4d6f-828f-8b3720613784\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-7lvrl" Jul 16 08:55:47.191370 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:47.191348 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-7lvrl" Jul 16 08:55:47.224973 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:47.224948 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-sxhqk"] Jul 16 08:55:47.227923 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:55:47.227897 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc91df41_e89e_4bbc_9a7c_9ffff3904a71.slice/crio-2a2dd092e97ae6d7ea224ae84a403df1e74e3fba06a9a565c9afa3fb89c646a1 WatchSource:0}: Error finding container 2a2dd092e97ae6d7ea224ae84a403df1e74e3fba06a9a565c9afa3fb89c646a1: Status 404 returned error can't find the container with id 2a2dd092e97ae6d7ea224ae84a403df1e74e3fba06a9a565c9afa3fb89c646a1 Jul 16 08:55:47.317921 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:47.317891 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-7lvrl"] Jul 16 08:55:47.320609 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:55:47.320582 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a323d0f_19ac_4d6f_828f_8b3720613784.slice/crio-c99f4f1cad1fdcb2ab0fe28b3930205829814753fd7acff124ee3cf9ede2c543 WatchSource:0}: Error finding container c99f4f1cad1fdcb2ab0fe28b3930205829814753fd7acff124ee3cf9ede2c543: Status 404 returned error can't find the container with id c99f4f1cad1fdcb2ab0fe28b3930205829814753fd7acff124ee3cf9ede2c543 Jul 16 08:55:47.682613 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:47.682544 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-sxhqk" event={"ID":"dc91df41-e89e-4bbc-9a7c-9ffff3904a71","Type":"ContainerStarted","Data":"2a2dd092e97ae6d7ea224ae84a403df1e74e3fba06a9a565c9afa3fb89c646a1"} Jul 16 08:55:47.684041 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:47.684011 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-7lvrl" event={"ID":"4a323d0f-19ac-4d6f-828f-8b3720613784","Type":"ContainerStarted","Data":"794be89aa7c0ff0d22128dceaf9f45b008d3f5a60b8a892db9a69ea9e074074d"} Jul 16 08:55:47.684149 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:47.684055 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-7lvrl" event={"ID":"4a323d0f-19ac-4d6f-828f-8b3720613784","Type":"ContainerStarted","Data":"c99f4f1cad1fdcb2ab0fe28b3930205829814753fd7acff124ee3cf9ede2c543"} Jul 16 08:55:47.702987 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:47.702940 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-7lvrl" podStartSLOduration=1.702928242 podStartE2EDuration="1.702928242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:55:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:55:47.702584409 +0000 UTC m=+75.992034670" watchObservedRunningTime="2026-07-16 08:55:47.702928242 +0000 UTC m=+75.992378501" Jul 16 08:55:49.693038 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:49.692985 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/0.log" Jul 16 08:55:49.693038 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:49.693023 2559 generic.go:356] "Generic (PLEG): container finished" podID="dc91df41-e89e-4bbc-9a7c-9ffff3904a71" containerID="39e91c3bc9d9835fa56e775ce27c6e2058a0c4f8b0e2c354d54a5439aaa21d63" exitCode=255 Jul 16 08:55:49.693373 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:49.693056 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-sxhqk" event={"ID":"dc91df41-e89e-4bbc-9a7c-9ffff3904a71","Type":"ContainerDied","Data":"39e91c3bc9d9835fa56e775ce27c6e2058a0c4f8b0e2c354d54a5439aaa21d63"} Jul 16 08:55:49.693373 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:49.693243 2559 scope.go:117] "RemoveContainer" containerID="39e91c3bc9d9835fa56e775ce27c6e2058a0c4f8b0e2c354d54a5439aaa21d63" Jul 16 08:55:50.697972 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:50.697945 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/1.log" Jul 16 08:55:50.698392 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:50.698376 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/0.log" Jul 16 08:55:50.698456 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:50.698411 2559 generic.go:356] "Generic (PLEG): container finished" podID="dc91df41-e89e-4bbc-9a7c-9ffff3904a71" containerID="d44565be2fca89bc967abe087b32947238f88afa5229f5ff4d0958f028eb9526" exitCode=255 Jul 16 08:55:50.698527 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:50.698490 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-sxhqk" event={"ID":"dc91df41-e89e-4bbc-9a7c-9ffff3904a71","Type":"ContainerDied","Data":"d44565be2fca89bc967abe087b32947238f88afa5229f5ff4d0958f028eb9526"} Jul 16 08:55:50.698580 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:50.698537 2559 scope.go:117] "RemoveContainer" containerID="39e91c3bc9d9835fa56e775ce27c6e2058a0c4f8b0e2c354d54a5439aaa21d63" Jul 16 08:55:50.698747 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:50.698728 2559 scope.go:117] "RemoveContainer" containerID="d44565be2fca89bc967abe087b32947238f88afa5229f5ff4d0958f028eb9526" Jul 16 08:55:50.698905 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:50.698883 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-sxhqk_openshift-console-operator(dc91df41-e89e-4bbc-9a7c-9ffff3904a71)\"" pod="openshift-console-operator/console-operator-7866497494-sxhqk" podUID="dc91df41-e89e-4bbc-9a7c-9ffff3904a71" Jul 16 08:55:51.702539 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:51.702517 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/1.log" Jul 16 08:55:51.702871 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:51.702817 2559 scope.go:117] "RemoveContainer" containerID="d44565be2fca89bc967abe087b32947238f88afa5229f5ff4d0958f028eb9526" Jul 16 08:55:51.702968 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:51.702950 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-sxhqk_openshift-console-operator(dc91df41-e89e-4bbc-9a7c-9ffff3904a71)\"" pod="openshift-console-operator/console-operator-7866497494-sxhqk" podUID="dc91df41-e89e-4bbc-9a7c-9ffff3904a71" Jul 16 08:55:51.860443 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:51.860419 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wxss2"] Jul 16 08:55:51.862252 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:51.862233 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:55:51.864912 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:51.864895 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 08:55:51.865005 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:51.864914 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-b8kz8\"" Jul 16 08:55:51.865005 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:51.864958 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 08:55:51.865005 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:51.864994 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 08:55:51.865156 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:51.865020 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 08:55:51.875211 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:51.875184 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wxss2"] Jul 16 08:55:51.945742 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:51.945717 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:55:51.945842 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:51.945755 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-crio-socket\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:55:51.945842 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:51.945775 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:55:51.945842 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:51.945793 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mchg\" (UniqueName: \"kubernetes.io/projected/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-kube-api-access-2mchg\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:55:51.945842 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:51.945814 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-data-volume\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:55:52.046242 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:52.046220 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:55:52.046318 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:52.046257 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-crio-socket\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:55:52.046318 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:52.046275 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:55:52.046318 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:52.046293 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mchg\" (UniqueName: \"kubernetes.io/projected/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-kube-api-access-2mchg\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:55:52.046411 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:52.046350 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-crio-socket\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:55:52.046411 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:52.046354 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 08:55:52.046411 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:52.046384 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-data-volume\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:55:52.046528 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:52.046420 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-kube-rbac-proxy-cm podName:0335dcfb-5b7b-4a9e-a618-346f4b7a662f nodeName:}" failed. No retries permitted until 2026-07-16 08:55:52.546406104 +0000 UTC m=+80.835856362 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wxss2" (UID: "0335dcfb-5b7b-4a9e-a618-346f4b7a662f") : configmap "kube-rbac-proxy" not found Jul 16 08:55:52.046528 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:52.046359 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 08:55:52.046528 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:52.046494 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-insights-runtime-extractor-tls podName:0335dcfb-5b7b-4a9e-a618-346f4b7a662f nodeName:}" failed. No retries permitted until 2026-07-16 08:55:52.546461095 +0000 UTC m=+80.835911359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wxss2" (UID: "0335dcfb-5b7b-4a9e-a618-346f4b7a662f") : secret "insights-runtime-extractor-tls" not found Jul 16 08:55:52.046652 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:52.046637 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-data-volume\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:55:52.056200 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:52.056182 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mchg\" (UniqueName: \"kubernetes.io/projected/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-kube-api-access-2mchg\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:55:52.550744 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:52.550713 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:55:52.550868 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:52.550759 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:55:52.550868 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:52.550831 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 08:55:52.550868 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:52.550857 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 08:55:52.550983 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:52.550880 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-kube-rbac-proxy-cm podName:0335dcfb-5b7b-4a9e-a618-346f4b7a662f nodeName:}" failed. No retries permitted until 2026-07-16 08:55:53.550868109 +0000 UTC m=+81.840318348 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wxss2" (UID: "0335dcfb-5b7b-4a9e-a618-346f4b7a662f") : configmap "kube-rbac-proxy" not found Jul 16 08:55:52.550983 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:52.550908 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-insights-runtime-extractor-tls podName:0335dcfb-5b7b-4a9e-a618-346f4b7a662f nodeName:}" failed. No retries permitted until 2026-07-16 08:55:53.550896512 +0000 UTC m=+81.840346752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wxss2" (UID: "0335dcfb-5b7b-4a9e-a618-346f4b7a662f") : secret "insights-runtime-extractor-tls" not found Jul 16 08:55:52.755915 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:52.755888 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qz9qt"] Jul 16 08:55:52.757842 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:52.757827 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qz9qt" Jul 16 08:55:52.760233 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:52.760214 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 16 08:55:52.761213 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:52.761195 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 16 08:55:52.761264 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:52.761230 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-bl4wv\"" Jul 16 08:55:52.769017 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:52.768997 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qz9qt"] Jul 16 08:55:52.853486 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:52.853419 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wtws\" (UniqueName: \"kubernetes.io/projected/0123f994-7643-473c-a1e4-dfcfd3296b15-kube-api-access-8wtws\") pod \"migrator-7f59b54f6c-qz9qt\" (UID: \"0123f994-7643-473c-a1e4-dfcfd3296b15\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qz9qt" Jul 16 08:55:52.954267 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:52.954235 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wtws\" (UniqueName: \"kubernetes.io/projected/0123f994-7643-473c-a1e4-dfcfd3296b15-kube-api-access-8wtws\") pod \"migrator-7f59b54f6c-qz9qt\" (UID: \"0123f994-7643-473c-a1e4-dfcfd3296b15\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qz9qt" Jul 16 08:55:52.965992 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:52.965965 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wtws\" (UniqueName: \"kubernetes.io/projected/0123f994-7643-473c-a1e4-dfcfd3296b15-kube-api-access-8wtws\") pod \"migrator-7f59b54f6c-qz9qt\" (UID: \"0123f994-7643-473c-a1e4-dfcfd3296b15\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qz9qt" Jul 16 08:55:53.066421 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:53.066394 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qz9qt" Jul 16 08:55:53.187021 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:53.186977 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qz9qt"] Jul 16 08:55:53.189269 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:55:53.189244 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0123f994_7643_473c_a1e4_dfcfd3296b15.slice/crio-4359f8f1cc084de02d7fdc32769a26c430c649cf1349f89cdb7612fb48d08298 WatchSource:0}: Error finding container 4359f8f1cc084de02d7fdc32769a26c430c649cf1349f89cdb7612fb48d08298: Status 404 returned error can't find the container with id 4359f8f1cc084de02d7fdc32769a26c430c649cf1349f89cdb7612fb48d08298 Jul 16 08:55:53.559620 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:53.559458 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:55:53.559620 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:53.559555 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:55:53.559620 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:53.559614 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 08:55:53.559849 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:53.559663 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 08:55:53.559849 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:53.559678 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-insights-runtime-extractor-tls podName:0335dcfb-5b7b-4a9e-a618-346f4b7a662f nodeName:}" failed. No retries permitted until 2026-07-16 08:55:55.559662332 +0000 UTC m=+83.849112572 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wxss2" (UID: "0335dcfb-5b7b-4a9e-a618-346f4b7a662f") : secret "insights-runtime-extractor-tls" not found Jul 16 08:55:53.559849 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:53.559712 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-kube-rbac-proxy-cm podName:0335dcfb-5b7b-4a9e-a618-346f4b7a662f nodeName:}" failed. No retries permitted until 2026-07-16 08:55:55.559696928 +0000 UTC m=+83.849147165 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wxss2" (UID: "0335dcfb-5b7b-4a9e-a618-346f4b7a662f") : configmap "kube-rbac-proxy" not found Jul 16 08:55:53.657098 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:53.657048 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-46vpz_b2eb4d12-f3cb-47eb-8b13-12c907658c4e/dns-node-resolver/0.log" Jul 16 08:55:53.709652 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:53.709625 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qz9qt" event={"ID":"0123f994-7643-473c-a1e4-dfcfd3296b15","Type":"ContainerStarted","Data":"4359f8f1cc084de02d7fdc32769a26c430c649cf1349f89cdb7612fb48d08298"} Jul 16 08:55:54.715024 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:54.714956 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qz9qt" event={"ID":"0123f994-7643-473c-a1e4-dfcfd3296b15","Type":"ContainerStarted","Data":"f0af1327a913f7731844867ec8e7b81fd5a0320d45ae37d73037c8a78e7ced93"} Jul 16 08:55:54.715024 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:54.715018 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qz9qt" event={"ID":"0123f994-7643-473c-a1e4-dfcfd3296b15","Type":"ContainerStarted","Data":"dd0486f9a807c2004498fcd00152d5894298c3983d981acb6781189b4f151aca"} Jul 16 08:55:54.747989 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:54.747932 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-qz9qt" podStartSLOduration=1.596997921 podStartE2EDuration="2.747919558s" totalImagesPullingTime="1.150921637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:55:54.747729607 +0000 UTC m=+83.037179866" watchObservedRunningTime="2026-07-16 08:55:54.747919558 +0000 UTC m=+83.037369810" Jul 16 08:55:54.859197 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:54.859179 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bmrd2_ca239b38-b1b7-410e-9ef2-2de2ea8c432f/node-ca/0.log" Jul 16 08:55:55.574075 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:55.574045 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:55:55.574210 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:55.574109 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:55:55.574210 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:55.574155 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 08:55:55.574283 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:55.574211 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-kube-rbac-proxy-cm podName:0335dcfb-5b7b-4a9e-a618-346f4b7a662f nodeName:}" failed. No retries permitted until 2026-07-16 08:55:59.574197098 +0000 UTC m=+87.863647358 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wxss2" (UID: "0335dcfb-5b7b-4a9e-a618-346f4b7a662f") : configmap "kube-rbac-proxy" not found Jul 16 08:55:55.574283 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:55.574213 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 08:55:55.574283 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:55.574258 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-insights-runtime-extractor-tls podName:0335dcfb-5b7b-4a9e-a618-346f4b7a662f nodeName:}" failed. No retries permitted until 2026-07-16 08:55:59.574246667 +0000 UTC m=+87.863696904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wxss2" (UID: "0335dcfb-5b7b-4a9e-a618-346f4b7a662f") : secret "insights-runtime-extractor-tls" not found Jul 16 08:55:55.657965 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:55.657943 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jz65z_b87a93e0-5fb5-4172-81ec-762bc4c51643/serve-healthcheck-canary/0.log" Jul 16 08:55:57.095595 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:57.095554 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-sxhqk" Jul 16 08:55:57.095966 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:57.095615 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-sxhqk" Jul 16 08:55:57.095966 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:57.095887 2559 scope.go:117] "RemoveContainer" containerID="d44565be2fca89bc967abe087b32947238f88afa5229f5ff4d0958f028eb9526" Jul 16 08:55:57.096038 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:57.096010 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-sxhqk_openshift-console-operator(dc91df41-e89e-4bbc-9a7c-9ffff3904a71)\"" pod="openshift-console-operator/console-operator-7866497494-sxhqk" podUID="dc91df41-e89e-4bbc-9a7c-9ffff3904a71" Jul 16 08:55:59.602617 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:59.602575 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:55:59.602617 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:55:59.602631 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:55:59.603099 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:59.602705 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 08:55:59.603099 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:59.602714 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 08:55:59.603099 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:59.602757 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-kube-rbac-proxy-cm podName:0335dcfb-5b7b-4a9e-a618-346f4b7a662f nodeName:}" failed. No retries permitted until 2026-07-16 08:56:07.602743436 +0000 UTC m=+95.892193673 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wxss2" (UID: "0335dcfb-5b7b-4a9e-a618-346f4b7a662f") : configmap "kube-rbac-proxy" not found Jul 16 08:55:59.603099 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:55:59.602787 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-insights-runtime-extractor-tls podName:0335dcfb-5b7b-4a9e-a618-346f4b7a662f nodeName:}" failed. No retries permitted until 2026-07-16 08:56:07.60276382 +0000 UTC m=+95.892214058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wxss2" (UID: "0335dcfb-5b7b-4a9e-a618-346f4b7a662f") : secret "insights-runtime-extractor-tls" not found Jul 16 08:56:07.659910 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:07.659874 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:56:07.660317 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:07.659923 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:56:07.660317 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:56:07.660023 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 08:56:07.660317 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:56:07.660089 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-insights-runtime-extractor-tls podName:0335dcfb-5b7b-4a9e-a618-346f4b7a662f nodeName:}" failed. No retries permitted until 2026-07-16 08:56:23.660074017 +0000 UTC m=+111.949524254 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wxss2" (UID: "0335dcfb-5b7b-4a9e-a618-346f4b7a662f") : secret "insights-runtime-extractor-tls" not found Jul 16 08:56:07.660427 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:07.660406 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:56:08.237440 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:08.237414 2559 scope.go:117] "RemoveContainer" containerID="d44565be2fca89bc967abe087b32947238f88afa5229f5ff4d0958f028eb9526" Jul 16 08:56:08.762985 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:08.762956 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/2.log" Jul 16 08:56:08.763420 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:08.763383 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/1.log" Jul 16 08:56:08.763514 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:08.763420 2559 generic.go:356] "Generic (PLEG): container finished" podID="dc91df41-e89e-4bbc-9a7c-9ffff3904a71" containerID="832698219bb312ada1efdfaa2ba208c7fa41ab492d87c5612337ca97827a9ba8" exitCode=255 Jul 16 08:56:08.763514 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:08.763492 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-sxhqk" event={"ID":"dc91df41-e89e-4bbc-9a7c-9ffff3904a71","Type":"ContainerDied","Data":"832698219bb312ada1efdfaa2ba208c7fa41ab492d87c5612337ca97827a9ba8"} Jul 16 08:56:08.763606 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:08.763564 2559 scope.go:117] "RemoveContainer" containerID="d44565be2fca89bc967abe087b32947238f88afa5229f5ff4d0958f028eb9526" Jul 16 08:56:08.763833 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:08.763818 2559 scope.go:117] "RemoveContainer" containerID="832698219bb312ada1efdfaa2ba208c7fa41ab492d87c5612337ca97827a9ba8" Jul 16 08:56:08.763998 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:56:08.763981 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-sxhqk_openshift-console-operator(dc91df41-e89e-4bbc-9a7c-9ffff3904a71)\"" pod="openshift-console-operator/console-operator-7866497494-sxhqk" podUID="dc91df41-e89e-4bbc-9a7c-9ffff3904a71" Jul 16 08:56:09.767628 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:09.767602 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/2.log" Jul 16 08:56:11.891061 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:11.891022 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:56:11.893349 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:11.893330 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls\") pod \"image-registry-7fdffc7fb-rkfxv\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:56:11.991626 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:11.991597 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls\") pod \"dns-default-75c9m\" (UID: \"f2176e0d-3fed-4101-9978-2794784b401f\") " pod="openshift-dns/dns-default-75c9m" Jul 16 08:56:11.993743 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:11.993726 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2176e0d-3fed-4101-9978-2794784b401f-metrics-tls\") pod \"dns-default-75c9m\" (UID: \"f2176e0d-3fed-4101-9978-2794784b401f\") " pod="openshift-dns/dns-default-75c9m" Jul 16 08:56:12.033638 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:12.033616 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zggx9\"" Jul 16 08:56:12.041705 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:12.041684 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:56:12.066416 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:12.066395 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wm6pc\"" Jul 16 08:56:12.074610 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:12.074590 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-75c9m" Jul 16 08:56:12.179630 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:12.179602 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fdffc7fb-rkfxv"] Jul 16 08:56:12.183399 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:56:12.183372 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod908e56d4_2d21_4ce2_aecf_14845af0e5a5.slice/crio-970c6556814177e8094bead29fb52eab0c0a4b78c404336578971fd42530fec3 WatchSource:0}: Error finding container 970c6556814177e8094bead29fb52eab0c0a4b78c404336578971fd42530fec3: Status 404 returned error can't find the container with id 970c6556814177e8094bead29fb52eab0c0a4b78c404336578971fd42530fec3 Jul 16 08:56:12.209409 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:12.209385 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-75c9m"] Jul 16 08:56:12.216397 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:56:12.216367 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2176e0d_3fed_4101_9978_2794784b401f.slice/crio-3b8bb8974f43829d8fd169e06c02db325b322e84a55205c4a8c9431cad885abe WatchSource:0}: Error finding container 3b8bb8974f43829d8fd169e06c02db325b322e84a55205c4a8c9431cad885abe: Status 404 returned error can't find the container with id 3b8bb8974f43829d8fd169e06c02db325b322e84a55205c4a8c9431cad885abe Jul 16 08:56:12.777880 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:12.777845 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" event={"ID":"908e56d4-2d21-4ce2-aecf-14845af0e5a5","Type":"ContainerStarted","Data":"c88174e3e17aa76f9f808bcb0d56e92eac611f7fb4db3ded23b110caa18fe78e"} Jul 16 08:56:12.778109 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:12.777915 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" event={"ID":"908e56d4-2d21-4ce2-aecf-14845af0e5a5","Type":"ContainerStarted","Data":"970c6556814177e8094bead29fb52eab0c0a4b78c404336578971fd42530fec3"} Jul 16 08:56:12.778109 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:12.777961 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:56:12.780966 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:12.780943 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-75c9m" event={"ID":"f2176e0d-3fed-4101-9978-2794784b401f","Type":"ContainerStarted","Data":"3b8bb8974f43829d8fd169e06c02db325b322e84a55205c4a8c9431cad885abe"} Jul 16 08:56:14.788666 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:14.788629 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-75c9m" event={"ID":"f2176e0d-3fed-4101-9978-2794784b401f","Type":"ContainerStarted","Data":"4f47af14cd2eaa1b2384ee152233c6af7a753974bdc941543b3e1da7b21a3a55"} Jul 16 08:56:14.789058 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:14.788687 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-75c9m" event={"ID":"f2176e0d-3fed-4101-9978-2794784b401f","Type":"ContainerStarted","Data":"c6bdbb58edecd2340aeab017e7ab531b9dfa64826914f0716efb3f4ce648679f"} Jul 16 08:56:14.789058 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:14.788755 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-75c9m" Jul 16 08:56:14.809955 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:14.809914 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" podStartSLOduration=101.809902332 podStartE2EDuration="1m41.809902332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:54:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:12.799010948 +0000 UTC m=+101.088461208" watchObservedRunningTime="2026-07-16 08:56:14.809902332 +0000 UTC m=+103.099352591" Jul 16 08:56:14.810559 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:14.810528 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-75c9m" podStartSLOduration=65.220892352 podStartE2EDuration="1m6.810518223s" totalImagesPullingTime="1.589625871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:55:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:14.808665363 +0000 UTC m=+103.098115616" watchObservedRunningTime="2026-07-16 08:56:14.810518223 +0000 UTC m=+103.099968483" Jul 16 08:56:15.650069 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:15.650035 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d9c6d8bdb-5l542"] Jul 16 08:56:15.675783 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:15.675760 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d9c6d8bdb-5l542"] Jul 16 08:56:15.675905 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:15.675856 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d9c6d8bdb-5l542" Jul 16 08:56:15.678360 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:15.678343 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 16 08:56:15.678503 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:15.678458 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6z2sg" Jul 16 08:56:15.679770 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:15.679751 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 16 08:56:15.679858 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:15.679755 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 16 08:56:15.679858 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:15.679755 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-5qq4m\"" Jul 16 08:56:15.679858 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:15.679827 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 16 08:56:15.819776 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:15.819751 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mr7k\" (UniqueName: \"kubernetes.io/projected/834cdc4b-377e-4bcb-ab56-1b268fe6e960-kube-api-access-4mr7k\") pod \"managed-serviceaccount-addon-agent-d9c6d8bdb-5l542\" (UID: \"834cdc4b-377e-4bcb-ab56-1b268fe6e960\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d9c6d8bdb-5l542" Jul 16 08:56:15.820101 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:15.819800 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/834cdc4b-377e-4bcb-ab56-1b268fe6e960-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d9c6d8bdb-5l542\" (UID: \"834cdc4b-377e-4bcb-ab56-1b268fe6e960\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d9c6d8bdb-5l542" Jul 16 08:56:15.920943 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:15.920877 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mr7k\" (UniqueName: \"kubernetes.io/projected/834cdc4b-377e-4bcb-ab56-1b268fe6e960-kube-api-access-4mr7k\") pod \"managed-serviceaccount-addon-agent-d9c6d8bdb-5l542\" (UID: \"834cdc4b-377e-4bcb-ab56-1b268fe6e960\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d9c6d8bdb-5l542" Jul 16 08:56:15.921032 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:15.920974 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/834cdc4b-377e-4bcb-ab56-1b268fe6e960-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d9c6d8bdb-5l542\" (UID: \"834cdc4b-377e-4bcb-ab56-1b268fe6e960\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d9c6d8bdb-5l542" Jul 16 08:56:15.923606 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:15.923586 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/834cdc4b-377e-4bcb-ab56-1b268fe6e960-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d9c6d8bdb-5l542\" (UID: \"834cdc4b-377e-4bcb-ab56-1b268fe6e960\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d9c6d8bdb-5l542" Jul 16 08:56:15.931985 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:15.931962 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mr7k\" (UniqueName: \"kubernetes.io/projected/834cdc4b-377e-4bcb-ab56-1b268fe6e960-kube-api-access-4mr7k\") pod \"managed-serviceaccount-addon-agent-d9c6d8bdb-5l542\" (UID: \"834cdc4b-377e-4bcb-ab56-1b268fe6e960\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d9c6d8bdb-5l542" Jul 16 08:56:15.998618 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:15.998595 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d9c6d8bdb-5l542" Jul 16 08:56:16.135906 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:16.135786 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d9c6d8bdb-5l542"] Jul 16 08:56:16.138348 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:56:16.138327 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod834cdc4b_377e_4bcb_ab56_1b268fe6e960.slice/crio-f9a5065e94fbb643710b9115bb1d1d1849e5d81e883a756d7089ade55cbb9897 WatchSource:0}: Error finding container f9a5065e94fbb643710b9115bb1d1d1849e5d81e883a756d7089ade55cbb9897: Status 404 returned error can't find the container with id f9a5065e94fbb643710b9115bb1d1d1849e5d81e883a756d7089ade55cbb9897 Jul 16 08:56:16.795144 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:16.795116 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d9c6d8bdb-5l542" event={"ID":"834cdc4b-377e-4bcb-ab56-1b268fe6e960","Type":"ContainerStarted","Data":"f9a5065e94fbb643710b9115bb1d1d1849e5d81e883a756d7089ade55cbb9897"} Jul 16 08:56:17.095631 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:17.095553 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-sxhqk" Jul 16 08:56:17.095631 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:17.095618 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-sxhqk" Jul 16 08:56:17.096079 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:17.095976 2559 scope.go:117] "RemoveContainer" containerID="832698219bb312ada1efdfaa2ba208c7fa41ab492d87c5612337ca97827a9ba8" Jul 16 08:56:17.096158 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:56:17.096131 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-sxhqk_openshift-console-operator(dc91df41-e89e-4bbc-9a7c-9ffff3904a71)\"" pod="openshift-console-operator/console-operator-7866497494-sxhqk" podUID="dc91df41-e89e-4bbc-9a7c-9ffff3904a71" Jul 16 08:56:19.809710 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:19.809669 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d9c6d8bdb-5l542" event={"ID":"834cdc4b-377e-4bcb-ab56-1b268fe6e960","Type":"ContainerStarted","Data":"92a7b0d6eac5df024da596eb6602c604c6601e353c17a0339958113938682d7e"} Jul 16 08:56:19.825383 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:19.825346 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d9c6d8bdb-5l542" podStartSLOduration=1.7143476199999998 podStartE2EDuration="4.825333565s" totalImagesPullingTime="3.110985945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:56:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:19.824760569 +0000 UTC m=+108.114210840" watchObservedRunningTime="2026-07-16 08:56:19.825333565 +0000 UTC m=+108.114783824" Jul 16 08:56:23.145884 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:23.145853 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sqvkg"] Jul 16 08:56:23.147639 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:23.147624 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sqvkg" Jul 16 08:56:23.150089 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:23.150058 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 16 08:56:23.150089 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:23.150069 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-q7s94\"" Jul 16 08:56:23.156288 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:23.156266 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sqvkg"] Jul 16 08:56:23.272667 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:23.272640 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1618f57a-1ec3-4fbc-b427-43f1481052aa-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-sqvkg\" (UID: \"1618f57a-1ec3-4fbc-b427-43f1481052aa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sqvkg" Jul 16 08:56:23.373235 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:23.373207 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1618f57a-1ec3-4fbc-b427-43f1481052aa-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-sqvkg\" (UID: \"1618f57a-1ec3-4fbc-b427-43f1481052aa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sqvkg" Jul 16 08:56:23.378323 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:23.378288 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1618f57a-1ec3-4fbc-b427-43f1481052aa-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-sqvkg\" (UID: \"1618f57a-1ec3-4fbc-b427-43f1481052aa\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sqvkg" Jul 16 08:56:23.456794 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:23.456730 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sqvkg" Jul 16 08:56:23.578833 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:23.578795 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sqvkg"] Jul 16 08:56:23.583014 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:56:23.582987 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1618f57a_1ec3_4fbc_b427_43f1481052aa.slice/crio-ac8274073e08eacdf5c1f07c2f5e95bd006059bbbf6729bc528d1c4567e670d3 WatchSource:0}: Error finding container ac8274073e08eacdf5c1f07c2f5e95bd006059bbbf6729bc528d1c4567e670d3: Status 404 returned error can't find the container with id ac8274073e08eacdf5c1f07c2f5e95bd006059bbbf6729bc528d1c4567e670d3 Jul 16 08:56:23.675963 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:23.675925 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:56:23.678382 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:23.678363 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0335dcfb-5b7b-4a9e-a618-346f4b7a662f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxss2\" (UID: \"0335dcfb-5b7b-4a9e-a618-346f4b7a662f\") " pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:56:23.822174 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:23.822141 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sqvkg" event={"ID":"1618f57a-1ec3-4fbc-b427-43f1481052aa","Type":"ContainerStarted","Data":"ac8274073e08eacdf5c1f07c2f5e95bd006059bbbf6729bc528d1c4567e670d3"} Jul 16 08:56:23.970665 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:23.970646 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wxss2" Jul 16 08:56:24.091580 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:24.091433 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wxss2"] Jul 16 08:56:24.094356 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:56:24.094319 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0335dcfb_5b7b_4a9e_a618_346f4b7a662f.slice/crio-c7b06aa41d10aa667ec5eec435d3670ef1dbee4a126033a7c59cefeeddd2a300 WatchSource:0}: Error finding container c7b06aa41d10aa667ec5eec435d3670ef1dbee4a126033a7c59cefeeddd2a300: Status 404 returned error can't find the container with id c7b06aa41d10aa667ec5eec435d3670ef1dbee4a126033a7c59cefeeddd2a300 Jul 16 08:56:24.795270 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:24.794404 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-75c9m" Jul 16 08:56:24.830237 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:24.828805 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sqvkg" event={"ID":"1618f57a-1ec3-4fbc-b427-43f1481052aa","Type":"ContainerStarted","Data":"604d26678a2f3d436c7052b55073101c139c7039d5a860c222e8177705da4998"} Jul 16 08:56:24.830237 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:24.829151 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sqvkg" Jul 16 08:56:24.831212 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:24.831187 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wxss2" event={"ID":"0335dcfb-5b7b-4a9e-a618-346f4b7a662f","Type":"ContainerStarted","Data":"c7b06aa41d10aa667ec5eec435d3670ef1dbee4a126033a7c59cefeeddd2a300"} Jul 16 08:56:24.837899 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:24.837874 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sqvkg" Jul 16 08:56:24.848009 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:24.847951 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sqvkg" podStartSLOduration=0.86375878 podStartE2EDuration="1.847937632s" totalImagesPullingTime="984.178852ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:24.846968053 +0000 UTC m=+113.136418315" watchObservedRunningTime="2026-07-16 08:56:24.847937632 +0000 UTC m=+113.137387891" Jul 16 08:56:29.848035 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:29.848008 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wxss2" event={"ID":"0335dcfb-5b7b-4a9e-a618-346f4b7a662f","Type":"ContainerStarted","Data":"f7cd07d7058e3cdf276ce1b474818c8ce87b85c9f9efd6b8ad2db1c68d07026e"} Jul 16 08:56:32.046734 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.046690 2559 patch_prober.go:28] interesting pod/image-registry-7fdffc7fb-rkfxv container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 16 08:56:32.047156 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.046770 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" podUID="908e56d4-2d21-4ce2-aecf-14845af0e5a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 08:56:32.243602 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.243578 2559 scope.go:117] "RemoveContainer" containerID="832698219bb312ada1efdfaa2ba208c7fa41ab492d87c5612337ca97827a9ba8" Jul 16 08:56:32.609146 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.609115 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cpgmc"] Jul 16 08:56:32.614276 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.614255 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.616967 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.616941 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 08:56:32.617062 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.616983 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 08:56:32.617156 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.617136 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 08:56:32.618046 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.618028 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 08:56:32.618145 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.618028 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6fx9n\"" Jul 16 08:56:32.618215 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.618200 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 08:56:32.618265 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.618221 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 08:56:32.643181 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.642823 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c4ed468-0928-4f6b-80c7-e26186154ccc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.643181 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.642870 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4c4ed468-0928-4f6b-80c7-e26186154ccc-root\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.643181 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.642896 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4c4ed468-0928-4f6b-80c7-e26186154ccc-node-exporter-accelerators-collector-config\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.643181 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.642928 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c4ed468-0928-4f6b-80c7-e26186154ccc-metrics-client-ca\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.643181 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.642958 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4c4ed468-0928-4f6b-80c7-e26186154ccc-node-exporter-tls\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.643181 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.642984 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4c4ed468-0928-4f6b-80c7-e26186154ccc-node-exporter-textfile\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.643181 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.643007 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvvk4\" (UniqueName: \"kubernetes.io/projected/4c4ed468-0928-4f6b-80c7-e26186154ccc-kube-api-access-dvvk4\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.643181 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.643061 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4c4ed468-0928-4f6b-80c7-e26186154ccc-node-exporter-wtmp\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.643181 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.643089 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c4ed468-0928-4f6b-80c7-e26186154ccc-sys\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.743945 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.743910 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c4ed468-0928-4f6b-80c7-e26186154ccc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.744126 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.743979 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4c4ed468-0928-4f6b-80c7-e26186154ccc-root\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.744126 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.744011 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4c4ed468-0928-4f6b-80c7-e26186154ccc-node-exporter-accelerators-collector-config\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.744126 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.744046 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c4ed468-0928-4f6b-80c7-e26186154ccc-metrics-client-ca\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.744126 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.744082 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4c4ed468-0928-4f6b-80c7-e26186154ccc-node-exporter-tls\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.744126 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.744090 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4c4ed468-0928-4f6b-80c7-e26186154ccc-root\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.744126 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.744111 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4c4ed468-0928-4f6b-80c7-e26186154ccc-node-exporter-textfile\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.744425 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.744137 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvvk4\" (UniqueName: \"kubernetes.io/projected/4c4ed468-0928-4f6b-80c7-e26186154ccc-kube-api-access-dvvk4\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.744425 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.744187 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4c4ed468-0928-4f6b-80c7-e26186154ccc-node-exporter-wtmp\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.744425 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.744215 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c4ed468-0928-4f6b-80c7-e26186154ccc-sys\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.744425 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.744282 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c4ed468-0928-4f6b-80c7-e26186154ccc-sys\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.744425 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.744407 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4c4ed468-0928-4f6b-80c7-e26186154ccc-node-exporter-wtmp\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.744690 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.744634 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c4ed468-0928-4f6b-80c7-e26186154ccc-metrics-client-ca\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.744690 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:56:32.744676 2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 16 08:56:32.744785 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:56:32.744745 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c4ed468-0928-4f6b-80c7-e26186154ccc-node-exporter-tls podName:4c4ed468-0928-4f6b-80c7-e26186154ccc nodeName:}" failed. No retries permitted until 2026-07-16 08:56:33.244724424 +0000 UTC m=+121.534174675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4c4ed468-0928-4f6b-80c7-e26186154ccc-node-exporter-tls") pod "node-exporter-cpgmc" (UID: "4c4ed468-0928-4f6b-80c7-e26186154ccc") : secret "node-exporter-tls" not found Jul 16 08:56:32.745025 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.745007 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4c4ed468-0928-4f6b-80c7-e26186154ccc-node-exporter-accelerators-collector-config\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.745120 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.745089 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4c4ed468-0928-4f6b-80c7-e26186154ccc-node-exporter-textfile\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.746699 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.746678 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c4ed468-0928-4f6b-80c7-e26186154ccc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:32.753423 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:32.753401 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvvk4\" (UniqueName: \"kubernetes.io/projected/4c4ed468-0928-4f6b-80c7-e26186154ccc-kube-api-access-dvvk4\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:33.248872 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.248846 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4c4ed468-0928-4f6b-80c7-e26186154ccc-node-exporter-tls\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:33.251277 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.251257 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4c4ed468-0928-4f6b-80c7-e26186154ccc-node-exporter-tls\") pod \"node-exporter-cpgmc\" (UID: \"4c4ed468-0928-4f6b-80c7-e26186154ccc\") " pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:33.546992 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.546959 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cpgmc" Jul 16 08:56:33.557392 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:56:33.557364 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c4ed468_0928_4f6b_80c7_e26186154ccc.slice/crio-2f90e18a5aa9449a64140710ba0e19aec91cdb951d05c804ec997562b491c861 WatchSource:0}: Error finding container 2f90e18a5aa9449a64140710ba0e19aec91cdb951d05c804ec997562b491c861: Status 404 returned error can't find the container with id 2f90e18a5aa9449a64140710ba0e19aec91cdb951d05c804ec997562b491c861 Jul 16 08:56:33.676598 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.676563 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 08:56:33.681648 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.681620 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.684786 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.684761 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 16 08:56:33.685358 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.685337 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 16 08:56:33.685665 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.685649 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 16 08:56:33.685855 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.685836 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 16 08:56:33.685956 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.685901 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 16 08:56:33.686401 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.686259 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9x7s6\"" Jul 16 08:56:33.686401 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.686266 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 16 08:56:33.686401 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.686294 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 16 08:56:33.686401 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.686307 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 16 08:56:33.686401 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.686336 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 16 08:56:33.698299 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.698218 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 08:56:33.751990 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.751962 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8d36bb69-982d-4a44-bf12-1253d939fc06-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.752128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.752003 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d36bb69-982d-4a44-bf12-1253d939fc06-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.752128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.752028 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.752128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.752049 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbxql\" (UniqueName: \"kubernetes.io/projected/8d36bb69-982d-4a44-bf12-1253d939fc06-kube-api-access-mbxql\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.752128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.752103 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d36bb69-982d-4a44-bf12-1253d939fc06-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.752363 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.752134 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.752363 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.752159 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.752363 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.752201 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d36bb69-982d-4a44-bf12-1253d939fc06-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.752363 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.752232 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.752363 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.752272 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-config-volume\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.752363 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.752297 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d36bb69-982d-4a44-bf12-1253d939fc06-config-out\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.752363 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.752322 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.752363 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.752345 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-web-config\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.789688 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.789074 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:56:33.852720 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.852653 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-config-volume\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.852720 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.852705 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d36bb69-982d-4a44-bf12-1253d939fc06-config-out\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.852943 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.852729 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.852943 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.852752 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-web-config\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.852943 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.852863 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8d36bb69-982d-4a44-bf12-1253d939fc06-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.852943 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.852892 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d36bb69-982d-4a44-bf12-1253d939fc06-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.852943 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.852932 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.853231 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.852957 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbxql\" (UniqueName: \"kubernetes.io/projected/8d36bb69-982d-4a44-bf12-1253d939fc06-kube-api-access-mbxql\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.853231 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.852993 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d36bb69-982d-4a44-bf12-1253d939fc06-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.853231 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.853065 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.853231 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.853093 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.853231 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.853129 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d36bb69-982d-4a44-bf12-1253d939fc06-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.853582 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.853300 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8d36bb69-982d-4a44-bf12-1253d939fc06-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.853582 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.853542 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.854743 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.854683 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d36bb69-982d-4a44-bf12-1253d939fc06-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.856323 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.856298 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d36bb69-982d-4a44-bf12-1253d939fc06-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.856716 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.856666 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.856884 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.856710 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.858513 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.858457 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d36bb69-982d-4a44-bf12-1253d939fc06-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.859074 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.858931 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.859074 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.858959 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d36bb69-982d-4a44-bf12-1253d939fc06-config-out\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.859074 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.859042 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-config-volume\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.860020 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.859977 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.860121 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.860093 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-web-config\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.860882 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.860820 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.862778 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.862751 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbxql\" (UniqueName: \"kubernetes.io/projected/8d36bb69-982d-4a44-bf12-1253d939fc06-kube-api-access-mbxql\") pod \"alertmanager-main-0\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:33.865761 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.865745 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/2.log" Jul 16 08:56:33.865912 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.865862 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-sxhqk" event={"ID":"dc91df41-e89e-4bbc-9a7c-9ffff3904a71","Type":"ContainerStarted","Data":"944da9de8d62005e9ff634106c5133730ea1d9e54e64098c661cc0955f67d1ff"} Jul 16 08:56:33.866241 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.866220 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-sxhqk" Jul 16 08:56:33.870218 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.870199 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wxss2" event={"ID":"0335dcfb-5b7b-4a9e-a618-346f4b7a662f","Type":"ContainerStarted","Data":"f1b38606f51f4d631ed6409933cb447ffd505477c45fca36a3e9006f884a0cd4"} Jul 16 08:56:33.872426 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.872404 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cpgmc" event={"ID":"4c4ed468-0928-4f6b-80c7-e26186154ccc","Type":"ContainerStarted","Data":"2f90e18a5aa9449a64140710ba0e19aec91cdb951d05c804ec997562b491c861"} Jul 16 08:56:33.872829 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.872783 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-sxhqk" Jul 16 08:56:33.897128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.897085 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-sxhqk" podStartSLOduration=45.73032171 podStartE2EDuration="47.897068924s" totalImagesPullingTime="2.166747214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:33.897051117 +0000 UTC m=+122.186501380" watchObservedRunningTime="2026-07-16 08:56:33.897068924 +0000 UTC m=+122.186519183" Jul 16 08:56:33.993187 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:33.992466 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:56:34.168325 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.168298 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 08:56:34.685124 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.684546 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x"] Jul 16 08:56:34.688785 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.688767 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.691114 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.691096 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-flm7b\"" Jul 16 08:56:34.691249 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.691126 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 16 08:56:34.691355 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.691336 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 16 08:56:34.691558 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.691539 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 16 08:56:34.691651 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.691565 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 16 08:56:34.691651 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.691605 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-46ar5p8hbu22d\"" Jul 16 08:56:34.691755 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.691685 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 16 08:56:34.699681 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.699659 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x"] Jul 16 08:56:34.760000 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.759967 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6d265134-857e-427c-9333-50b7bc7c4fbc-secret-thanos-querier-tls\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.760096 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.760011 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d265134-857e-427c-9333-50b7bc7c4fbc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.760096 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.760056 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kmjf\" (UniqueName: \"kubernetes.io/projected/6d265134-857e-427c-9333-50b7bc7c4fbc-kube-api-access-5kmjf\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.760198 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.760121 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d265134-857e-427c-9333-50b7bc7c4fbc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.760198 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.760152 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6d265134-857e-427c-9333-50b7bc7c4fbc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.760272 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.760223 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6d265134-857e-427c-9333-50b7bc7c4fbc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.760272 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.760259 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d265134-857e-427c-9333-50b7bc7c4fbc-metrics-client-ca\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.760344 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.760278 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6d265134-857e-427c-9333-50b7bc7c4fbc-secret-grpc-tls\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.861388 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.861315 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kmjf\" (UniqueName: \"kubernetes.io/projected/6d265134-857e-427c-9333-50b7bc7c4fbc-kube-api-access-5kmjf\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.861388 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.861370 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d265134-857e-427c-9333-50b7bc7c4fbc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.861653 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.861632 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6d265134-857e-427c-9333-50b7bc7c4fbc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.861724 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.861704 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6d265134-857e-427c-9333-50b7bc7c4fbc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.861791 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.861749 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d265134-857e-427c-9333-50b7bc7c4fbc-metrics-client-ca\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.861791 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.861778 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6d265134-857e-427c-9333-50b7bc7c4fbc-secret-grpc-tls\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.861887 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.861832 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6d265134-857e-427c-9333-50b7bc7c4fbc-secret-thanos-querier-tls\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.861887 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.861860 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d265134-857e-427c-9333-50b7bc7c4fbc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.863050 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.862535 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d265134-857e-427c-9333-50b7bc7c4fbc-metrics-client-ca\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.864995 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.864953 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6d265134-857e-427c-9333-50b7bc7c4fbc-secret-grpc-tls\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.865840 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.865457 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d265134-857e-427c-9333-50b7bc7c4fbc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.865840 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.865805 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6d265134-857e-427c-9333-50b7bc7c4fbc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.867194 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.867174 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6d265134-857e-427c-9333-50b7bc7c4fbc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.867871 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.867831 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d265134-857e-427c-9333-50b7bc7c4fbc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.868505 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.868463 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6d265134-857e-427c-9333-50b7bc7c4fbc-secret-thanos-querier-tls\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.879278 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.879206 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kmjf\" (UniqueName: \"kubernetes.io/projected/6d265134-857e-427c-9333-50b7bc7c4fbc-kube-api-access-5kmjf\") pod \"thanos-querier-c8cdbfd7d-fjz8x\" (UID: \"6d265134-857e-427c-9333-50b7bc7c4fbc\") " pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:34.879360 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.879279 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d36bb69-982d-4a44-bf12-1253d939fc06","Type":"ContainerStarted","Data":"6d6ae499cff19e5427ffbedd5cf82beec5bfde271d14f46b0dd5f2d8c9bf5c1c"} Jul 16 08:56:34.881647 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.881465 2559 generic.go:356] "Generic (PLEG): container finished" podID="4c4ed468-0928-4f6b-80c7-e26186154ccc" containerID="f69e99a61d3b8ca7a82a4372058735b4bd6b5b49a76714e4ad55b0eb626925b5" exitCode=0 Jul 16 08:56:34.882464 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:34.882442 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cpgmc" event={"ID":"4c4ed468-0928-4f6b-80c7-e26186154ccc","Type":"ContainerDied","Data":"f69e99a61d3b8ca7a82a4372058735b4bd6b5b49a76714e4ad55b0eb626925b5"} Jul 16 08:56:35.021463 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:35.021392 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:35.190019 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:35.189988 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x"] Jul 16 08:56:35.388483 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:56:35.387006 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d265134_857e_427c_9333_50b7bc7c4fbc.slice/crio-2ad5529c5d2ca15a55e87a1108edb5d1f4502ecadedb7c4acab60ab81340b4f4 WatchSource:0}: Error finding container 2ad5529c5d2ca15a55e87a1108edb5d1f4502ecadedb7c4acab60ab81340b4f4: Status 404 returned error can't find the container with id 2ad5529c5d2ca15a55e87a1108edb5d1f4502ecadedb7c4acab60ab81340b4f4 Jul 16 08:56:35.887008 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:35.886972 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" event={"ID":"6d265134-857e-427c-9333-50b7bc7c4fbc","Type":"ContainerStarted","Data":"2ad5529c5d2ca15a55e87a1108edb5d1f4502ecadedb7c4acab60ab81340b4f4"} Jul 16 08:56:35.889464 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:35.889430 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cpgmc" event={"ID":"4c4ed468-0928-4f6b-80c7-e26186154ccc","Type":"ContainerStarted","Data":"b3d282490d48302ab777565935b03017cf65e1afb93964044ec20ffc2acfb269"} Jul 16 08:56:35.889629 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:35.889515 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cpgmc" event={"ID":"4c4ed468-0928-4f6b-80c7-e26186154ccc","Type":"ContainerStarted","Data":"9ef9b2c4eedc2266fe9a19b67565232498acb3c90875a49b06283351bb6b839f"} Jul 16 08:56:35.912539 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:35.912498 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cpgmc" podStartSLOduration=2.874505203 podStartE2EDuration="3.912464461s" totalImagesPullingTime="957.352122ms" totalInitContainerRuntime="80.607136ms" isStatefulPod=true podCreationTimestamp="2026-07-16 08:56:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:35.910380212 +0000 UTC m=+124.199830471" watchObservedRunningTime="2026-07-16 08:56:35.912464461 +0000 UTC m=+124.201914743" Jul 16 08:56:36.931038 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:36.931010 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-747f8ddb64-llbx5"] Jul 16 08:56:36.957346 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:36.957316 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-747f8ddb64-llbx5"] Jul 16 08:56:36.957346 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:36.957331 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:36.961703 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:36.961538 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 16 08:56:36.961703 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:36.961549 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-69tmk\"" Jul 16 08:56:36.961703 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:36.961567 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 16 08:56:36.961703 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:36.961539 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 16 08:56:36.961703 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:36.961686 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 16 08:56:36.962009 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:36.961736 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-qnsgmambobq1\"" Jul 16 08:56:36.979981 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:36.979955 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9f41c9cd-045e-4233-856d-c3729e134b44-secret-metrics-server-client-certs\") pod \"metrics-server-747f8ddb64-llbx5\" (UID: \"9f41c9cd-045e-4233-856d-c3729e134b44\") " pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:36.980091 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:36.980006 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9f41c9cd-045e-4233-856d-c3729e134b44-secret-metrics-server-tls\") pod \"metrics-server-747f8ddb64-llbx5\" (UID: \"9f41c9cd-045e-4233-856d-c3729e134b44\") " pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:36.980091 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:36.980036 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f41c9cd-045e-4233-856d-c3729e134b44-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-747f8ddb64-llbx5\" (UID: \"9f41c9cd-045e-4233-856d-c3729e134b44\") " pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:36.980091 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:36.980070 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9f41c9cd-045e-4233-856d-c3729e134b44-metrics-server-audit-profiles\") pod \"metrics-server-747f8ddb64-llbx5\" (UID: \"9f41c9cd-045e-4233-856d-c3729e134b44\") " pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:36.980250 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:36.980227 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f41c9cd-045e-4233-856d-c3729e134b44-client-ca-bundle\") pod \"metrics-server-747f8ddb64-llbx5\" (UID: \"9f41c9cd-045e-4233-856d-c3729e134b44\") " pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:36.980326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:36.980265 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl87j\" (UniqueName: \"kubernetes.io/projected/9f41c9cd-045e-4233-856d-c3729e134b44-kube-api-access-tl87j\") pod \"metrics-server-747f8ddb64-llbx5\" (UID: \"9f41c9cd-045e-4233-856d-c3729e134b44\") " pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:36.980386 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:36.980321 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9f41c9cd-045e-4233-856d-c3729e134b44-audit-log\") pod \"metrics-server-747f8ddb64-llbx5\" (UID: \"9f41c9cd-045e-4233-856d-c3729e134b44\") " pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:37.081076 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.081051 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9f41c9cd-045e-4233-856d-c3729e134b44-audit-log\") pod \"metrics-server-747f8ddb64-llbx5\" (UID: \"9f41c9cd-045e-4233-856d-c3729e134b44\") " pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:37.081209 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.081090 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9f41c9cd-045e-4233-856d-c3729e134b44-secret-metrics-server-client-certs\") pod \"metrics-server-747f8ddb64-llbx5\" (UID: \"9f41c9cd-045e-4233-856d-c3729e134b44\") " pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:37.081209 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.081130 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9f41c9cd-045e-4233-856d-c3729e134b44-secret-metrics-server-tls\") pod \"metrics-server-747f8ddb64-llbx5\" (UID: \"9f41c9cd-045e-4233-856d-c3729e134b44\") " pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:37.081209 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.081154 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f41c9cd-045e-4233-856d-c3729e134b44-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-747f8ddb64-llbx5\" (UID: \"9f41c9cd-045e-4233-856d-c3729e134b44\") " pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:37.081209 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.081187 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9f41c9cd-045e-4233-856d-c3729e134b44-metrics-server-audit-profiles\") pod \"metrics-server-747f8ddb64-llbx5\" (UID: \"9f41c9cd-045e-4233-856d-c3729e134b44\") " pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:37.081426 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.081261 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f41c9cd-045e-4233-856d-c3729e134b44-client-ca-bundle\") pod \"metrics-server-747f8ddb64-llbx5\" (UID: \"9f41c9cd-045e-4233-856d-c3729e134b44\") " pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:37.081426 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.081286 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl87j\" (UniqueName: \"kubernetes.io/projected/9f41c9cd-045e-4233-856d-c3729e134b44-kube-api-access-tl87j\") pod \"metrics-server-747f8ddb64-llbx5\" (UID: \"9f41c9cd-045e-4233-856d-c3729e134b44\") " pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:37.081557 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.081423 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9f41c9cd-045e-4233-856d-c3729e134b44-audit-log\") pod \"metrics-server-747f8ddb64-llbx5\" (UID: \"9f41c9cd-045e-4233-856d-c3729e134b44\") " pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:37.082046 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.081925 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f41c9cd-045e-4233-856d-c3729e134b44-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-747f8ddb64-llbx5\" (UID: \"9f41c9cd-045e-4233-856d-c3729e134b44\") " pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:37.082156 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.082141 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9f41c9cd-045e-4233-856d-c3729e134b44-metrics-server-audit-profiles\") pod \"metrics-server-747f8ddb64-llbx5\" (UID: \"9f41c9cd-045e-4233-856d-c3729e134b44\") " pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:37.083921 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.083890 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9f41c9cd-045e-4233-856d-c3729e134b44-secret-metrics-server-tls\") pod \"metrics-server-747f8ddb64-llbx5\" (UID: \"9f41c9cd-045e-4233-856d-c3729e134b44\") " pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:37.083921 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.083917 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9f41c9cd-045e-4233-856d-c3729e134b44-client-ca-bundle\") pod \"metrics-server-747f8ddb64-llbx5\" (UID: \"9f41c9cd-045e-4233-856d-c3729e134b44\") " pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:37.084060 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.083940 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9f41c9cd-045e-4233-856d-c3729e134b44-secret-metrics-server-client-certs\") pod \"metrics-server-747f8ddb64-llbx5\" (UID: \"9f41c9cd-045e-4233-856d-c3729e134b44\") " pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:37.089559 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.089535 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl87j\" (UniqueName: \"kubernetes.io/projected/9f41c9cd-045e-4233-856d-c3729e134b44-kube-api-access-tl87j\") pod \"metrics-server-747f8ddb64-llbx5\" (UID: \"9f41c9cd-045e-4233-856d-c3729e134b44\") " pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:37.268591 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.268562 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:37.349597 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.349571 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-6rmzv"] Jul 16 08:56:37.353635 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.353615 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6rmzv" Jul 16 08:56:37.356143 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.356125 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 16 08:56:37.356222 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.356145 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rrkr4\"" Jul 16 08:56:37.361140 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.361091 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-6rmzv"] Jul 16 08:56:37.383247 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.383221 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/82c18da3-8ff5-44fe-8381-59cd2ca4c037-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-6rmzv\" (UID: \"82c18da3-8ff5-44fe-8381-59cd2ca4c037\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6rmzv" Jul 16 08:56:37.383382 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.383277 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rldm\" (UniqueName: \"kubernetes.io/projected/82c18da3-8ff5-44fe-8381-59cd2ca4c037-kube-api-access-6rldm\") pod \"monitoring-plugin-5f68df7f58-6rmzv\" (UID: \"82c18da3-8ff5-44fe-8381-59cd2ca4c037\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6rmzv" Jul 16 08:56:37.417298 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.417262 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-747f8ddb64-llbx5"] Jul 16 08:56:37.422152 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:56:37.422124 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f41c9cd_045e_4233_856d_c3729e134b44.slice/crio-cba11aa5bf8a94d70ada8a7cb3bc0c60e07c094254e80b03c40e6e77dcaf897b WatchSource:0}: Error finding container cba11aa5bf8a94d70ada8a7cb3bc0c60e07c094254e80b03c40e6e77dcaf897b: Status 404 returned error can't find the container with id cba11aa5bf8a94d70ada8a7cb3bc0c60e07c094254e80b03c40e6e77dcaf897b Jul 16 08:56:37.484517 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.484430 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/82c18da3-8ff5-44fe-8381-59cd2ca4c037-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-6rmzv\" (UID: \"82c18da3-8ff5-44fe-8381-59cd2ca4c037\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6rmzv" Jul 16 08:56:37.484620 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.484514 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rldm\" (UniqueName: \"kubernetes.io/projected/82c18da3-8ff5-44fe-8381-59cd2ca4c037-kube-api-access-6rldm\") pod \"monitoring-plugin-5f68df7f58-6rmzv\" (UID: \"82c18da3-8ff5-44fe-8381-59cd2ca4c037\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6rmzv" Jul 16 08:56:37.484620 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:56:37.484575 2559 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 16 08:56:37.484714 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:56:37.484650 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c18da3-8ff5-44fe-8381-59cd2ca4c037-monitoring-plugin-cert podName:82c18da3-8ff5-44fe-8381-59cd2ca4c037 nodeName:}" failed. No retries permitted until 2026-07-16 08:56:37.984625433 +0000 UTC m=+126.274075673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/82c18da3-8ff5-44fe-8381-59cd2ca4c037-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-6rmzv" (UID: "82c18da3-8ff5-44fe-8381-59cd2ca4c037") : secret "monitoring-plugin-cert" not found Jul 16 08:56:37.496035 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.496010 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rldm\" (UniqueName: \"kubernetes.io/projected/82c18da3-8ff5-44fe-8381-59cd2ca4c037-kube-api-access-6rldm\") pod \"monitoring-plugin-5f68df7f58-6rmzv\" (UID: \"82c18da3-8ff5-44fe-8381-59cd2ca4c037\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6rmzv" Jul 16 08:56:37.898821 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.898782 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" event={"ID":"9f41c9cd-045e-4233-856d-c3729e134b44","Type":"ContainerStarted","Data":"cba11aa5bf8a94d70ada8a7cb3bc0c60e07c094254e80b03c40e6e77dcaf897b"} Jul 16 08:56:37.901115 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.901078 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wxss2" event={"ID":"0335dcfb-5b7b-4a9e-a618-346f4b7a662f","Type":"ContainerStarted","Data":"f81f8ba8c7c66e55f9433445ae593341cd7352e5414882388aacec3d1bfba4e0"} Jul 16 08:56:37.902762 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.902733 2559 generic.go:356] "Generic (PLEG): container finished" podID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerID="c9d3df1cbc047669d6d5d60a1fe9b50e0c309b0f5845ea5dc15162c9764b9dbd" exitCode=0 Jul 16 08:56:37.902882 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.902774 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d36bb69-982d-4a44-bf12-1253d939fc06","Type":"ContainerDied","Data":"c9d3df1cbc047669d6d5d60a1fe9b50e0c309b0f5845ea5dc15162c9764b9dbd"} Jul 16 08:56:37.919907 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.919858 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wxss2" podStartSLOduration=34.032682629 podStartE2EDuration="46.919840295s" totalImagesPullingTime="12.887157666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 08:55:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:37.918999477 +0000 UTC m=+126.208449738" watchObservedRunningTime="2026-07-16 08:56:37.919840295 +0000 UTC m=+126.209290556" Jul 16 08:56:37.990991 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.990967 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/82c18da3-8ff5-44fe-8381-59cd2ca4c037-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-6rmzv\" (UID: \"82c18da3-8ff5-44fe-8381-59cd2ca4c037\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6rmzv" Jul 16 08:56:37.993822 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:37.993803 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/82c18da3-8ff5-44fe-8381-59cd2ca4c037-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-6rmzv\" (UID: \"82c18da3-8ff5-44fe-8381-59cd2ca4c037\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6rmzv" Jul 16 08:56:38.265683 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:38.265651 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6rmzv" Jul 16 08:56:38.459740 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:38.459005 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fdffc7fb-rkfxv"] Jul 16 08:56:39.287332 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:39.287073 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-6rmzv"] Jul 16 08:56:39.291330 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:56:39.291302 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82c18da3_8ff5_44fe_8381_59cd2ca4c037.slice/crio-331c547632f9424496a251a8b7d9f789c6f614c9a3119558a0550b98460b677e WatchSource:0}: Error finding container 331c547632f9424496a251a8b7d9f789c6f614c9a3119558a0550b98460b677e: Status 404 returned error can't find the container with id 331c547632f9424496a251a8b7d9f789c6f614c9a3119558a0550b98460b677e Jul 16 08:56:39.914116 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:39.914046 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" event={"ID":"9f41c9cd-045e-4233-856d-c3729e134b44","Type":"ContainerStarted","Data":"3142fd311059a420ec474cc5593b23d58b0db35c3a284529a0d9bb81dc499488"} Jul 16 08:56:39.915830 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:39.915808 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6rmzv" event={"ID":"82c18da3-8ff5-44fe-8381-59cd2ca4c037","Type":"ContainerStarted","Data":"331c547632f9424496a251a8b7d9f789c6f614c9a3119558a0550b98460b677e"} Jul 16 08:56:39.918796 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:39.918767 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" event={"ID":"6d265134-857e-427c-9333-50b7bc7c4fbc","Type":"ContainerStarted","Data":"f62b93deb8af76577fa30afba899e224487f85cd0b9ca729ba8ff09bd0bd85b0"} Jul 16 08:56:39.918893 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:39.918846 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" event={"ID":"6d265134-857e-427c-9333-50b7bc7c4fbc","Type":"ContainerStarted","Data":"4cbd916a79b154f0e4154a2177840880974d0f8491979314f54679045f16f9a8"} Jul 16 08:56:39.918893 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:39.918888 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" event={"ID":"6d265134-857e-427c-9333-50b7bc7c4fbc","Type":"ContainerStarted","Data":"db047badba9bbdceadccbaf5e832db44643045a1b7bb36f29fe90b8e77711636"} Jul 16 08:56:39.921459 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:39.921435 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d36bb69-982d-4a44-bf12-1253d939fc06","Type":"ContainerStarted","Data":"c36d897c64c8a988b4273c64336d3c8bd32a5bde41609bd124da91490f7fa43d"} Jul 16 08:56:39.921562 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:39.921529 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d36bb69-982d-4a44-bf12-1253d939fc06","Type":"ContainerStarted","Data":"1cf65e23de617a87106fe0c6fc1c71d96eeb139e6d0eb9b32798eb68bfa328c3"} Jul 16 08:56:39.933819 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:39.933656 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" podStartSLOduration=2.216318815 podStartE2EDuration="3.933639173s" totalImagesPullingTime="1.717320358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:56:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:39.932760898 +0000 UTC m=+128.222211158" watchObservedRunningTime="2026-07-16 08:56:39.933639173 +0000 UTC m=+128.223089434" Jul 16 08:56:40.928497 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:40.928437 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" event={"ID":"6d265134-857e-427c-9333-50b7bc7c4fbc","Type":"ContainerStarted","Data":"77aa5330cc391805a199b2430706e091d0cbc621410aad7089cf05a294e225da"} Jul 16 08:56:40.932436 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:40.932054 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d36bb69-982d-4a44-bf12-1253d939fc06","Type":"ContainerStarted","Data":"de97a5b60557849172ec4be900d3361cc627dfbe8289af64e22df7522063e97f"} Jul 16 08:56:40.932436 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:40.932124 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d36bb69-982d-4a44-bf12-1253d939fc06","Type":"ContainerStarted","Data":"ef88b7a047d13047834da0c9f8df6259eec6fc1fa206d0798d222703921b1540"} Jul 16 08:56:40.932436 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:40.932166 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d36bb69-982d-4a44-bf12-1253d939fc06","Type":"ContainerStarted","Data":"50fcfea8b11e30deca872bb81dcbaf1de54c36f4f3b4d7277d42e070eaa50bb6"} Jul 16 08:56:40.933847 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:40.933810 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6rmzv" event={"ID":"82c18da3-8ff5-44fe-8381-59cd2ca4c037","Type":"ContainerStarted","Data":"4a28de73c98879da55ed408db141a7aaf0339cc0c5f147b80a810c7da42bcf2e"} Jul 16 08:56:40.954814 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:40.954773 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6rmzv" podStartSLOduration=2.397113039 podStartE2EDuration="3.954760508s" totalImagesPullingTime="1.557647469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:56:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:40.953364059 +0000 UTC m=+129.242814333" watchObservedRunningTime="2026-07-16 08:56:40.954760508 +0000 UTC m=+129.244210766" Jul 16 08:56:41.940700 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:41.940663 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d36bb69-982d-4a44-bf12-1253d939fc06","Type":"ContainerStarted","Data":"453cf2b4ca6eab30b5e79d85f612b661e9d9d1bd3272e87c91cb11cea54c383e"} Jul 16 08:56:41.943521 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:41.943499 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" event={"ID":"6d265134-857e-427c-9333-50b7bc7c4fbc","Type":"ContainerStarted","Data":"71b52213f0c7ae59ff530e9835116330c31faa2db8afb2bf1317187f3dde911e"} Jul 16 08:56:41.943627 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:41.943554 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" event={"ID":"6d265134-857e-427c-9333-50b7bc7c4fbc","Type":"ContainerStarted","Data":"85cd4e2563bac30c68f6e9a50b31e9a4010f2360f5cc32f612f50757fe959c5a"} Jul 16 08:56:41.943627 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:41.943596 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6rmzv" Jul 16 08:56:41.948942 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:41.948926 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6rmzv" Jul 16 08:56:41.968942 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:41.968894 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.14707989 podStartE2EDuration="8.968877755s" totalImagesPullingTime="5.799981478s" totalInitContainerRuntime="21.816387ms" isStatefulPod=false podCreationTimestamp="2026-07-16 08:56:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:41.967538782 +0000 UTC m=+130.256989040" watchObservedRunningTime="2026-07-16 08:56:41.968877755 +0000 UTC m=+130.258328017" Jul 16 08:56:41.990071 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:41.990033 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" podStartSLOduration=2.770070772 podStartE2EDuration="7.990020704s" totalImagesPullingTime="5.219949932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:56:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:41.989333092 +0000 UTC m=+130.278783353" watchObservedRunningTime="2026-07-16 08:56:41.990020704 +0000 UTC m=+130.279471009" Jul 16 08:56:42.128331 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:42.128302 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs\") pod \"network-metrics-daemon-czllj\" (UID: \"7589804c-eb08-481e-a23c-431f53d6e559\") " pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:56:42.130525 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:42.130494 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7589804c-eb08-481e-a23c-431f53d6e559-metrics-certs\") pod \"network-metrics-daemon-czllj\" (UID: \"7589804c-eb08-481e-a23c-431f53d6e559\") " pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:56:42.170712 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:42.170687 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s7ks4\"" Jul 16 08:56:42.178682 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:42.178661 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-czllj" Jul 16 08:56:42.312838 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:42.312757 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-czllj"] Jul 16 08:56:42.315369 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:56:42.315337 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7589804c_eb08_481e_a23c_431f53d6e559.slice/crio-676043dd4bd994c0118050627b6c8e40540464d5a1313aa679eaf45771da6621 WatchSource:0}: Error finding container 676043dd4bd994c0118050627b6c8e40540464d5a1313aa679eaf45771da6621: Status 404 returned error can't find the container with id 676043dd4bd994c0118050627b6c8e40540464d5a1313aa679eaf45771da6621 Jul 16 08:56:42.949487 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:42.949429 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-czllj" event={"ID":"7589804c-eb08-481e-a23c-431f53d6e559","Type":"ContainerStarted","Data":"676043dd4bd994c0118050627b6c8e40540464d5a1313aa679eaf45771da6621"} Jul 16 08:56:42.949992 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:42.949972 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:43.856960 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:43.856925 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-884c57d84-lv88d"] Jul 16 08:56:43.860192 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:43.860175 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:43.862923 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:43.862890 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 16 08:56:43.863017 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:43.862890 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 16 08:56:43.863017 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:43.862955 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 16 08:56:43.864064 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:43.864044 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 16 08:56:43.864184 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:43.864064 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 16 08:56:43.864184 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:43.864084 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 16 08:56:43.864184 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:43.864082 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fs8z9\"" Jul 16 08:56:43.864184 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:43.864109 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 16 08:56:43.871621 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:43.871602 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-884c57d84-lv88d"] Jul 16 08:56:43.943616 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:43.943588 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-oauth-serving-cert\") pod \"console-884c57d84-lv88d\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:43.943725 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:43.943630 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-console-serving-cert\") pod \"console-884c57d84-lv88d\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:43.943725 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:43.943714 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-console-oauth-config\") pod \"console-884c57d84-lv88d\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:43.943808 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:43.943767 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-console-config\") pod \"console-884c57d84-lv88d\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:43.943808 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:43.943793 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tbht\" (UniqueName: \"kubernetes.io/projected/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-kube-api-access-4tbht\") pod \"console-884c57d84-lv88d\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:43.943902 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:43.943825 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-service-ca\") pod \"console-884c57d84-lv88d\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:43.955393 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:43.955361 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-czllj" event={"ID":"7589804c-eb08-481e-a23c-431f53d6e559","Type":"ContainerStarted","Data":"ef796ae98eb4f7b715bbeeeacc21e55a436d0798ccfe5b805a923a2c92cfd965"} Jul 16 08:56:43.955770 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:43.955414 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-czllj" event={"ID":"7589804c-eb08-481e-a23c-431f53d6e559","Type":"ContainerStarted","Data":"fc28f57a25a8c92b9aaf71f6d5e13e590eabe79cedbac7385df4e1c897e88a76"} Jul 16 08:56:43.972841 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:43.972792 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-czllj" podStartSLOduration=130.128847904 podStartE2EDuration="2m10.972776631s" totalImagesPullingTime="843.928727ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:43.971554419 +0000 UTC m=+132.261004680" watchObservedRunningTime="2026-07-16 08:56:43.972776631 +0000 UTC m=+132.262226890" Jul 16 08:56:44.045115 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:44.045082 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-console-oauth-config\") pod \"console-884c57d84-lv88d\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:44.045238 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:44.045175 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-console-config\") pod \"console-884c57d84-lv88d\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:44.045238 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:44.045206 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tbht\" (UniqueName: \"kubernetes.io/projected/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-kube-api-access-4tbht\") pod \"console-884c57d84-lv88d\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:44.045238 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:44.045234 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-service-ca\") pod \"console-884c57d84-lv88d\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:44.045414 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:44.045340 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-oauth-serving-cert\") pod \"console-884c57d84-lv88d\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:44.045414 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:44.045389 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-console-serving-cert\") pod \"console-884c57d84-lv88d\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:44.046183 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:44.046161 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-console-config\") pod \"console-884c57d84-lv88d\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:44.046363 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:44.046345 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-oauth-serving-cert\") pod \"console-884c57d84-lv88d\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:44.046490 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:44.046455 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-service-ca\") pod \"console-884c57d84-lv88d\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:44.047748 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:44.047718 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-console-oauth-config\") pod \"console-884c57d84-lv88d\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:44.048049 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:44.048032 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-console-serving-cert\") pod \"console-884c57d84-lv88d\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:44.054288 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:44.054269 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tbht\" (UniqueName: \"kubernetes.io/projected/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-kube-api-access-4tbht\") pod \"console-884c57d84-lv88d\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:44.169903 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:44.169848 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:44.305179 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:44.305148 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-884c57d84-lv88d"] Jul 16 08:56:44.310115 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:56:44.310082 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod822384c1_9de1_4c0e_90cf_05f7ce9b9d0e.slice/crio-9fe3c7ba837d97d239684a721e4dae4361eb7c71793f549af27a877b0b8adf24 WatchSource:0}: Error finding container 9fe3c7ba837d97d239684a721e4dae4361eb7c71793f549af27a877b0b8adf24: Status 404 returned error can't find the container with id 9fe3c7ba837d97d239684a721e4dae4361eb7c71793f549af27a877b0b8adf24 Jul 16 08:56:44.961157 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:44.961122 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-884c57d84-lv88d" event={"ID":"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e","Type":"ContainerStarted","Data":"9fe3c7ba837d97d239684a721e4dae4361eb7c71793f549af27a877b0b8adf24"} Jul 16 08:56:47.977354 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:47.977323 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-884c57d84-lv88d" event={"ID":"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e","Type":"ContainerStarted","Data":"1237869f93171c10b1f007e52d7cbad8663de2bcb3c3b12cde3744edcb828247"} Jul 16 08:56:47.997351 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:47.997303 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-884c57d84-lv88d" podStartSLOduration=2.092617048 podStartE2EDuration="4.997287074s" totalImagesPullingTime="2.904670026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:56:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:56:47.995558325 +0000 UTC m=+136.285008587" watchObservedRunningTime="2026-07-16 08:56:47.997287074 +0000 UTC m=+136.286737334" Jul 16 08:56:48.960975 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:48.960949 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-c8cdbfd7d-fjz8x" Jul 16 08:56:54.170459 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:54.170425 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:54.170886 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:54.170517 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:54.174988 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:54.174965 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:55.009212 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:55.009182 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:56:57.269279 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:57.269248 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:56:57.269682 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:56:57.269302 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:57:03.487612 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.487538 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" podUID="908e56d4-2d21-4ce2-aecf-14845af0e5a5" containerName="registry" containerID="cri-o://c88174e3e17aa76f9f808bcb0d56e92eac611f7fb4db3ded23b110caa18fe78e" gracePeriod=30 Jul 16 08:57:03.650528 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.650490 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-884c57d84-lv88d"] Jul 16 08:57:03.740605 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.740586 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:57:03.792555 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.792525 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-certificates\") pod \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " Jul 16 08:57:03.792686 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.792577 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/908e56d4-2d21-4ce2-aecf-14845af0e5a5-trusted-ca\") pod \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " Jul 16 08:57:03.792686 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.792602 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-bound-sa-token\") pod \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " Jul 16 08:57:03.792686 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.792626 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/908e56d4-2d21-4ce2-aecf-14845af0e5a5-installation-pull-secrets\") pod \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " Jul 16 08:57:03.792686 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.792674 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v77rc\" (UniqueName: \"kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-kube-api-access-v77rc\") pod \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " Jul 16 08:57:03.792926 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.792704 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/908e56d4-2d21-4ce2-aecf-14845af0e5a5-ca-trust-extracted\") pod \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " Jul 16 08:57:03.792926 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.792763 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls\") pod \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " Jul 16 08:57:03.792926 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.792802 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/908e56d4-2d21-4ce2-aecf-14845af0e5a5-image-registry-private-configuration\") pod \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\" (UID: \"908e56d4-2d21-4ce2-aecf-14845af0e5a5\") " Jul 16 08:57:03.793084 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.792930 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "908e56d4-2d21-4ce2-aecf-14845af0e5a5" (UID: "908e56d4-2d21-4ce2-aecf-14845af0e5a5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 08:57:03.793084 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.792987 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/908e56d4-2d21-4ce2-aecf-14845af0e5a5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "908e56d4-2d21-4ce2-aecf-14845af0e5a5" (UID: "908e56d4-2d21-4ce2-aecf-14845af0e5a5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 08:57:03.793186 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.793109 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-certificates\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:03.793186 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.793130 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/908e56d4-2d21-4ce2-aecf-14845af0e5a5-trusted-ca\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:03.795376 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.795323 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-kube-api-access-v77rc" (OuterVolumeSpecName: "kube-api-access-v77rc") pod "908e56d4-2d21-4ce2-aecf-14845af0e5a5" (UID: "908e56d4-2d21-4ce2-aecf-14845af0e5a5"). InnerVolumeSpecName "kube-api-access-v77rc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 08:57:03.795574 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.795542 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/908e56d4-2d21-4ce2-aecf-14845af0e5a5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "908e56d4-2d21-4ce2-aecf-14845af0e5a5" (UID: "908e56d4-2d21-4ce2-aecf-14845af0e5a5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 08:57:03.795684 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.795626 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "908e56d4-2d21-4ce2-aecf-14845af0e5a5" (UID: "908e56d4-2d21-4ce2-aecf-14845af0e5a5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 08:57:03.795684 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.795634 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "908e56d4-2d21-4ce2-aecf-14845af0e5a5" (UID: "908e56d4-2d21-4ce2-aecf-14845af0e5a5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 08:57:03.795758 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.795689 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/908e56d4-2d21-4ce2-aecf-14845af0e5a5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "908e56d4-2d21-4ce2-aecf-14845af0e5a5" (UID: "908e56d4-2d21-4ce2-aecf-14845af0e5a5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 08:57:03.802132 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.802107 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/908e56d4-2d21-4ce2-aecf-14845af0e5a5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "908e56d4-2d21-4ce2-aecf-14845af0e5a5" (UID: "908e56d4-2d21-4ce2-aecf-14845af0e5a5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 08:57:03.893746 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.893721 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-bound-sa-token\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:03.893746 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.893741 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/908e56d4-2d21-4ce2-aecf-14845af0e5a5-installation-pull-secrets\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:03.893878 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.893750 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v77rc\" (UniqueName: \"kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-kube-api-access-v77rc\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:03.893878 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.893759 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/908e56d4-2d21-4ce2-aecf-14845af0e5a5-ca-trust-extracted\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:03.893878 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.893767 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/908e56d4-2d21-4ce2-aecf-14845af0e5a5-registry-tls\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:03.893878 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:03.893776 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/908e56d4-2d21-4ce2-aecf-14845af0e5a5-image-registry-private-configuration\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:04.037999 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:04.037921 2559 generic.go:356] "Generic (PLEG): container finished" podID="908e56d4-2d21-4ce2-aecf-14845af0e5a5" containerID="c88174e3e17aa76f9f808bcb0d56e92eac611f7fb4db3ded23b110caa18fe78e" exitCode=0 Jul 16 08:57:04.037999 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:04.037962 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" Jul 16 08:57:04.037999 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:04.037974 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" event={"ID":"908e56d4-2d21-4ce2-aecf-14845af0e5a5","Type":"ContainerDied","Data":"c88174e3e17aa76f9f808bcb0d56e92eac611f7fb4db3ded23b110caa18fe78e"} Jul 16 08:57:04.038204 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:04.038015 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fdffc7fb-rkfxv" event={"ID":"908e56d4-2d21-4ce2-aecf-14845af0e5a5","Type":"ContainerDied","Data":"970c6556814177e8094bead29fb52eab0c0a4b78c404336578971fd42530fec3"} Jul 16 08:57:04.038204 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:04.038036 2559 scope.go:117] "RemoveContainer" containerID="c88174e3e17aa76f9f808bcb0d56e92eac611f7fb4db3ded23b110caa18fe78e" Jul 16 08:57:04.046935 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:04.046662 2559 scope.go:117] "RemoveContainer" containerID="c88174e3e17aa76f9f808bcb0d56e92eac611f7fb4db3ded23b110caa18fe78e" Jul 16 08:57:04.047324 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:57:04.047223 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c88174e3e17aa76f9f808bcb0d56e92eac611f7fb4db3ded23b110caa18fe78e\": container with ID starting with c88174e3e17aa76f9f808bcb0d56e92eac611f7fb4db3ded23b110caa18fe78e not found: ID does not exist" containerID="c88174e3e17aa76f9f808bcb0d56e92eac611f7fb4db3ded23b110caa18fe78e" Jul 16 08:57:04.047324 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:04.047256 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c88174e3e17aa76f9f808bcb0d56e92eac611f7fb4db3ded23b110caa18fe78e"} err="failed to get container status \"c88174e3e17aa76f9f808bcb0d56e92eac611f7fb4db3ded23b110caa18fe78e\": rpc error: code = NotFound desc = could not find container \"c88174e3e17aa76f9f808bcb0d56e92eac611f7fb4db3ded23b110caa18fe78e\": container with ID starting with c88174e3e17aa76f9f808bcb0d56e92eac611f7fb4db3ded23b110caa18fe78e not found: ID does not exist" Jul 16 08:57:04.060909 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:04.060881 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fdffc7fb-rkfxv"] Jul 16 08:57:04.064921 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:04.064892 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7fdffc7fb-rkfxv"] Jul 16 08:57:04.242356 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:04.242325 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="908e56d4-2d21-4ce2-aecf-14845af0e5a5" path="/var/lib/kubelet/pods/908e56d4-2d21-4ce2-aecf-14845af0e5a5/volumes" Jul 16 08:57:17.274327 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:17.274304 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:57:17.278385 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:17.278360 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-747f8ddb64-llbx5" Jul 16 08:57:28.672634 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:28.672543 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-884c57d84-lv88d" podUID="822384c1-9de1-4c0e-90cf-05f7ce9b9d0e" containerName="console" containerID="cri-o://1237869f93171c10b1f007e52d7cbad8663de2bcb3c3b12cde3744edcb828247" gracePeriod=15 Jul 16 08:57:28.936434 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:28.936364 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:57:29.062064 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.062034 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-oauth-serving-cert\") pod \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " Jul 16 08:57:29.062245 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.062089 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-console-serving-cert\") pod \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " Jul 16 08:57:29.062245 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.062116 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-console-oauth-config\") pod \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " Jul 16 08:57:29.062245 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.062151 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tbht\" (UniqueName: \"kubernetes.io/projected/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-kube-api-access-4tbht\") pod \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " Jul 16 08:57:29.062245 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.062184 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-console-config\") pod \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " Jul 16 08:57:29.062245 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.062221 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-service-ca\") pod \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\" (UID: \"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e\") " Jul 16 08:57:29.062576 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.062538 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "822384c1-9de1-4c0e-90cf-05f7ce9b9d0e" (UID: "822384c1-9de1-4c0e-90cf-05f7ce9b9d0e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 08:57:29.062882 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.062794 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-service-ca" (OuterVolumeSpecName: "service-ca") pod "822384c1-9de1-4c0e-90cf-05f7ce9b9d0e" (UID: "822384c1-9de1-4c0e-90cf-05f7ce9b9d0e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 08:57:29.062882 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.062792 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-console-config" (OuterVolumeSpecName: "console-config") pod "822384c1-9de1-4c0e-90cf-05f7ce9b9d0e" (UID: "822384c1-9de1-4c0e-90cf-05f7ce9b9d0e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 08:57:29.064547 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.064519 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "822384c1-9de1-4c0e-90cf-05f7ce9b9d0e" (UID: "822384c1-9de1-4c0e-90cf-05f7ce9b9d0e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 08:57:29.064730 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.064686 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-kube-api-access-4tbht" (OuterVolumeSpecName: "kube-api-access-4tbht") pod "822384c1-9de1-4c0e-90cf-05f7ce9b9d0e" (UID: "822384c1-9de1-4c0e-90cf-05f7ce9b9d0e"). InnerVolumeSpecName "kube-api-access-4tbht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 08:57:29.064804 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.064708 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "822384c1-9de1-4c0e-90cf-05f7ce9b9d0e" (UID: "822384c1-9de1-4c0e-90cf-05f7ce9b9d0e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 08:57:29.144135 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.144096 2559 generic.go:356] "Generic (PLEG): container finished" podID="822384c1-9de1-4c0e-90cf-05f7ce9b9d0e" containerID="1237869f93171c10b1f007e52d7cbad8663de2bcb3c3b12cde3744edcb828247" exitCode=0 Jul 16 08:57:29.144623 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.144605 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-884c57d84-lv88d" Jul 16 08:57:29.144848 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.144675 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-884c57d84-lv88d" event={"ID":"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e","Type":"ContainerDied","Data":"1237869f93171c10b1f007e52d7cbad8663de2bcb3c3b12cde3744edcb828247"} Jul 16 08:57:29.145035 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.145021 2559 scope.go:117] "RemoveContainer" containerID="1237869f93171c10b1f007e52d7cbad8663de2bcb3c3b12cde3744edcb828247" Jul 16 08:57:29.145362 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.144995 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-884c57d84-lv88d" event={"ID":"822384c1-9de1-4c0e-90cf-05f7ce9b9d0e","Type":"ContainerDied","Data":"9fe3c7ba837d97d239684a721e4dae4361eb7c71793f549af27a877b0b8adf24"} Jul 16 08:57:29.158688 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.158662 2559 scope.go:117] "RemoveContainer" containerID="1237869f93171c10b1f007e52d7cbad8663de2bcb3c3b12cde3744edcb828247" Jul 16 08:57:29.158955 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:57:29.158935 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1237869f93171c10b1f007e52d7cbad8663de2bcb3c3b12cde3744edcb828247\": container with ID starting with 1237869f93171c10b1f007e52d7cbad8663de2bcb3c3b12cde3744edcb828247 not found: ID does not exist" containerID="1237869f93171c10b1f007e52d7cbad8663de2bcb3c3b12cde3744edcb828247" Jul 16 08:57:29.159022 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.158961 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1237869f93171c10b1f007e52d7cbad8663de2bcb3c3b12cde3744edcb828247"} err="failed to get container status \"1237869f93171c10b1f007e52d7cbad8663de2bcb3c3b12cde3744edcb828247\": rpc error: code = NotFound desc = could not find container \"1237869f93171c10b1f007e52d7cbad8663de2bcb3c3b12cde3744edcb828247\": container with ID starting with 1237869f93171c10b1f007e52d7cbad8663de2bcb3c3b12cde3744edcb828247 not found: ID does not exist" Jul 16 08:57:29.163379 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.163358 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-oauth-serving-cert\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:29.163379 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.163379 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-console-serving-cert\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:29.163864 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.163388 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-console-oauth-config\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:29.163864 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.163396 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tbht\" (UniqueName: \"kubernetes.io/projected/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-kube-api-access-4tbht\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:29.163864 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.163405 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-console-config\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:29.163864 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.163413 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e-service-ca\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:29.171228 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.171203 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-884c57d84-lv88d"] Jul 16 08:57:29.173971 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:29.173951 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-884c57d84-lv88d"] Jul 16 08:57:30.242230 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:30.242204 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="822384c1-9de1-4c0e-90cf-05f7ce9b9d0e" path="/var/lib/kubelet/pods/822384c1-9de1-4c0e-90cf-05f7ce9b9d0e/volumes" Jul 16 08:57:52.936673 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:52.936643 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 08:57:52.937186 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:52.936917 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="alertmanager" containerID="cri-o://1cf65e23de617a87106fe0c6fc1c71d96eeb139e6d0eb9b32798eb68bfa328c3" gracePeriod=120 Jul 16 08:57:52.937186 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:52.936992 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="kube-rbac-proxy-metric" containerID="cri-o://de97a5b60557849172ec4be900d3361cc627dfbe8289af64e22df7522063e97f" gracePeriod=120 Jul 16 08:57:52.937186 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:52.937040 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="kube-rbac-proxy-web" containerID="cri-o://50fcfea8b11e30deca872bb81dcbaf1de54c36f4f3b4d7277d42e070eaa50bb6" gracePeriod=120 Jul 16 08:57:52.937186 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:52.937085 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="config-reloader" containerID="cri-o://c36d897c64c8a988b4273c64336d3c8bd32a5bde41609bd124da91490f7fa43d" gracePeriod=120 Jul 16 08:57:52.937186 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:52.937117 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="prom-label-proxy" containerID="cri-o://453cf2b4ca6eab30b5e79d85f612b661e9d9d1bd3272e87c91cb11cea54c383e" gracePeriod=120 Jul 16 08:57:52.937186 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:52.937111 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="kube-rbac-proxy" containerID="cri-o://ef88b7a047d13047834da0c9f8df6259eec6fc1fa206d0798d222703921b1540" gracePeriod=120 Jul 16 08:57:53.238714 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:53.238649 2559 generic.go:356] "Generic (PLEG): container finished" podID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerID="453cf2b4ca6eab30b5e79d85f612b661e9d9d1bd3272e87c91cb11cea54c383e" exitCode=0 Jul 16 08:57:53.238714 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:53.238669 2559 generic.go:356] "Generic (PLEG): container finished" podID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerID="ef88b7a047d13047834da0c9f8df6259eec6fc1fa206d0798d222703921b1540" exitCode=0 Jul 16 08:57:53.238714 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:53.238674 2559 generic.go:356] "Generic (PLEG): container finished" podID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerID="c36d897c64c8a988b4273c64336d3c8bd32a5bde41609bd124da91490f7fa43d" exitCode=0 Jul 16 08:57:53.238714 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:53.238680 2559 generic.go:356] "Generic (PLEG): container finished" podID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerID="1cf65e23de617a87106fe0c6fc1c71d96eeb139e6d0eb9b32798eb68bfa328c3" exitCode=0 Jul 16 08:57:53.238913 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:53.238727 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d36bb69-982d-4a44-bf12-1253d939fc06","Type":"ContainerDied","Data":"453cf2b4ca6eab30b5e79d85f612b661e9d9d1bd3272e87c91cb11cea54c383e"} Jul 16 08:57:53.238913 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:53.238781 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d36bb69-982d-4a44-bf12-1253d939fc06","Type":"ContainerDied","Data":"ef88b7a047d13047834da0c9f8df6259eec6fc1fa206d0798d222703921b1540"} Jul 16 08:57:53.238913 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:53.238813 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d36bb69-982d-4a44-bf12-1253d939fc06","Type":"ContainerDied","Data":"c36d897c64c8a988b4273c64336d3c8bd32a5bde41609bd124da91490f7fa43d"} Jul 16 08:57:53.238913 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:53.238835 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d36bb69-982d-4a44-bf12-1253d939fc06","Type":"ContainerDied","Data":"1cf65e23de617a87106fe0c6fc1c71d96eeb139e6d0eb9b32798eb68bfa328c3"} Jul 16 08:57:54.174145 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.174124 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.252087 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.252009 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d36bb69-982d-4a44-bf12-1253d939fc06-alertmanager-trusted-ca-bundle\") pod \"8d36bb69-982d-4a44-bf12-1253d939fc06\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " Jul 16 08:57:54.252087 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.252046 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-main-tls\") pod \"8d36bb69-982d-4a44-bf12-1253d939fc06\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " Jul 16 08:57:54.252087 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.252068 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-web-config\") pod \"8d36bb69-982d-4a44-bf12-1253d939fc06\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " Jul 16 08:57:54.252345 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.252101 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8d36bb69-982d-4a44-bf12-1253d939fc06\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " Jul 16 08:57:54.252345 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.252137 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d36bb69-982d-4a44-bf12-1253d939fc06-tls-assets\") pod \"8d36bb69-982d-4a44-bf12-1253d939fc06\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " Jul 16 08:57:54.252345 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.252164 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-cluster-tls-config\") pod \"8d36bb69-982d-4a44-bf12-1253d939fc06\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " Jul 16 08:57:54.252345 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.252208 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8d36bb69-982d-4a44-bf12-1253d939fc06-alertmanager-main-db\") pod \"8d36bb69-982d-4a44-bf12-1253d939fc06\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " Jul 16 08:57:54.252345 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.252237 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbxql\" (UniqueName: \"kubernetes.io/projected/8d36bb69-982d-4a44-bf12-1253d939fc06-kube-api-access-mbxql\") pod \"8d36bb69-982d-4a44-bf12-1253d939fc06\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " Jul 16 08:57:54.252345 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.252260 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-kube-rbac-proxy\") pod \"8d36bb69-982d-4a44-bf12-1253d939fc06\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " Jul 16 08:57:54.252345 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.252290 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d36bb69-982d-4a44-bf12-1253d939fc06-metrics-client-ca\") pod \"8d36bb69-982d-4a44-bf12-1253d939fc06\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " Jul 16 08:57:54.252345 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.252328 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-config-volume\") pod \"8d36bb69-982d-4a44-bf12-1253d939fc06\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " Jul 16 08:57:54.252808 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.252360 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-kube-rbac-proxy-web\") pod \"8d36bb69-982d-4a44-bf12-1253d939fc06\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " Jul 16 08:57:54.252808 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.252396 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d36bb69-982d-4a44-bf12-1253d939fc06-config-out\") pod \"8d36bb69-982d-4a44-bf12-1253d939fc06\" (UID: \"8d36bb69-982d-4a44-bf12-1253d939fc06\") " Jul 16 08:57:54.252808 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.252419 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d36bb69-982d-4a44-bf12-1253d939fc06-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8d36bb69-982d-4a44-bf12-1253d939fc06" (UID: "8d36bb69-982d-4a44-bf12-1253d939fc06"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 08:57:54.252808 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.252500 2559 generic.go:356] "Generic (PLEG): container finished" podID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerID="de97a5b60557849172ec4be900d3361cc627dfbe8289af64e22df7522063e97f" exitCode=0 Jul 16 08:57:54.252808 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.252522 2559 generic.go:356] "Generic (PLEG): container finished" podID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerID="50fcfea8b11e30deca872bb81dcbaf1de54c36f4f3b4d7277d42e070eaa50bb6" exitCode=0 Jul 16 08:57:54.252808 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.252581 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d36bb69-982d-4a44-bf12-1253d939fc06-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:54.252808 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.252597 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d36bb69-982d-4a44-bf12-1253d939fc06","Type":"ContainerDied","Data":"de97a5b60557849172ec4be900d3361cc627dfbe8289af64e22df7522063e97f"} Jul 16 08:57:54.252808 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.252665 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d36bb69-982d-4a44-bf12-1253d939fc06","Type":"ContainerDied","Data":"50fcfea8b11e30deca872bb81dcbaf1de54c36f4f3b4d7277d42e070eaa50bb6"} Jul 16 08:57:54.252808 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.252737 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8d36bb69-982d-4a44-bf12-1253d939fc06","Type":"ContainerDied","Data":"6d6ae499cff19e5427ffbedd5cf82beec5bfde271d14f46b0dd5f2d8c9bf5c1c"} Jul 16 08:57:54.253281 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.252857 2559 scope.go:117] "RemoveContainer" containerID="453cf2b4ca6eab30b5e79d85f612b661e9d9d1bd3272e87c91cb11cea54c383e" Jul 16 08:57:54.253281 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.253157 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.255359 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.255335 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d36bb69-982d-4a44-bf12-1253d939fc06-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8d36bb69-982d-4a44-bf12-1253d939fc06" (UID: "8d36bb69-982d-4a44-bf12-1253d939fc06"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 08:57:54.255808 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.255779 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d36bb69-982d-4a44-bf12-1253d939fc06-config-out" (OuterVolumeSpecName: "config-out") pod "8d36bb69-982d-4a44-bf12-1253d939fc06" (UID: "8d36bb69-982d-4a44-bf12-1253d939fc06"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 08:57:54.256183 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.256106 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d36bb69-982d-4a44-bf12-1253d939fc06-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8d36bb69-982d-4a44-bf12-1253d939fc06" (UID: "8d36bb69-982d-4a44-bf12-1253d939fc06"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 08:57:54.257457 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.257427 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d36bb69-982d-4a44-bf12-1253d939fc06-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8d36bb69-982d-4a44-bf12-1253d939fc06" (UID: "8d36bb69-982d-4a44-bf12-1253d939fc06"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 08:57:54.258056 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.258021 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8d36bb69-982d-4a44-bf12-1253d939fc06" (UID: "8d36bb69-982d-4a44-bf12-1253d939fc06"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 08:57:54.258217 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.258185 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8d36bb69-982d-4a44-bf12-1253d939fc06" (UID: "8d36bb69-982d-4a44-bf12-1253d939fc06"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 08:57:54.258510 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.258457 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d36bb69-982d-4a44-bf12-1253d939fc06-kube-api-access-mbxql" (OuterVolumeSpecName: "kube-api-access-mbxql") pod "8d36bb69-982d-4a44-bf12-1253d939fc06" (UID: "8d36bb69-982d-4a44-bf12-1253d939fc06"). InnerVolumeSpecName "kube-api-access-mbxql". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 08:57:54.258686 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.258650 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-config-volume" (OuterVolumeSpecName: "config-volume") pod "8d36bb69-982d-4a44-bf12-1253d939fc06" (UID: "8d36bb69-982d-4a44-bf12-1253d939fc06"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 08:57:54.258811 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.258782 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8d36bb69-982d-4a44-bf12-1253d939fc06" (UID: "8d36bb69-982d-4a44-bf12-1253d939fc06"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 08:57:54.259796 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.259770 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8d36bb69-982d-4a44-bf12-1253d939fc06" (UID: "8d36bb69-982d-4a44-bf12-1253d939fc06"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 08:57:54.262084 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.262055 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8d36bb69-982d-4a44-bf12-1253d939fc06" (UID: "8d36bb69-982d-4a44-bf12-1253d939fc06"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 08:57:54.268514 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.268494 2559 scope.go:117] "RemoveContainer" containerID="de97a5b60557849172ec4be900d3361cc627dfbe8289af64e22df7522063e97f" Jul 16 08:57:54.268900 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.268878 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-web-config" (OuterVolumeSpecName: "web-config") pod "8d36bb69-982d-4a44-bf12-1253d939fc06" (UID: "8d36bb69-982d-4a44-bf12-1253d939fc06"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 08:57:54.275326 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.275307 2559 scope.go:117] "RemoveContainer" containerID="ef88b7a047d13047834da0c9f8df6259eec6fc1fa206d0798d222703921b1540" Jul 16 08:57:54.281899 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.281881 2559 scope.go:117] "RemoveContainer" containerID="50fcfea8b11e30deca872bb81dcbaf1de54c36f4f3b4d7277d42e070eaa50bb6" Jul 16 08:57:54.288135 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.288119 2559 scope.go:117] "RemoveContainer" containerID="c36d897c64c8a988b4273c64336d3c8bd32a5bde41609bd124da91490f7fa43d" Jul 16 08:57:54.294789 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.294772 2559 scope.go:117] "RemoveContainer" containerID="1cf65e23de617a87106fe0c6fc1c71d96eeb139e6d0eb9b32798eb68bfa328c3" Jul 16 08:57:54.301392 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.301374 2559 scope.go:117] "RemoveContainer" containerID="c9d3df1cbc047669d6d5d60a1fe9b50e0c309b0f5845ea5dc15162c9764b9dbd" Jul 16 08:57:54.307732 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.307715 2559 scope.go:117] "RemoveContainer" containerID="453cf2b4ca6eab30b5e79d85f612b661e9d9d1bd3272e87c91cb11cea54c383e" Jul 16 08:57:54.307976 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:57:54.307958 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"453cf2b4ca6eab30b5e79d85f612b661e9d9d1bd3272e87c91cb11cea54c383e\": container with ID starting with 453cf2b4ca6eab30b5e79d85f612b661e9d9d1bd3272e87c91cb11cea54c383e not found: ID does not exist" containerID="453cf2b4ca6eab30b5e79d85f612b661e9d9d1bd3272e87c91cb11cea54c383e" Jul 16 08:57:54.308056 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.307982 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"453cf2b4ca6eab30b5e79d85f612b661e9d9d1bd3272e87c91cb11cea54c383e"} err="failed to get container status \"453cf2b4ca6eab30b5e79d85f612b661e9d9d1bd3272e87c91cb11cea54c383e\": rpc error: code = NotFound desc = could not find container \"453cf2b4ca6eab30b5e79d85f612b661e9d9d1bd3272e87c91cb11cea54c383e\": container with ID starting with 453cf2b4ca6eab30b5e79d85f612b661e9d9d1bd3272e87c91cb11cea54c383e not found: ID does not exist" Jul 16 08:57:54.308056 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.308001 2559 scope.go:117] "RemoveContainer" containerID="de97a5b60557849172ec4be900d3361cc627dfbe8289af64e22df7522063e97f" Jul 16 08:57:54.308245 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:57:54.308228 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de97a5b60557849172ec4be900d3361cc627dfbe8289af64e22df7522063e97f\": container with ID starting with de97a5b60557849172ec4be900d3361cc627dfbe8289af64e22df7522063e97f not found: ID does not exist" containerID="de97a5b60557849172ec4be900d3361cc627dfbe8289af64e22df7522063e97f" Jul 16 08:57:54.308287 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.308252 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de97a5b60557849172ec4be900d3361cc627dfbe8289af64e22df7522063e97f"} err="failed to get container status \"de97a5b60557849172ec4be900d3361cc627dfbe8289af64e22df7522063e97f\": rpc error: code = NotFound desc = could not find container \"de97a5b60557849172ec4be900d3361cc627dfbe8289af64e22df7522063e97f\": container with ID starting with de97a5b60557849172ec4be900d3361cc627dfbe8289af64e22df7522063e97f not found: ID does not exist" Jul 16 08:57:54.308287 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.308268 2559 scope.go:117] "RemoveContainer" containerID="ef88b7a047d13047834da0c9f8df6259eec6fc1fa206d0798d222703921b1540" Jul 16 08:57:54.308483 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:57:54.308456 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef88b7a047d13047834da0c9f8df6259eec6fc1fa206d0798d222703921b1540\": container with ID starting with ef88b7a047d13047834da0c9f8df6259eec6fc1fa206d0798d222703921b1540 not found: ID does not exist" containerID="ef88b7a047d13047834da0c9f8df6259eec6fc1fa206d0798d222703921b1540" Jul 16 08:57:54.308577 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.308560 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef88b7a047d13047834da0c9f8df6259eec6fc1fa206d0798d222703921b1540"} err="failed to get container status \"ef88b7a047d13047834da0c9f8df6259eec6fc1fa206d0798d222703921b1540\": rpc error: code = NotFound desc = could not find container \"ef88b7a047d13047834da0c9f8df6259eec6fc1fa206d0798d222703921b1540\": container with ID starting with ef88b7a047d13047834da0c9f8df6259eec6fc1fa206d0798d222703921b1540 not found: ID does not exist" Jul 16 08:57:54.308613 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.308578 2559 scope.go:117] "RemoveContainer" containerID="50fcfea8b11e30deca872bb81dcbaf1de54c36f4f3b4d7277d42e070eaa50bb6" Jul 16 08:57:54.308811 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:57:54.308795 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50fcfea8b11e30deca872bb81dcbaf1de54c36f4f3b4d7277d42e070eaa50bb6\": container with ID starting with 50fcfea8b11e30deca872bb81dcbaf1de54c36f4f3b4d7277d42e070eaa50bb6 not found: ID does not exist" containerID="50fcfea8b11e30deca872bb81dcbaf1de54c36f4f3b4d7277d42e070eaa50bb6" Jul 16 08:57:54.308850 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.308815 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50fcfea8b11e30deca872bb81dcbaf1de54c36f4f3b4d7277d42e070eaa50bb6"} err="failed to get container status \"50fcfea8b11e30deca872bb81dcbaf1de54c36f4f3b4d7277d42e070eaa50bb6\": rpc error: code = NotFound desc = could not find container \"50fcfea8b11e30deca872bb81dcbaf1de54c36f4f3b4d7277d42e070eaa50bb6\": container with ID starting with 50fcfea8b11e30deca872bb81dcbaf1de54c36f4f3b4d7277d42e070eaa50bb6 not found: ID does not exist" Jul 16 08:57:54.308850 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.308828 2559 scope.go:117] "RemoveContainer" containerID="c36d897c64c8a988b4273c64336d3c8bd32a5bde41609bd124da91490f7fa43d" Jul 16 08:57:54.309013 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:57:54.308997 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c36d897c64c8a988b4273c64336d3c8bd32a5bde41609bd124da91490f7fa43d\": container with ID starting with c36d897c64c8a988b4273c64336d3c8bd32a5bde41609bd124da91490f7fa43d not found: ID does not exist" containerID="c36d897c64c8a988b4273c64336d3c8bd32a5bde41609bd124da91490f7fa43d" Jul 16 08:57:54.309046 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.309016 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c36d897c64c8a988b4273c64336d3c8bd32a5bde41609bd124da91490f7fa43d"} err="failed to get container status \"c36d897c64c8a988b4273c64336d3c8bd32a5bde41609bd124da91490f7fa43d\": rpc error: code = NotFound desc = could not find container \"c36d897c64c8a988b4273c64336d3c8bd32a5bde41609bd124da91490f7fa43d\": container with ID starting with c36d897c64c8a988b4273c64336d3c8bd32a5bde41609bd124da91490f7fa43d not found: ID does not exist" Jul 16 08:57:54.309046 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.309028 2559 scope.go:117] "RemoveContainer" containerID="1cf65e23de617a87106fe0c6fc1c71d96eeb139e6d0eb9b32798eb68bfa328c3" Jul 16 08:57:54.309206 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:57:54.309191 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cf65e23de617a87106fe0c6fc1c71d96eeb139e6d0eb9b32798eb68bfa328c3\": container with ID starting with 1cf65e23de617a87106fe0c6fc1c71d96eeb139e6d0eb9b32798eb68bfa328c3 not found: ID does not exist" containerID="1cf65e23de617a87106fe0c6fc1c71d96eeb139e6d0eb9b32798eb68bfa328c3" Jul 16 08:57:54.309240 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.309209 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cf65e23de617a87106fe0c6fc1c71d96eeb139e6d0eb9b32798eb68bfa328c3"} err="failed to get container status \"1cf65e23de617a87106fe0c6fc1c71d96eeb139e6d0eb9b32798eb68bfa328c3\": rpc error: code = NotFound desc = could not find container \"1cf65e23de617a87106fe0c6fc1c71d96eeb139e6d0eb9b32798eb68bfa328c3\": container with ID starting with 1cf65e23de617a87106fe0c6fc1c71d96eeb139e6d0eb9b32798eb68bfa328c3 not found: ID does not exist" Jul 16 08:57:54.309240 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.309222 2559 scope.go:117] "RemoveContainer" containerID="c9d3df1cbc047669d6d5d60a1fe9b50e0c309b0f5845ea5dc15162c9764b9dbd" Jul 16 08:57:54.309400 ip-10-0-140-31 kubenswrapper[2559]: E0716 08:57:54.309386 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9d3df1cbc047669d6d5d60a1fe9b50e0c309b0f5845ea5dc15162c9764b9dbd\": container with ID starting with c9d3df1cbc047669d6d5d60a1fe9b50e0c309b0f5845ea5dc15162c9764b9dbd not found: ID does not exist" containerID="c9d3df1cbc047669d6d5d60a1fe9b50e0c309b0f5845ea5dc15162c9764b9dbd" Jul 16 08:57:54.309548 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.309403 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9d3df1cbc047669d6d5d60a1fe9b50e0c309b0f5845ea5dc15162c9764b9dbd"} err="failed to get container status \"c9d3df1cbc047669d6d5d60a1fe9b50e0c309b0f5845ea5dc15162c9764b9dbd\": rpc error: code = NotFound desc = could not find container \"c9d3df1cbc047669d6d5d60a1fe9b50e0c309b0f5845ea5dc15162c9764b9dbd\": container with ID starting with c9d3df1cbc047669d6d5d60a1fe9b50e0c309b0f5845ea5dc15162c9764b9dbd not found: ID does not exist" Jul 16 08:57:54.309548 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.309414 2559 scope.go:117] "RemoveContainer" containerID="453cf2b4ca6eab30b5e79d85f612b661e9d9d1bd3272e87c91cb11cea54c383e" Jul 16 08:57:54.309639 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.309622 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"453cf2b4ca6eab30b5e79d85f612b661e9d9d1bd3272e87c91cb11cea54c383e"} err="failed to get container status \"453cf2b4ca6eab30b5e79d85f612b661e9d9d1bd3272e87c91cb11cea54c383e\": rpc error: code = NotFound desc = could not find container \"453cf2b4ca6eab30b5e79d85f612b661e9d9d1bd3272e87c91cb11cea54c383e\": container with ID starting with 453cf2b4ca6eab30b5e79d85f612b661e9d9d1bd3272e87c91cb11cea54c383e not found: ID does not exist" Jul 16 08:57:54.309673 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.309641 2559 scope.go:117] "RemoveContainer" containerID="de97a5b60557849172ec4be900d3361cc627dfbe8289af64e22df7522063e97f" Jul 16 08:57:54.309846 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.309820 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de97a5b60557849172ec4be900d3361cc627dfbe8289af64e22df7522063e97f"} err="failed to get container status \"de97a5b60557849172ec4be900d3361cc627dfbe8289af64e22df7522063e97f\": rpc error: code = NotFound desc = could not find container \"de97a5b60557849172ec4be900d3361cc627dfbe8289af64e22df7522063e97f\": container with ID starting with de97a5b60557849172ec4be900d3361cc627dfbe8289af64e22df7522063e97f not found: ID does not exist" Jul 16 08:57:54.309900 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.309846 2559 scope.go:117] "RemoveContainer" containerID="ef88b7a047d13047834da0c9f8df6259eec6fc1fa206d0798d222703921b1540" Jul 16 08:57:54.310076 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.310060 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef88b7a047d13047834da0c9f8df6259eec6fc1fa206d0798d222703921b1540"} err="failed to get container status \"ef88b7a047d13047834da0c9f8df6259eec6fc1fa206d0798d222703921b1540\": rpc error: code = NotFound desc = could not find container \"ef88b7a047d13047834da0c9f8df6259eec6fc1fa206d0798d222703921b1540\": container with ID starting with ef88b7a047d13047834da0c9f8df6259eec6fc1fa206d0798d222703921b1540 not found: ID does not exist" Jul 16 08:57:54.310116 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.310077 2559 scope.go:117] "RemoveContainer" containerID="50fcfea8b11e30deca872bb81dcbaf1de54c36f4f3b4d7277d42e070eaa50bb6" Jul 16 08:57:54.310269 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.310254 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50fcfea8b11e30deca872bb81dcbaf1de54c36f4f3b4d7277d42e070eaa50bb6"} err="failed to get container status \"50fcfea8b11e30deca872bb81dcbaf1de54c36f4f3b4d7277d42e070eaa50bb6\": rpc error: code = NotFound desc = could not find container \"50fcfea8b11e30deca872bb81dcbaf1de54c36f4f3b4d7277d42e070eaa50bb6\": container with ID starting with 50fcfea8b11e30deca872bb81dcbaf1de54c36f4f3b4d7277d42e070eaa50bb6 not found: ID does not exist" Jul 16 08:57:54.310309 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.310270 2559 scope.go:117] "RemoveContainer" containerID="c36d897c64c8a988b4273c64336d3c8bd32a5bde41609bd124da91490f7fa43d" Jul 16 08:57:54.310486 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.310447 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c36d897c64c8a988b4273c64336d3c8bd32a5bde41609bd124da91490f7fa43d"} err="failed to get container status \"c36d897c64c8a988b4273c64336d3c8bd32a5bde41609bd124da91490f7fa43d\": rpc error: code = NotFound desc = could not find container \"c36d897c64c8a988b4273c64336d3c8bd32a5bde41609bd124da91490f7fa43d\": container with ID starting with c36d897c64c8a988b4273c64336d3c8bd32a5bde41609bd124da91490f7fa43d not found: ID does not exist" Jul 16 08:57:54.310566 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.310484 2559 scope.go:117] "RemoveContainer" containerID="1cf65e23de617a87106fe0c6fc1c71d96eeb139e6d0eb9b32798eb68bfa328c3" Jul 16 08:57:54.310721 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.310706 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cf65e23de617a87106fe0c6fc1c71d96eeb139e6d0eb9b32798eb68bfa328c3"} err="failed to get container status \"1cf65e23de617a87106fe0c6fc1c71d96eeb139e6d0eb9b32798eb68bfa328c3\": rpc error: code = NotFound desc = could not find container \"1cf65e23de617a87106fe0c6fc1c71d96eeb139e6d0eb9b32798eb68bfa328c3\": container with ID starting with 1cf65e23de617a87106fe0c6fc1c71d96eeb139e6d0eb9b32798eb68bfa328c3 not found: ID does not exist" Jul 16 08:57:54.310769 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.310723 2559 scope.go:117] "RemoveContainer" containerID="c9d3df1cbc047669d6d5d60a1fe9b50e0c309b0f5845ea5dc15162c9764b9dbd" Jul 16 08:57:54.310925 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.310910 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9d3df1cbc047669d6d5d60a1fe9b50e0c309b0f5845ea5dc15162c9764b9dbd"} err="failed to get container status \"c9d3df1cbc047669d6d5d60a1fe9b50e0c309b0f5845ea5dc15162c9764b9dbd\": rpc error: code = NotFound desc = could not find container \"c9d3df1cbc047669d6d5d60a1fe9b50e0c309b0f5845ea5dc15162c9764b9dbd\": container with ID starting with c9d3df1cbc047669d6d5d60a1fe9b50e0c309b0f5845ea5dc15162c9764b9dbd not found: ID does not exist" Jul 16 08:57:54.353433 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.353403 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:54.353433 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.353432 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d36bb69-982d-4a44-bf12-1253d939fc06-tls-assets\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:54.353555 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.353441 2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-cluster-tls-config\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:54.353555 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.353450 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8d36bb69-982d-4a44-bf12-1253d939fc06-alertmanager-main-db\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:54.353555 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.353459 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbxql\" (UniqueName: \"kubernetes.io/projected/8d36bb69-982d-4a44-bf12-1253d939fc06-kube-api-access-mbxql\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:54.353555 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.353486 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:54.353555 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.353494 2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d36bb69-982d-4a44-bf12-1253d939fc06-metrics-client-ca\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:54.353555 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.353502 2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-config-volume\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:54.353555 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.353510 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:54.353555 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.353519 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d36bb69-982d-4a44-bf12-1253d939fc06-config-out\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:54.353555 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.353528 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-secret-alertmanager-main-tls\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:54.353555 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.353536 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d36bb69-982d-4a44-bf12-1253d939fc06-web-config\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 08:57:54.578805 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.578772 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 08:57:54.585140 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.585118 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 08:57:54.611882 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.611865 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 08:57:54.612128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612116 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="alertmanager" Jul 16 08:57:54.612167 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612133 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="alertmanager" Jul 16 08:57:54.612167 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612146 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="config-reloader" Jul 16 08:57:54.612167 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612152 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="config-reloader" Jul 16 08:57:54.612167 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612162 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="kube-rbac-proxy" Jul 16 08:57:54.612167 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612168 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="kube-rbac-proxy" Jul 16 08:57:54.612308 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612173 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="822384c1-9de1-4c0e-90cf-05f7ce9b9d0e" containerName="console" Jul 16 08:57:54.612308 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612179 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="822384c1-9de1-4c0e-90cf-05f7ce9b9d0e" containerName="console" Jul 16 08:57:54.612308 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612190 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="908e56d4-2d21-4ce2-aecf-14845af0e5a5" containerName="registry" Jul 16 08:57:54.612308 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612195 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="908e56d4-2d21-4ce2-aecf-14845af0e5a5" containerName="registry" Jul 16 08:57:54.612308 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612201 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="kube-rbac-proxy-metric" Jul 16 08:57:54.612308 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612206 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="kube-rbac-proxy-metric" Jul 16 08:57:54.612308 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612220 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="init-config-reloader" Jul 16 08:57:54.612308 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612228 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="init-config-reloader" Jul 16 08:57:54.612308 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612234 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="kube-rbac-proxy-web" Jul 16 08:57:54.612308 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612239 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="kube-rbac-proxy-web" Jul 16 08:57:54.612308 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612245 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="prom-label-proxy" Jul 16 08:57:54.612308 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612250 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="prom-label-proxy" Jul 16 08:57:54.612308 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612297 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="908e56d4-2d21-4ce2-aecf-14845af0e5a5" containerName="registry" Jul 16 08:57:54.612308 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612309 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="prom-label-proxy" Jul 16 08:57:54.612725 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612316 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="kube-rbac-proxy-web" Jul 16 08:57:54.612725 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612323 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="config-reloader" Jul 16 08:57:54.612725 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612329 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="kube-rbac-proxy-metric" Jul 16 08:57:54.612725 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612335 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="822384c1-9de1-4c0e-90cf-05f7ce9b9d0e" containerName="console" Jul 16 08:57:54.612725 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612340 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="alertmanager" Jul 16 08:57:54.612725 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.612345 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" containerName="kube-rbac-proxy" Jul 16 08:57:54.617388 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.617373 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.619827 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.619809 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 16 08:57:54.619907 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.619835 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 16 08:57:54.619957 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.619922 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 16 08:57:54.620246 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.620230 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 16 08:57:54.620246 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.620246 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 16 08:57:54.620369 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.620285 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 16 08:57:54.620532 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.620517 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 16 08:57:54.620532 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.620525 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9x7s6\"" Jul 16 08:57:54.620646 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.620540 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 16 08:57:54.627243 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.627226 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 16 08:57:54.630419 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.630400 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 08:57:54.655965 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.655937 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4e4e67d4-db8e-48fa-aff1-85e116528a10-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.656061 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.655990 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e4e67d4-db8e-48fa-aff1-85e116528a10-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.656123 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.656059 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4e4e67d4-db8e-48fa-aff1-85e116528a10-config-out\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.656123 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.656099 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4e4e67d4-db8e-48fa-aff1-85e116528a10-web-config\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.656222 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.656129 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4e4e67d4-db8e-48fa-aff1-85e116528a10-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.656222 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.656159 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4e4e67d4-db8e-48fa-aff1-85e116528a10-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.656222 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.656194 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e4e67d4-db8e-48fa-aff1-85e116528a10-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.656372 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.656219 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4e4e67d4-db8e-48fa-aff1-85e116528a10-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.656372 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.656265 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vj2h\" (UniqueName: \"kubernetes.io/projected/4e4e67d4-db8e-48fa-aff1-85e116528a10-kube-api-access-6vj2h\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.656372 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.656312 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e4e67d4-db8e-48fa-aff1-85e116528a10-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.656372 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.656345 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e4e67d4-db8e-48fa-aff1-85e116528a10-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.656568 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.656380 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4e4e67d4-db8e-48fa-aff1-85e116528a10-config-volume\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.656568 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.656415 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4e4e67d4-db8e-48fa-aff1-85e116528a10-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.757014 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.756992 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4e4e67d4-db8e-48fa-aff1-85e116528a10-config-volume\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.757116 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.757022 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4e4e67d4-db8e-48fa-aff1-85e116528a10-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.757116 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.757040 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4e4e67d4-db8e-48fa-aff1-85e116528a10-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.757116 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.757062 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e4e67d4-db8e-48fa-aff1-85e116528a10-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.757259 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.757190 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4e4e67d4-db8e-48fa-aff1-85e116528a10-config-out\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.757259 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.757220 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4e4e67d4-db8e-48fa-aff1-85e116528a10-web-config\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.757259 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.757248 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4e4e67d4-db8e-48fa-aff1-85e116528a10-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.757387 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.757277 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4e4e67d4-db8e-48fa-aff1-85e116528a10-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.757387 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.757303 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e4e67d4-db8e-48fa-aff1-85e116528a10-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.757387 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.757330 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4e4e67d4-db8e-48fa-aff1-85e116528a10-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.757387 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.757357 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vj2h\" (UniqueName: \"kubernetes.io/projected/4e4e67d4-db8e-48fa-aff1-85e116528a10-kube-api-access-6vj2h\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.757624 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.757396 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e4e67d4-db8e-48fa-aff1-85e116528a10-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.757624 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.757431 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e4e67d4-db8e-48fa-aff1-85e116528a10-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.758424 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.758393 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4e4e67d4-db8e-48fa-aff1-85e116528a10-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.758748 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.758690 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e4e67d4-db8e-48fa-aff1-85e116528a10-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.759164 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.759120 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e4e67d4-db8e-48fa-aff1-85e116528a10-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.760138 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.760101 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4e4e67d4-db8e-48fa-aff1-85e116528a10-config-out\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.760407 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.760256 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4e4e67d4-db8e-48fa-aff1-85e116528a10-config-volume\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.760489 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.760438 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4e4e67d4-db8e-48fa-aff1-85e116528a10-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.760653 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.760629 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4e4e67d4-db8e-48fa-aff1-85e116528a10-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.760755 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.760735 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4e4e67d4-db8e-48fa-aff1-85e116528a10-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.760970 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.760951 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4e4e67d4-db8e-48fa-aff1-85e116528a10-web-config\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.761064 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.761041 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e4e67d4-db8e-48fa-aff1-85e116528a10-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.762182 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.762158 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e4e67d4-db8e-48fa-aff1-85e116528a10-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.762298 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.762284 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4e4e67d4-db8e-48fa-aff1-85e116528a10-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.767512 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.767496 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vj2h\" (UniqueName: \"kubernetes.io/projected/4e4e67d4-db8e-48fa-aff1-85e116528a10-kube-api-access-6vj2h\") pod \"alertmanager-main-0\" (UID: \"4e4e67d4-db8e-48fa-aff1-85e116528a10\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:54.927984 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:54.927927 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 08:57:55.065971 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:55.065948 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 08:57:55.068012 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:57:55.067990 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e4e67d4_db8e_48fa_aff1_85e116528a10.slice/crio-cbcb7c90baa1610672d2df2a8f518a1b00b542d19fd26a69c7e8e909267b66f6 WatchSource:0}: Error finding container cbcb7c90baa1610672d2df2a8f518a1b00b542d19fd26a69c7e8e909267b66f6: Status 404 returned error can't find the container with id cbcb7c90baa1610672d2df2a8f518a1b00b542d19fd26a69c7e8e909267b66f6 Jul 16 08:57:55.257756 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:55.257728 2559 generic.go:356] "Generic (PLEG): container finished" podID="4e4e67d4-db8e-48fa-aff1-85e116528a10" containerID="eb96b98f4104d0a03cc422f452c58e6c15a3c300a000081e41e83071cacdc80a" exitCode=0 Jul 16 08:57:55.258044 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:55.257815 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e4e67d4-db8e-48fa-aff1-85e116528a10","Type":"ContainerDied","Data":"eb96b98f4104d0a03cc422f452c58e6c15a3c300a000081e41e83071cacdc80a"} Jul 16 08:57:55.258044 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:55.257875 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e4e67d4-db8e-48fa-aff1-85e116528a10","Type":"ContainerStarted","Data":"cbcb7c90baa1610672d2df2a8f518a1b00b542d19fd26a69c7e8e909267b66f6"} Jul 16 08:57:56.241953 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.241927 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d36bb69-982d-4a44-bf12-1253d939fc06" path="/var/lib/kubelet/pods/8d36bb69-982d-4a44-bf12-1253d939fc06/volumes" Jul 16 08:57:56.265660 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.265600 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e4e67d4-db8e-48fa-aff1-85e116528a10","Type":"ContainerStarted","Data":"cf05770b17f4e1dfc5961f33e4ca8d238ea8a27911a6026e071365b782000652"} Jul 16 08:57:56.265660 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.265659 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e4e67d4-db8e-48fa-aff1-85e116528a10","Type":"ContainerStarted","Data":"0e91d954c1276cc74f20db38057fdabcc803c502c280f3d656bf714f24e34b85"} Jul 16 08:57:56.266027 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.265685 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e4e67d4-db8e-48fa-aff1-85e116528a10","Type":"ContainerStarted","Data":"e2ad8bea30b423cee713ffabc073acb4afde51e7a22bd7e8807f8989c12eb0a2"} Jul 16 08:57:56.266027 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.265725 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e4e67d4-db8e-48fa-aff1-85e116528a10","Type":"ContainerStarted","Data":"db7795db11112fc8b07d39d20ef6df7e6942211f78dfa72c1f32ab71da077d3d"} Jul 16 08:57:56.266027 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.265752 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e4e67d4-db8e-48fa-aff1-85e116528a10","Type":"ContainerStarted","Data":"9765a714f2a3536c1f8add2b2ed72e02724ac43b621624c41edd944da26ba816"} Jul 16 08:57:56.266027 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.265774 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4e4e67d4-db8e-48fa-aff1-85e116528a10","Type":"ContainerStarted","Data":"af24d1b74ee9c98737978dbd01973d8e3d3988d537e06da96d62e6ae343add6e"} Jul 16 08:57:56.294485 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.294422 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.273546521 podStartE2EDuration="2.294408761s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.86224ms" isStatefulPod=false podCreationTimestamp="2026-07-16 08:57:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:57:56.293270389 +0000 UTC m=+204.582720664" watchObservedRunningTime="2026-07-16 08:57:56.294408761 +0000 UTC m=+204.583859020" Jul 16 08:57:56.962785 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.962754 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-666c5b7df6-srfvh"] Jul 16 08:57:56.967157 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.967131 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:56.969733 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.969711 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wn57t\"" Jul 16 08:57:56.969840 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.969784 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 16 08:57:56.969948 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.969933 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 16 08:57:56.970179 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.970161 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 16 08:57:56.970260 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.970170 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 16 08:57:56.970948 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.970931 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 16 08:57:56.973272 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.973247 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/134a308a-1be9-4021-ac9a-c0dbf8820518-telemeter-trusted-ca-bundle\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:56.973408 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.973287 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/134a308a-1be9-4021-ac9a-c0dbf8820518-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:56.973408 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.973308 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/134a308a-1be9-4021-ac9a-c0dbf8820518-telemeter-client-tls\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:56.973408 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.973334 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/134a308a-1be9-4021-ac9a-c0dbf8820518-serving-certs-ca-bundle\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:56.973408 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.973355 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/134a308a-1be9-4021-ac9a-c0dbf8820518-secret-telemeter-client\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:56.973770 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.973421 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/134a308a-1be9-4021-ac9a-c0dbf8820518-metrics-client-ca\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:56.973770 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.973501 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t5v4\" (UniqueName: \"kubernetes.io/projected/134a308a-1be9-4021-ac9a-c0dbf8820518-kube-api-access-4t5v4\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:56.973770 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.973540 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/134a308a-1be9-4021-ac9a-c0dbf8820518-federate-client-tls\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:56.975682 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.975664 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 16 08:57:56.978837 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:56.978816 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-666c5b7df6-srfvh"] Jul 16 08:57:57.074353 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:57.074330 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/134a308a-1be9-4021-ac9a-c0dbf8820518-serving-certs-ca-bundle\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:57.074450 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:57.074359 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/134a308a-1be9-4021-ac9a-c0dbf8820518-secret-telemeter-client\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:57.074450 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:57.074381 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/134a308a-1be9-4021-ac9a-c0dbf8820518-metrics-client-ca\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:57.074450 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:57.074401 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t5v4\" (UniqueName: \"kubernetes.io/projected/134a308a-1be9-4021-ac9a-c0dbf8820518-kube-api-access-4t5v4\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:57.074450 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:57.074421 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/134a308a-1be9-4021-ac9a-c0dbf8820518-federate-client-tls\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:57.074695 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:57.074463 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/134a308a-1be9-4021-ac9a-c0dbf8820518-telemeter-trusted-ca-bundle\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:57.074695 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:57.074519 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/134a308a-1be9-4021-ac9a-c0dbf8820518-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:57.074695 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:57.074544 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/134a308a-1be9-4021-ac9a-c0dbf8820518-telemeter-client-tls\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:57.075353 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:57.075325 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/134a308a-1be9-4021-ac9a-c0dbf8820518-serving-certs-ca-bundle\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:57.075457 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:57.075353 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/134a308a-1be9-4021-ac9a-c0dbf8820518-metrics-client-ca\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:57.075653 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:57.075629 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/134a308a-1be9-4021-ac9a-c0dbf8820518-telemeter-trusted-ca-bundle\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:57.077044 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:57.077021 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/134a308a-1be9-4021-ac9a-c0dbf8820518-secret-telemeter-client\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:57.077120 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:57.077090 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/134a308a-1be9-4021-ac9a-c0dbf8820518-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:57.077160 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:57.077117 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/134a308a-1be9-4021-ac9a-c0dbf8820518-federate-client-tls\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:57.077277 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:57.077250 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/134a308a-1be9-4021-ac9a-c0dbf8820518-telemeter-client-tls\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:57.082906 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:57.082884 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t5v4\" (UniqueName: \"kubernetes.io/projected/134a308a-1be9-4021-ac9a-c0dbf8820518-kube-api-access-4t5v4\") pod \"telemeter-client-666c5b7df6-srfvh\" (UID: \"134a308a-1be9-4021-ac9a-c0dbf8820518\") " pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:57.277200 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:57.277181 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" Jul 16 08:57:57.417004 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:57.416934 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-666c5b7df6-srfvh"] Jul 16 08:57:57.419212 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:57:57.419183 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod134a308a_1be9_4021_ac9a_c0dbf8820518.slice/crio-f7954552fb3759136478c309391ddf0cd3c97c2953cf4a5986362554e8d60305 WatchSource:0}: Error finding container f7954552fb3759136478c309391ddf0cd3c97c2953cf4a5986362554e8d60305: Status 404 returned error can't find the container with id f7954552fb3759136478c309391ddf0cd3c97c2953cf4a5986362554e8d60305 Jul 16 08:57:58.274974 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:57:58.274928 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" event={"ID":"134a308a-1be9-4021-ac9a-c0dbf8820518","Type":"ContainerStarted","Data":"f7954552fb3759136478c309391ddf0cd3c97c2953cf4a5986362554e8d60305"} Jul 16 08:58:00.283812 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:00.283781 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" event={"ID":"134a308a-1be9-4021-ac9a-c0dbf8820518","Type":"ContainerStarted","Data":"097733c0d73269ca32f2ddac91b04bd26bdc52e81b807dd3ea22206ad5ac9d34"} Jul 16 08:58:00.284168 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:00.283828 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" event={"ID":"134a308a-1be9-4021-ac9a-c0dbf8820518","Type":"ContainerStarted","Data":"e29d3f5e5d323aa27e538c9d26fb94db0590547ee41f2526e62e5f6d1c50c693"} Jul 16 08:58:00.284168 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:00.283853 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" event={"ID":"134a308a-1be9-4021-ac9a-c0dbf8820518","Type":"ContainerStarted","Data":"5696fff1700463114ebd846a063007b5099362f189e53d5421b1f2a91e21c36b"} Jul 16 08:58:00.306192 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:00.306151 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-666c5b7df6-srfvh" podStartSLOduration=2.297369953 podStartE2EDuration="4.306137569s" totalImagesPullingTime="2.008767616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:58:00.305103456 +0000 UTC m=+208.594553715" watchObservedRunningTime="2026-07-16 08:58:00.306137569 +0000 UTC m=+208.595587838" Jul 16 08:58:01.095450 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.095421 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-dccdfb468-t7mbx"] Jul 16 08:58:01.098906 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.098888 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:01.101527 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.101506 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 16 08:58:01.101641 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.101506 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 16 08:58:01.101641 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.101506 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 16 08:58:01.101641 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.101512 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 16 08:58:01.102671 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.102650 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 16 08:58:01.102765 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.102723 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 16 08:58:01.102871 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.102761 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fs8z9\"" Jul 16 08:58:01.103018 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.103000 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 16 08:58:01.107557 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.107532 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 16 08:58:01.108936 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.108916 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dccdfb468-t7mbx"] Jul 16 08:58:01.208579 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.208557 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a70fd964-0561-420f-b487-cd706d9394e4-console-serving-cert\") pod \"console-dccdfb468-t7mbx\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:01.208711 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.208594 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-service-ca\") pod \"console-dccdfb468-t7mbx\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:01.208711 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.208640 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-console-config\") pod \"console-dccdfb468-t7mbx\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:01.208711 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.208664 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-oauth-serving-cert\") pod \"console-dccdfb468-t7mbx\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:01.208846 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.208728 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-trusted-ca-bundle\") pod \"console-dccdfb468-t7mbx\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:01.208846 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.208792 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a70fd964-0561-420f-b487-cd706d9394e4-console-oauth-config\") pod \"console-dccdfb468-t7mbx\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:01.208846 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.208814 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqb5n\" (UniqueName: \"kubernetes.io/projected/a70fd964-0561-420f-b487-cd706d9394e4-kube-api-access-vqb5n\") pod \"console-dccdfb468-t7mbx\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:01.309788 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.309763 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-console-config\") pod \"console-dccdfb468-t7mbx\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:01.310128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.309797 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-oauth-serving-cert\") pod \"console-dccdfb468-t7mbx\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:01.310128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.309842 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-trusted-ca-bundle\") pod \"console-dccdfb468-t7mbx\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:01.310128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.309903 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a70fd964-0561-420f-b487-cd706d9394e4-console-oauth-config\") pod \"console-dccdfb468-t7mbx\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:01.310128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.309946 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqb5n\" (UniqueName: \"kubernetes.io/projected/a70fd964-0561-420f-b487-cd706d9394e4-kube-api-access-vqb5n\") pod \"console-dccdfb468-t7mbx\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:01.310128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.309992 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a70fd964-0561-420f-b487-cd706d9394e4-console-serving-cert\") pod \"console-dccdfb468-t7mbx\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:01.310128 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.310033 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-service-ca\") pod \"console-dccdfb468-t7mbx\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:01.310597 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.310571 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-console-config\") pod \"console-dccdfb468-t7mbx\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:01.310694 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.310616 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-oauth-serving-cert\") pod \"console-dccdfb468-t7mbx\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:01.310952 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.310932 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-service-ca\") pod \"console-dccdfb468-t7mbx\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:01.311141 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.310976 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-trusted-ca-bundle\") pod \"console-dccdfb468-t7mbx\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:01.312777 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.312760 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a70fd964-0561-420f-b487-cd706d9394e4-console-serving-cert\") pod \"console-dccdfb468-t7mbx\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:01.312854 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.312817 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a70fd964-0561-420f-b487-cd706d9394e4-console-oauth-config\") pod \"console-dccdfb468-t7mbx\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:01.322165 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.322148 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqb5n\" (UniqueName: \"kubernetes.io/projected/a70fd964-0561-420f-b487-cd706d9394e4-kube-api-access-vqb5n\") pod \"console-dccdfb468-t7mbx\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:01.410366 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.410313 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:01.538275 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:01.538251 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dccdfb468-t7mbx"] Jul 16 08:58:01.540405 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:58:01.540383 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda70fd964_0561_420f_b487_cd706d9394e4.slice/crio-3a1d75be469771ae6ddbeae1c7d5d164cb7413af25c87bc42503fa236f1ca09e WatchSource:0}: Error finding container 3a1d75be469771ae6ddbeae1c7d5d164cb7413af25c87bc42503fa236f1ca09e: Status 404 returned error can't find the container with id 3a1d75be469771ae6ddbeae1c7d5d164cb7413af25c87bc42503fa236f1ca09e Jul 16 08:58:02.293143 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:02.293107 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dccdfb468-t7mbx" event={"ID":"a70fd964-0561-420f-b487-cd706d9394e4","Type":"ContainerStarted","Data":"a100eda37a5b361c377d63d6e5ae1c46cf853324a20601b4f1c99a04112f40ce"} Jul 16 08:58:02.293305 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:02.293158 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dccdfb468-t7mbx" event={"ID":"a70fd964-0561-420f-b487-cd706d9394e4","Type":"ContainerStarted","Data":"3a1d75be469771ae6ddbeae1c7d5d164cb7413af25c87bc42503fa236f1ca09e"} Jul 16 08:58:02.311944 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:02.311902 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-dccdfb468-t7mbx" podStartSLOduration=1.311888336 podStartE2EDuration="1.311888336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:58:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:58:02.310672378 +0000 UTC m=+210.600122639" watchObservedRunningTime="2026-07-16 08:58:02.311888336 +0000 UTC m=+210.601338596" Jul 16 08:58:11.411013 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:11.410977 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:11.411391 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:11.411055 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:11.415454 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:11.415432 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:58:12.334036 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:58:12.334009 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 08:59:32.133437 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:32.133409 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/2.log" Jul 16 08:59:32.138223 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:32.138198 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/2.log" Jul 16 08:59:32.140420 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:32.140402 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sb2b7_4aa01755-587c-4e81-bf62-974df0ddbf82/ovn-acl-logging/0.log" Jul 16 08:59:32.143934 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:32.143913 2559 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 08:59:32.146092 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:32.146077 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sb2b7_4aa01755-587c-4e81-bf62-974df0ddbf82/ovn-acl-logging/0.log" Jul 16 08:59:33.328515 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.328484 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c8dd6895-cmkks"] Jul 16 08:59:33.331670 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.331649 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:33.341330 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.341309 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c8dd6895-cmkks"] Jul 16 08:59:33.352075 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.352046 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-service-ca\") pod \"console-5c8dd6895-cmkks\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:33.352173 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.352078 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-trusted-ca-bundle\") pod \"console-5c8dd6895-cmkks\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:33.352173 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.352105 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65ced7f2-f5f2-4377-a9f3-54ade33555cc-console-serving-cert\") pod \"console-5c8dd6895-cmkks\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:33.352311 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.352200 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-oauth-serving-cert\") pod \"console-5c8dd6895-cmkks\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:33.352311 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.352237 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65ced7f2-f5f2-4377-a9f3-54ade33555cc-console-oauth-config\") pod \"console-5c8dd6895-cmkks\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:33.352311 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.352258 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-console-config\") pod \"console-5c8dd6895-cmkks\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:33.352311 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.352307 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzkdv\" (UniqueName: \"kubernetes.io/projected/65ced7f2-f5f2-4377-a9f3-54ade33555cc-kube-api-access-qzkdv\") pod \"console-5c8dd6895-cmkks\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:33.452701 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.452658 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzkdv\" (UniqueName: \"kubernetes.io/projected/65ced7f2-f5f2-4377-a9f3-54ade33555cc-kube-api-access-qzkdv\") pod \"console-5c8dd6895-cmkks\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:33.452799 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.452716 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-service-ca\") pod \"console-5c8dd6895-cmkks\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:33.452799 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.452741 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-trusted-ca-bundle\") pod \"console-5c8dd6895-cmkks\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:33.452799 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.452761 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65ced7f2-f5f2-4377-a9f3-54ade33555cc-console-serving-cert\") pod \"console-5c8dd6895-cmkks\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:33.452799 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.452785 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-oauth-serving-cert\") pod \"console-5c8dd6895-cmkks\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:33.452985 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.452818 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65ced7f2-f5f2-4377-a9f3-54ade33555cc-console-oauth-config\") pod \"console-5c8dd6895-cmkks\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:33.452985 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.452846 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-console-config\") pod \"console-5c8dd6895-cmkks\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:33.453572 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.453540 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-service-ca\") pod \"console-5c8dd6895-cmkks\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:33.453732 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.453673 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-console-config\") pod \"console-5c8dd6895-cmkks\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:33.453836 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.453744 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-trusted-ca-bundle\") pod \"console-5c8dd6895-cmkks\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:33.453836 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.453767 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-oauth-serving-cert\") pod \"console-5c8dd6895-cmkks\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:33.455440 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.455420 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65ced7f2-f5f2-4377-a9f3-54ade33555cc-console-oauth-config\") pod \"console-5c8dd6895-cmkks\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:33.455601 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.455582 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65ced7f2-f5f2-4377-a9f3-54ade33555cc-console-serving-cert\") pod \"console-5c8dd6895-cmkks\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:33.461974 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.461952 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzkdv\" (UniqueName: \"kubernetes.io/projected/65ced7f2-f5f2-4377-a9f3-54ade33555cc-kube-api-access-qzkdv\") pod \"console-5c8dd6895-cmkks\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:33.641909 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.641832 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:33.774603 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:33.774580 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c8dd6895-cmkks"] Jul 16 08:59:33.777085 ip-10-0-140-31 kubenswrapper[2559]: W0716 08:59:33.777059 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ced7f2_f5f2_4377_a9f3_54ade33555cc.slice/crio-372d2a4e9c5e4013f5baf2cac3d4e632a449d5e75efa7760740f5976caab99e0 WatchSource:0}: Error finding container 372d2a4e9c5e4013f5baf2cac3d4e632a449d5e75efa7760740f5976caab99e0: Status 404 returned error can't find the container with id 372d2a4e9c5e4013f5baf2cac3d4e632a449d5e75efa7760740f5976caab99e0 Jul 16 08:59:34.630506 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:34.630453 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8dd6895-cmkks" event={"ID":"65ced7f2-f5f2-4377-a9f3-54ade33555cc","Type":"ContainerStarted","Data":"7af42d315d6257e242b4bccbe1569ef7daa93a1602223e16bb85e9de7ebe9ed8"} Jul 16 08:59:34.630869 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:34.630517 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8dd6895-cmkks" event={"ID":"65ced7f2-f5f2-4377-a9f3-54ade33555cc","Type":"ContainerStarted","Data":"372d2a4e9c5e4013f5baf2cac3d4e632a449d5e75efa7760740f5976caab99e0"} Jul 16 08:59:34.651405 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:34.651363 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c8dd6895-cmkks" podStartSLOduration=1.651351148 podStartE2EDuration="1.651351148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 08:59:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 08:59:34.649684727 +0000 UTC m=+302.939134989" watchObservedRunningTime="2026-07-16 08:59:34.651351148 +0000 UTC m=+302.940801454" Jul 16 08:59:43.642171 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:43.642131 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:43.642672 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:43.642222 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:43.646911 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:43.646893 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:43.667792 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:43.667768 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 08:59:43.717401 ip-10-0-140-31 kubenswrapper[2559]: I0716 08:59:43.717373 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dccdfb468-t7mbx"] Jul 16 09:00:08.737952 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:08.737894 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-dccdfb468-t7mbx" podUID="a70fd964-0561-420f-b487-cd706d9394e4" containerName="console" containerID="cri-o://a100eda37a5b361c377d63d6e5ae1c46cf853324a20601b4f1c99a04112f40ce" gracePeriod=15 Jul 16 09:00:08.977105 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:08.977082 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 09:00:09.091002 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.090978 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-oauth-serving-cert\") pod \"a70fd964-0561-420f-b487-cd706d9394e4\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " Jul 16 09:00:09.091172 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.091010 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-trusted-ca-bundle\") pod \"a70fd964-0561-420f-b487-cd706d9394e4\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " Jul 16 09:00:09.091172 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.091052 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-console-config\") pod \"a70fd964-0561-420f-b487-cd706d9394e4\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " Jul 16 09:00:09.091172 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.091074 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqb5n\" (UniqueName: \"kubernetes.io/projected/a70fd964-0561-420f-b487-cd706d9394e4-kube-api-access-vqb5n\") pod \"a70fd964-0561-420f-b487-cd706d9394e4\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " Jul 16 09:00:09.091172 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.091100 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-service-ca\") pod \"a70fd964-0561-420f-b487-cd706d9394e4\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " Jul 16 09:00:09.091172 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.091147 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a70fd964-0561-420f-b487-cd706d9394e4-console-serving-cert\") pod \"a70fd964-0561-420f-b487-cd706d9394e4\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " Jul 16 09:00:09.091494 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.091178 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a70fd964-0561-420f-b487-cd706d9394e4-console-oauth-config\") pod \"a70fd964-0561-420f-b487-cd706d9394e4\" (UID: \"a70fd964-0561-420f-b487-cd706d9394e4\") " Jul 16 09:00:09.091494 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.091429 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a70fd964-0561-420f-b487-cd706d9394e4" (UID: "a70fd964-0561-420f-b487-cd706d9394e4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 09:00:09.091604 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.091489 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a70fd964-0561-420f-b487-cd706d9394e4" (UID: "a70fd964-0561-420f-b487-cd706d9394e4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 09:00:09.091654 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.091619 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-console-config" (OuterVolumeSpecName: "console-config") pod "a70fd964-0561-420f-b487-cd706d9394e4" (UID: "a70fd964-0561-420f-b487-cd706d9394e4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 09:00:09.091708 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.091683 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-service-ca" (OuterVolumeSpecName: "service-ca") pod "a70fd964-0561-420f-b487-cd706d9394e4" (UID: "a70fd964-0561-420f-b487-cd706d9394e4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 09:00:09.093521 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.093460 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a70fd964-0561-420f-b487-cd706d9394e4-kube-api-access-vqb5n" (OuterVolumeSpecName: "kube-api-access-vqb5n") pod "a70fd964-0561-420f-b487-cd706d9394e4" (UID: "a70fd964-0561-420f-b487-cd706d9394e4"). InnerVolumeSpecName "kube-api-access-vqb5n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 09:00:09.093521 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.093461 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a70fd964-0561-420f-b487-cd706d9394e4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a70fd964-0561-420f-b487-cd706d9394e4" (UID: "a70fd964-0561-420f-b487-cd706d9394e4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 09:00:09.093658 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.093576 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a70fd964-0561-420f-b487-cd706d9394e4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a70fd964-0561-420f-b487-cd706d9394e4" (UID: "a70fd964-0561-420f-b487-cd706d9394e4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 09:00:09.192397 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.192369 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-service-ca\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:00:09.192397 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.192390 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a70fd964-0561-420f-b487-cd706d9394e4-console-serving-cert\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:00:09.192397 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.192400 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a70fd964-0561-420f-b487-cd706d9394e4-console-oauth-config\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:00:09.192613 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.192408 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-oauth-serving-cert\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:00:09.192613 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.192416 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-trusted-ca-bundle\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:00:09.192613 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.192424 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a70fd964-0561-420f-b487-cd706d9394e4-console-config\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:00:09.192613 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.192431 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqb5n\" (UniqueName: \"kubernetes.io/projected/a70fd964-0561-420f-b487-cd706d9394e4-kube-api-access-vqb5n\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:00:09.764399 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.764362 2559 generic.go:356] "Generic (PLEG): container finished" podID="a70fd964-0561-420f-b487-cd706d9394e4" containerID="a100eda37a5b361c377d63d6e5ae1c46cf853324a20601b4f1c99a04112f40ce" exitCode=0 Jul 16 09:00:09.764858 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.764407 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dccdfb468-t7mbx" Jul 16 09:00:09.764858 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.764450 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dccdfb468-t7mbx" event={"ID":"a70fd964-0561-420f-b487-cd706d9394e4","Type":"ContainerDied","Data":"a100eda37a5b361c377d63d6e5ae1c46cf853324a20601b4f1c99a04112f40ce"} Jul 16 09:00:09.764858 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.764515 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dccdfb468-t7mbx" event={"ID":"a70fd964-0561-420f-b487-cd706d9394e4","Type":"ContainerDied","Data":"3a1d75be469771ae6ddbeae1c7d5d164cb7413af25c87bc42503fa236f1ca09e"} Jul 16 09:00:09.764858 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.764537 2559 scope.go:117] "RemoveContainer" containerID="a100eda37a5b361c377d63d6e5ae1c46cf853324a20601b4f1c99a04112f40ce" Jul 16 09:00:09.773826 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.773813 2559 scope.go:117] "RemoveContainer" containerID="a100eda37a5b361c377d63d6e5ae1c46cf853324a20601b4f1c99a04112f40ce" Jul 16 09:00:09.774055 ip-10-0-140-31 kubenswrapper[2559]: E0716 09:00:09.774038 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a100eda37a5b361c377d63d6e5ae1c46cf853324a20601b4f1c99a04112f40ce\": container with ID starting with a100eda37a5b361c377d63d6e5ae1c46cf853324a20601b4f1c99a04112f40ce not found: ID does not exist" containerID="a100eda37a5b361c377d63d6e5ae1c46cf853324a20601b4f1c99a04112f40ce" Jul 16 09:00:09.774116 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.774077 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a100eda37a5b361c377d63d6e5ae1c46cf853324a20601b4f1c99a04112f40ce"} err="failed to get container status \"a100eda37a5b361c377d63d6e5ae1c46cf853324a20601b4f1c99a04112f40ce\": rpc error: code = NotFound desc = could not find container \"a100eda37a5b361c377d63d6e5ae1c46cf853324a20601b4f1c99a04112f40ce\": container with ID starting with a100eda37a5b361c377d63d6e5ae1c46cf853324a20601b4f1c99a04112f40ce not found: ID does not exist" Jul 16 09:00:09.786654 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.786631 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dccdfb468-t7mbx"] Jul 16 09:00:09.789981 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:09.789963 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-dccdfb468-t7mbx"] Jul 16 09:00:10.242174 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:10.242149 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a70fd964-0561-420f-b487-cd706d9394e4" path="/var/lib/kubelet/pods/a70fd964-0561-420f-b487-cd706d9394e4/volumes" Jul 16 09:00:18.445807 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:18.445756 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw"] Jul 16 09:00:18.446282 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:18.446052 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a70fd964-0561-420f-b487-cd706d9394e4" containerName="console" Jul 16 09:00:18.446282 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:18.446062 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a70fd964-0561-420f-b487-cd706d9394e4" containerName="console" Jul 16 09:00:18.446282 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:18.446125 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a70fd964-0561-420f-b487-cd706d9394e4" containerName="console" Jul 16 09:00:18.450519 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:18.450502 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw" Jul 16 09:00:18.452892 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:18.452869 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 16 09:00:18.453926 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:18.453911 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fgwgs\"" Jul 16 09:00:18.453986 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:18.453917 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 16 09:00:18.458596 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:18.458572 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw"] Jul 16 09:00:18.561827 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:18.561797 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/551b10d6-bf25-4f40-93f1-65aa4d2d3078-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw\" (UID: \"551b10d6-bf25-4f40-93f1-65aa4d2d3078\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw" Jul 16 09:00:18.561995 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:18.561835 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnbht\" (UniqueName: \"kubernetes.io/projected/551b10d6-bf25-4f40-93f1-65aa4d2d3078-kube-api-access-tnbht\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw\" (UID: \"551b10d6-bf25-4f40-93f1-65aa4d2d3078\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw" Jul 16 09:00:18.561995 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:18.561924 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/551b10d6-bf25-4f40-93f1-65aa4d2d3078-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw\" (UID: \"551b10d6-bf25-4f40-93f1-65aa4d2d3078\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw" Jul 16 09:00:18.663111 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:18.663073 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/551b10d6-bf25-4f40-93f1-65aa4d2d3078-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw\" (UID: \"551b10d6-bf25-4f40-93f1-65aa4d2d3078\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw" Jul 16 09:00:18.663245 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:18.663127 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnbht\" (UniqueName: \"kubernetes.io/projected/551b10d6-bf25-4f40-93f1-65aa4d2d3078-kube-api-access-tnbht\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw\" (UID: \"551b10d6-bf25-4f40-93f1-65aa4d2d3078\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw" Jul 16 09:00:18.663245 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:18.663195 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/551b10d6-bf25-4f40-93f1-65aa4d2d3078-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw\" (UID: \"551b10d6-bf25-4f40-93f1-65aa4d2d3078\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw" Jul 16 09:00:18.663587 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:18.663566 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/551b10d6-bf25-4f40-93f1-65aa4d2d3078-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw\" (UID: \"551b10d6-bf25-4f40-93f1-65aa4d2d3078\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw" Jul 16 09:00:18.663671 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:18.663588 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/551b10d6-bf25-4f40-93f1-65aa4d2d3078-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw\" (UID: \"551b10d6-bf25-4f40-93f1-65aa4d2d3078\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw" Jul 16 09:00:18.672129 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:18.672112 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnbht\" (UniqueName: \"kubernetes.io/projected/551b10d6-bf25-4f40-93f1-65aa4d2d3078-kube-api-access-tnbht\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw\" (UID: \"551b10d6-bf25-4f40-93f1-65aa4d2d3078\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw" Jul 16 09:00:18.760151 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:18.760133 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw" Jul 16 09:00:18.892560 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:18.892538 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw"] Jul 16 09:00:18.894749 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:00:18.894717 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod551b10d6_bf25_4f40_93f1_65aa4d2d3078.slice/crio-c6e8df1ea40ee43579468c6238140e4d3a9542b361f36d9fd4e79e47b4db0e99 WatchSource:0}: Error finding container c6e8df1ea40ee43579468c6238140e4d3a9542b361f36d9fd4e79e47b4db0e99: Status 404 returned error can't find the container with id c6e8df1ea40ee43579468c6238140e4d3a9542b361f36d9fd4e79e47b4db0e99 Jul 16 09:00:18.896614 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:18.896597 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 09:00:19.803735 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:19.803702 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw" event={"ID":"551b10d6-bf25-4f40-93f1-65aa4d2d3078","Type":"ContainerStarted","Data":"c6e8df1ea40ee43579468c6238140e4d3a9542b361f36d9fd4e79e47b4db0e99"} Jul 16 09:00:26.835481 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:26.835440 2559 generic.go:356] "Generic (PLEG): container finished" podID="551b10d6-bf25-4f40-93f1-65aa4d2d3078" containerID="f8cab10ec9c18caecf8a55af84ac9ecb3ff65a2b71af134285a2853fbe755f6f" exitCode=0 Jul 16 09:00:26.835803 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:26.835519 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw" event={"ID":"551b10d6-bf25-4f40-93f1-65aa4d2d3078","Type":"ContainerDied","Data":"f8cab10ec9c18caecf8a55af84ac9ecb3ff65a2b71af134285a2853fbe755f6f"} Jul 16 09:00:29.848906 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:29.848868 2559 generic.go:356] "Generic (PLEG): container finished" podID="551b10d6-bf25-4f40-93f1-65aa4d2d3078" containerID="132c9adb078350614ee664fe0f1c67475b3aa90b06a5a46e3486bab5b71035d7" exitCode=0 Jul 16 09:00:29.849266 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:29.848954 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw" event={"ID":"551b10d6-bf25-4f40-93f1-65aa4d2d3078","Type":"ContainerDied","Data":"132c9adb078350614ee664fe0f1c67475b3aa90b06a5a46e3486bab5b71035d7"} Jul 16 09:00:38.889894 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:38.889863 2559 generic.go:356] "Generic (PLEG): container finished" podID="551b10d6-bf25-4f40-93f1-65aa4d2d3078" containerID="9d11a199df40395953b96c146bb99df7a2468ca6db8aa4f217e9f134e85ddf6d" exitCode=0 Jul 16 09:00:38.890263 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:38.889924 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw" event={"ID":"551b10d6-bf25-4f40-93f1-65aa4d2d3078","Type":"ContainerDied","Data":"9d11a199df40395953b96c146bb99df7a2468ca6db8aa4f217e9f134e85ddf6d"} Jul 16 09:00:40.027989 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:40.027967 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw" Jul 16 09:00:40.132098 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:40.132069 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/551b10d6-bf25-4f40-93f1-65aa4d2d3078-util\") pod \"551b10d6-bf25-4f40-93f1-65aa4d2d3078\" (UID: \"551b10d6-bf25-4f40-93f1-65aa4d2d3078\") " Jul 16 09:00:40.132247 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:40.132162 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnbht\" (UniqueName: \"kubernetes.io/projected/551b10d6-bf25-4f40-93f1-65aa4d2d3078-kube-api-access-tnbht\") pod \"551b10d6-bf25-4f40-93f1-65aa4d2d3078\" (UID: \"551b10d6-bf25-4f40-93f1-65aa4d2d3078\") " Jul 16 09:00:40.132247 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:40.132186 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/551b10d6-bf25-4f40-93f1-65aa4d2d3078-bundle\") pod \"551b10d6-bf25-4f40-93f1-65aa4d2d3078\" (UID: \"551b10d6-bf25-4f40-93f1-65aa4d2d3078\") " Jul 16 09:00:40.132971 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:40.132939 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/551b10d6-bf25-4f40-93f1-65aa4d2d3078-bundle" (OuterVolumeSpecName: "bundle") pod "551b10d6-bf25-4f40-93f1-65aa4d2d3078" (UID: "551b10d6-bf25-4f40-93f1-65aa4d2d3078"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 09:00:40.134552 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:40.134522 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/551b10d6-bf25-4f40-93f1-65aa4d2d3078-kube-api-access-tnbht" (OuterVolumeSpecName: "kube-api-access-tnbht") pod "551b10d6-bf25-4f40-93f1-65aa4d2d3078" (UID: "551b10d6-bf25-4f40-93f1-65aa4d2d3078"). InnerVolumeSpecName "kube-api-access-tnbht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 09:00:40.136987 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:40.136966 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/551b10d6-bf25-4f40-93f1-65aa4d2d3078-util" (OuterVolumeSpecName: "util") pod "551b10d6-bf25-4f40-93f1-65aa4d2d3078" (UID: "551b10d6-bf25-4f40-93f1-65aa4d2d3078"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 09:00:40.233178 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:40.233120 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/551b10d6-bf25-4f40-93f1-65aa4d2d3078-util\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:00:40.233178 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:40.233143 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnbht\" (UniqueName: \"kubernetes.io/projected/551b10d6-bf25-4f40-93f1-65aa4d2d3078-kube-api-access-tnbht\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:00:40.233178 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:40.233154 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/551b10d6-bf25-4f40-93f1-65aa4d2d3078-bundle\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:00:40.900101 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:40.900055 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw" event={"ID":"551b10d6-bf25-4f40-93f1-65aa4d2d3078","Type":"ContainerDied","Data":"c6e8df1ea40ee43579468c6238140e4d3a9542b361f36d9fd4e79e47b4db0e99"} Jul 16 09:00:40.900101 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:40.900104 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6e8df1ea40ee43579468c6238140e4d3a9542b361f36d9fd4e79e47b4db0e99" Jul 16 09:00:40.900275 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:40.900106 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404wgmw" Jul 16 09:00:46.191789 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:46.191758 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d2znz"] Jul 16 09:00:46.192216 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:46.192043 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="551b10d6-bf25-4f40-93f1-65aa4d2d3078" containerName="pull" Jul 16 09:00:46.192216 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:46.192053 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="551b10d6-bf25-4f40-93f1-65aa4d2d3078" containerName="pull" Jul 16 09:00:46.192216 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:46.192061 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="551b10d6-bf25-4f40-93f1-65aa4d2d3078" containerName="extract" Jul 16 09:00:46.192216 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:46.192066 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="551b10d6-bf25-4f40-93f1-65aa4d2d3078" containerName="extract" Jul 16 09:00:46.192216 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:46.192078 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="551b10d6-bf25-4f40-93f1-65aa4d2d3078" containerName="util" Jul 16 09:00:46.192216 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:46.192083 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="551b10d6-bf25-4f40-93f1-65aa4d2d3078" containerName="util" Jul 16 09:00:46.192216 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:46.192137 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="551b10d6-bf25-4f40-93f1-65aa4d2d3078" containerName="extract" Jul 16 09:00:46.195591 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:46.195577 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d2znz" Jul 16 09:00:46.199153 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:46.199134 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 16 09:00:46.199410 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:46.199394 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-794n8\"" Jul 16 09:00:46.199552 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:46.199533 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 16 09:00:46.209687 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:46.209669 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d2znz"] Jul 16 09:00:46.275381 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:46.275355 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e89522d6-97f8-41d5-8ff3-d1ed6f1d4250-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-d2znz\" (UID: \"e89522d6-97f8-41d5-8ff3-d1ed6f1d4250\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d2znz" Jul 16 09:00:46.275494 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:46.275392 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6drn\" (UniqueName: \"kubernetes.io/projected/e89522d6-97f8-41d5-8ff3-d1ed6f1d4250-kube-api-access-k6drn\") pod \"cert-manager-operator-controller-manager-55c444bf86-d2znz\" (UID: \"e89522d6-97f8-41d5-8ff3-d1ed6f1d4250\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d2znz" Jul 16 09:00:46.376666 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:46.376641 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e89522d6-97f8-41d5-8ff3-d1ed6f1d4250-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-d2znz\" (UID: \"e89522d6-97f8-41d5-8ff3-d1ed6f1d4250\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d2znz" Jul 16 09:00:46.376778 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:46.376684 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6drn\" (UniqueName: \"kubernetes.io/projected/e89522d6-97f8-41d5-8ff3-d1ed6f1d4250-kube-api-access-k6drn\") pod \"cert-manager-operator-controller-manager-55c444bf86-d2znz\" (UID: \"e89522d6-97f8-41d5-8ff3-d1ed6f1d4250\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d2znz" Jul 16 09:00:46.377066 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:46.377048 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e89522d6-97f8-41d5-8ff3-d1ed6f1d4250-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-d2znz\" (UID: \"e89522d6-97f8-41d5-8ff3-d1ed6f1d4250\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d2znz" Jul 16 09:00:46.386362 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:46.386336 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6drn\" (UniqueName: \"kubernetes.io/projected/e89522d6-97f8-41d5-8ff3-d1ed6f1d4250-kube-api-access-k6drn\") pod \"cert-manager-operator-controller-manager-55c444bf86-d2znz\" (UID: \"e89522d6-97f8-41d5-8ff3-d1ed6f1d4250\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d2znz" Jul 16 09:00:46.504986 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:46.504966 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d2znz" Jul 16 09:00:46.641317 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:46.641294 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d2znz"] Jul 16 09:00:46.644143 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:00:46.644116 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode89522d6_97f8_41d5_8ff3_d1ed6f1d4250.slice/crio-aa58dc3df4e64707484d58146c523dc596def288f724ec5ed38184245516a0e5 WatchSource:0}: Error finding container aa58dc3df4e64707484d58146c523dc596def288f724ec5ed38184245516a0e5: Status 404 returned error can't find the container with id aa58dc3df4e64707484d58146c523dc596def288f724ec5ed38184245516a0e5 Jul 16 09:00:46.926107 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:46.926037 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d2znz" event={"ID":"e89522d6-97f8-41d5-8ff3-d1ed6f1d4250","Type":"ContainerStarted","Data":"aa58dc3df4e64707484d58146c523dc596def288f724ec5ed38184245516a0e5"} Jul 16 09:00:48.936632 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:48.936595 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d2znz" event={"ID":"e89522d6-97f8-41d5-8ff3-d1ed6f1d4250","Type":"ContainerStarted","Data":"84e8af7cc037964740abc5c47c2a9858010d596f8719160990161e2f39e53547"} Jul 16 09:00:48.957180 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:48.957132 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-d2znz" podStartSLOduration=1.226044812 podStartE2EDuration="2.957115105s" totalImagesPullingTime="1.731070293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:00:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:00:48.956002461 +0000 UTC m=+377.245452731" watchObservedRunningTime="2026-07-16 09:00:48.957115105 +0000 UTC m=+377.246565362" Jul 16 09:00:49.580176 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:49.580141 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-j6wl9"] Jul 16 09:00:49.582389 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:49.582373 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-j6wl9" Jul 16 09:00:49.585352 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:49.585330 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 16 09:00:49.586522 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:49.586509 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 16 09:00:49.586580 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:49.586563 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6gnxb\"" Jul 16 09:00:49.604893 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:49.604870 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-j6wl9"] Jul 16 09:00:49.701306 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:49.701281 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd83d674-4127-4391-a204-9364b321f428-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-j6wl9\" (UID: \"fd83d674-4127-4391-a204-9364b321f428\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j6wl9" Jul 16 09:00:49.701424 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:49.701337 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj9mk\" (UniqueName: \"kubernetes.io/projected/fd83d674-4127-4391-a204-9364b321f428-kube-api-access-gj9mk\") pod \"cert-manager-webhook-6486ffd997-j6wl9\" (UID: \"fd83d674-4127-4391-a204-9364b321f428\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j6wl9" Jul 16 09:00:49.802433 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:49.802409 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj9mk\" (UniqueName: \"kubernetes.io/projected/fd83d674-4127-4391-a204-9364b321f428-kube-api-access-gj9mk\") pod \"cert-manager-webhook-6486ffd997-j6wl9\" (UID: \"fd83d674-4127-4391-a204-9364b321f428\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j6wl9" Jul 16 09:00:49.802564 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:49.802455 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd83d674-4127-4391-a204-9364b321f428-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-j6wl9\" (UID: \"fd83d674-4127-4391-a204-9364b321f428\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j6wl9" Jul 16 09:00:49.812188 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:49.812168 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd83d674-4127-4391-a204-9364b321f428-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-j6wl9\" (UID: \"fd83d674-4127-4391-a204-9364b321f428\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j6wl9" Jul 16 09:00:49.812314 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:49.812297 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj9mk\" (UniqueName: \"kubernetes.io/projected/fd83d674-4127-4391-a204-9364b321f428-kube-api-access-gj9mk\") pod \"cert-manager-webhook-6486ffd997-j6wl9\" (UID: \"fd83d674-4127-4391-a204-9364b321f428\") " pod="cert-manager/cert-manager-webhook-6486ffd997-j6wl9" Jul 16 09:00:49.891404 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:49.891301 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-j6wl9" Jul 16 09:00:50.027679 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:50.027658 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-j6wl9"] Jul 16 09:00:50.029533 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:00:50.029507 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd83d674_4127_4391_a204_9364b321f428.slice/crio-746dc1e00121041af7db94b2db02222b7a19edb65d3edac3e4e34ac71015eea1 WatchSource:0}: Error finding container 746dc1e00121041af7db94b2db02222b7a19edb65d3edac3e4e34ac71015eea1: Status 404 returned error can't find the container with id 746dc1e00121041af7db94b2db02222b7a19edb65d3edac3e4e34ac71015eea1 Jul 16 09:00:50.727603 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:50.727574 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz"] Jul 16 09:00:50.731133 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:50.731114 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz" Jul 16 09:00:50.733818 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:50.733798 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 16 09:00:50.735918 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:50.735902 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 16 09:00:50.735918 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:50.735909 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fgwgs\"" Jul 16 09:00:50.739237 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:50.738809 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz"] Jul 16 09:00:50.810649 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:50.810618 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/416c980f-c3cd-43a8-b69a-fbf9258850a4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz\" (UID: \"416c980f-c3cd-43a8-b69a-fbf9258850a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz" Jul 16 09:00:50.810776 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:50.810656 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdh62\" (UniqueName: \"kubernetes.io/projected/416c980f-c3cd-43a8-b69a-fbf9258850a4-kube-api-access-wdh62\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz\" (UID: \"416c980f-c3cd-43a8-b69a-fbf9258850a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz" Jul 16 09:00:50.810776 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:50.810764 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/416c980f-c3cd-43a8-b69a-fbf9258850a4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz\" (UID: \"416c980f-c3cd-43a8-b69a-fbf9258850a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz" Jul 16 09:00:50.911082 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:50.911058 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/416c980f-c3cd-43a8-b69a-fbf9258850a4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz\" (UID: \"416c980f-c3cd-43a8-b69a-fbf9258850a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz" Jul 16 09:00:50.911183 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:50.911087 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/416c980f-c3cd-43a8-b69a-fbf9258850a4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz\" (UID: \"416c980f-c3cd-43a8-b69a-fbf9258850a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz" Jul 16 09:00:50.911183 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:50.911110 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdh62\" (UniqueName: \"kubernetes.io/projected/416c980f-c3cd-43a8-b69a-fbf9258850a4-kube-api-access-wdh62\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz\" (UID: \"416c980f-c3cd-43a8-b69a-fbf9258850a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz" Jul 16 09:00:50.911514 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:50.911495 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/416c980f-c3cd-43a8-b69a-fbf9258850a4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz\" (UID: \"416c980f-c3cd-43a8-b69a-fbf9258850a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz" Jul 16 09:00:50.911514 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:50.911506 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/416c980f-c3cd-43a8-b69a-fbf9258850a4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz\" (UID: \"416c980f-c3cd-43a8-b69a-fbf9258850a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz" Jul 16 09:00:50.919765 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:50.919740 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdh62\" (UniqueName: \"kubernetes.io/projected/416c980f-c3cd-43a8-b69a-fbf9258850a4-kube-api-access-wdh62\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz\" (UID: \"416c980f-c3cd-43a8-b69a-fbf9258850a4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz" Jul 16 09:00:50.948259 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:50.948234 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-j6wl9" event={"ID":"fd83d674-4127-4391-a204-9364b321f428","Type":"ContainerStarted","Data":"746dc1e00121041af7db94b2db02222b7a19edb65d3edac3e4e34ac71015eea1"} Jul 16 09:00:51.042672 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:51.042650 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz" Jul 16 09:00:51.172587 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:51.172562 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz"] Jul 16 09:00:51.173646 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:00:51.173622 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod416c980f_c3cd_43a8_b69a_fbf9258850a4.slice/crio-9936f4a18dced6b35c727573e58ad87ddd88e424ab6a5bbf5e6177bfb3083a45 WatchSource:0}: Error finding container 9936f4a18dced6b35c727573e58ad87ddd88e424ab6a5bbf5e6177bfb3083a45: Status 404 returned error can't find the container with id 9936f4a18dced6b35c727573e58ad87ddd88e424ab6a5bbf5e6177bfb3083a45 Jul 16 09:00:51.954038 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:51.954005 2559 generic.go:356] "Generic (PLEG): container finished" podID="416c980f-c3cd-43a8-b69a-fbf9258850a4" containerID="29964ad78686a57e228621abbe12497ce1ddece644e7003caa79a77ea401f74d" exitCode=0 Jul 16 09:00:51.954197 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:51.954092 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz" event={"ID":"416c980f-c3cd-43a8-b69a-fbf9258850a4","Type":"ContainerDied","Data":"29964ad78686a57e228621abbe12497ce1ddece644e7003caa79a77ea401f74d"} Jul 16 09:00:51.954197 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:51.954151 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz" event={"ID":"416c980f-c3cd-43a8-b69a-fbf9258850a4","Type":"ContainerStarted","Data":"9936f4a18dced6b35c727573e58ad87ddd88e424ab6a5bbf5e6177bfb3083a45"} Jul 16 09:00:54.971026 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:54.970966 2559 generic.go:356] "Generic (PLEG): container finished" podID="416c980f-c3cd-43a8-b69a-fbf9258850a4" containerID="a47babe9414310e62ece727a666834cd6a3a957350eacb15d56208ebaed4f08f" exitCode=0 Jul 16 09:00:54.971364 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:54.971057 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz" event={"ID":"416c980f-c3cd-43a8-b69a-fbf9258850a4","Type":"ContainerDied","Data":"a47babe9414310e62ece727a666834cd6a3a957350eacb15d56208ebaed4f08f"} Jul 16 09:00:54.972766 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:54.972733 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-j6wl9" event={"ID":"fd83d674-4127-4391-a204-9364b321f428","Type":"ContainerStarted","Data":"e40ea19fa729eee2f06e0101d14e5997a20241013166b3fd0fe3377a897e2f3d"} Jul 16 09:00:54.972872 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:54.972809 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-j6wl9" Jul 16 09:00:55.006942 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:55.006905 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-j6wl9" podStartSLOduration=1.368043334 podStartE2EDuration="6.006892627s" totalImagesPullingTime="4.638849293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:00:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:00:55.005253875 +0000 UTC m=+383.294704135" watchObservedRunningTime="2026-07-16 09:00:55.006892627 +0000 UTC m=+383.296342886" Jul 16 09:00:55.979652 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:55.979616 2559 generic.go:356] "Generic (PLEG): container finished" podID="416c980f-c3cd-43a8-b69a-fbf9258850a4" containerID="56ef1af8e0507d2e3165a81e77d57100a4af2f2e8e3da050fc917c6fceb1f9ee" exitCode=0 Jul 16 09:00:55.980109 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:55.979696 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz" event={"ID":"416c980f-c3cd-43a8-b69a-fbf9258850a4","Type":"ContainerDied","Data":"56ef1af8e0507d2e3165a81e77d57100a4af2f2e8e3da050fc917c6fceb1f9ee"} Jul 16 09:00:57.109312 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:57.109290 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz" Jul 16 09:00:57.267410 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:57.267378 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/416c980f-c3cd-43a8-b69a-fbf9258850a4-util\") pod \"416c980f-c3cd-43a8-b69a-fbf9258850a4\" (UID: \"416c980f-c3cd-43a8-b69a-fbf9258850a4\") " Jul 16 09:00:57.267600 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:57.267425 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdh62\" (UniqueName: \"kubernetes.io/projected/416c980f-c3cd-43a8-b69a-fbf9258850a4-kube-api-access-wdh62\") pod \"416c980f-c3cd-43a8-b69a-fbf9258850a4\" (UID: \"416c980f-c3cd-43a8-b69a-fbf9258850a4\") " Jul 16 09:00:57.267600 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:57.267487 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/416c980f-c3cd-43a8-b69a-fbf9258850a4-bundle\") pod \"416c980f-c3cd-43a8-b69a-fbf9258850a4\" (UID: \"416c980f-c3cd-43a8-b69a-fbf9258850a4\") " Jul 16 09:00:57.267880 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:57.267856 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/416c980f-c3cd-43a8-b69a-fbf9258850a4-bundle" (OuterVolumeSpecName: "bundle") pod "416c980f-c3cd-43a8-b69a-fbf9258850a4" (UID: "416c980f-c3cd-43a8-b69a-fbf9258850a4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 09:00:57.269809 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:57.269784 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/416c980f-c3cd-43a8-b69a-fbf9258850a4-kube-api-access-wdh62" (OuterVolumeSpecName: "kube-api-access-wdh62") pod "416c980f-c3cd-43a8-b69a-fbf9258850a4" (UID: "416c980f-c3cd-43a8-b69a-fbf9258850a4"). InnerVolumeSpecName "kube-api-access-wdh62". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 09:00:57.273050 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:57.273027 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/416c980f-c3cd-43a8-b69a-fbf9258850a4-util" (OuterVolumeSpecName: "util") pod "416c980f-c3cd-43a8-b69a-fbf9258850a4" (UID: "416c980f-c3cd-43a8-b69a-fbf9258850a4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 09:00:57.368015 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:57.367995 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/416c980f-c3cd-43a8-b69a-fbf9258850a4-util\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:00:57.368015 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:57.368016 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdh62\" (UniqueName: \"kubernetes.io/projected/416c980f-c3cd-43a8-b69a-fbf9258850a4-kube-api-access-wdh62\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:00:57.368143 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:57.368026 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/416c980f-c3cd-43a8-b69a-fbf9258850a4-bundle\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:00:57.990720 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:57.990697 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz" Jul 16 09:00:57.990720 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:57.990702 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7gwsz" event={"ID":"416c980f-c3cd-43a8-b69a-fbf9258850a4","Type":"ContainerDied","Data":"9936f4a18dced6b35c727573e58ad87ddd88e424ab6a5bbf5e6177bfb3083a45"} Jul 16 09:00:57.990872 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:00:57.990740 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9936f4a18dced6b35c727573e58ad87ddd88e424ab6a5bbf5e6177bfb3083a45" Jul 16 09:01:00.927969 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:00.927938 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zf8bt"] Jul 16 09:01:00.928322 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:00.928218 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="416c980f-c3cd-43a8-b69a-fbf9258850a4" containerName="pull" Jul 16 09:01:00.928322 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:00.928228 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="416c980f-c3cd-43a8-b69a-fbf9258850a4" containerName="pull" Jul 16 09:01:00.928322 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:00.928239 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="416c980f-c3cd-43a8-b69a-fbf9258850a4" containerName="util" Jul 16 09:01:00.928322 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:00.928244 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="416c980f-c3cd-43a8-b69a-fbf9258850a4" containerName="util" Jul 16 09:01:00.928322 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:00.928262 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="416c980f-c3cd-43a8-b69a-fbf9258850a4" containerName="extract" Jul 16 09:01:00.928322 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:00.928267 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="416c980f-c3cd-43a8-b69a-fbf9258850a4" containerName="extract" Jul 16 09:01:00.928322 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:00.928323 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="416c980f-c3cd-43a8-b69a-fbf9258850a4" containerName="extract" Jul 16 09:01:00.932392 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:00.932377 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zf8bt" Jul 16 09:01:00.934656 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:00.934641 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-w4kkc\"" Jul 16 09:01:00.940662 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:00.940641 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zf8bt"] Jul 16 09:01:00.981999 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:00.981980 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-j6wl9" Jul 16 09:01:01.094328 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:01.094295 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d658c2f4-606e-4752-95f4-62cad136a1aa-bound-sa-token\") pod \"cert-manager-55b4d954d5-zf8bt\" (UID: \"d658c2f4-606e-4752-95f4-62cad136a1aa\") " pod="cert-manager/cert-manager-55b4d954d5-zf8bt" Jul 16 09:01:01.094494 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:01.094333 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sknv\" (UniqueName: \"kubernetes.io/projected/d658c2f4-606e-4752-95f4-62cad136a1aa-kube-api-access-2sknv\") pod \"cert-manager-55b4d954d5-zf8bt\" (UID: \"d658c2f4-606e-4752-95f4-62cad136a1aa\") " pod="cert-manager/cert-manager-55b4d954d5-zf8bt" Jul 16 09:01:01.195783 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:01.195717 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d658c2f4-606e-4752-95f4-62cad136a1aa-bound-sa-token\") pod \"cert-manager-55b4d954d5-zf8bt\" (UID: \"d658c2f4-606e-4752-95f4-62cad136a1aa\") " pod="cert-manager/cert-manager-55b4d954d5-zf8bt" Jul 16 09:01:01.195783 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:01.195751 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sknv\" (UniqueName: \"kubernetes.io/projected/d658c2f4-606e-4752-95f4-62cad136a1aa-kube-api-access-2sknv\") pod \"cert-manager-55b4d954d5-zf8bt\" (UID: \"d658c2f4-606e-4752-95f4-62cad136a1aa\") " pod="cert-manager/cert-manager-55b4d954d5-zf8bt" Jul 16 09:01:01.206799 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:01.206769 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d658c2f4-606e-4752-95f4-62cad136a1aa-bound-sa-token\") pod \"cert-manager-55b4d954d5-zf8bt\" (UID: \"d658c2f4-606e-4752-95f4-62cad136a1aa\") " pod="cert-manager/cert-manager-55b4d954d5-zf8bt" Jul 16 09:01:01.206957 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:01.206938 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sknv\" (UniqueName: \"kubernetes.io/projected/d658c2f4-606e-4752-95f4-62cad136a1aa-kube-api-access-2sknv\") pod \"cert-manager-55b4d954d5-zf8bt\" (UID: \"d658c2f4-606e-4752-95f4-62cad136a1aa\") " pod="cert-manager/cert-manager-55b4d954d5-zf8bt" Jul 16 09:01:01.241911 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:01.241885 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zf8bt" Jul 16 09:01:01.373048 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:01.373026 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zf8bt"] Jul 16 09:01:01.375277 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:01:01.375246 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd658c2f4_606e_4752_95f4_62cad136a1aa.slice/crio-e04017f377e557044dc90b54baab67527f7fdc2e14af4c4f939ad2aae013e805 WatchSource:0}: Error finding container e04017f377e557044dc90b54baab67527f7fdc2e14af4c4f939ad2aae013e805: Status 404 returned error can't find the container with id e04017f377e557044dc90b54baab67527f7fdc2e14af4c4f939ad2aae013e805 Jul 16 09:01:02.014157 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:02.014118 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zf8bt" event={"ID":"d658c2f4-606e-4752-95f4-62cad136a1aa","Type":"ContainerStarted","Data":"8e6112cbd482778d2e425e667b25478802ea1cf034347dcd476378c1d643165f"} Jul 16 09:01:02.014157 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:02.014170 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zf8bt" event={"ID":"d658c2f4-606e-4752-95f4-62cad136a1aa","Type":"ContainerStarted","Data":"e04017f377e557044dc90b54baab67527f7fdc2e14af4c4f939ad2aae013e805"} Jul 16 09:01:02.032877 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:02.032828 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-zf8bt" podStartSLOduration=2.032814647 podStartE2EDuration="2.032814647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:01:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:01:02.031058292 +0000 UTC m=+390.320508659" watchObservedRunningTime="2026-07-16 09:01:02.032814647 +0000 UTC m=+390.322264906" Jul 16 09:01:04.176990 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:04.176953 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gksm5"] Jul 16 09:01:04.180857 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:04.180841 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gksm5" Jul 16 09:01:04.183421 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:04.183405 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 16 09:01:04.184448 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:04.184428 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-2d92r\"" Jul 16 09:01:04.184565 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:04.184465 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 16 09:01:04.189124 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:04.189104 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gksm5"] Jul 16 09:01:04.317895 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:04.317863 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc22q\" (UniqueName: \"kubernetes.io/projected/038d7e6b-3a69-42fc-95c6-4da78a5b00e6-kube-api-access-sc22q\") pod \"openshift-lws-operator-fd8ccff4c-gksm5\" (UID: \"038d7e6b-3a69-42fc-95c6-4da78a5b00e6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gksm5" Jul 16 09:01:04.318054 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:04.317904 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/038d7e6b-3a69-42fc-95c6-4da78a5b00e6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gksm5\" (UID: \"038d7e6b-3a69-42fc-95c6-4da78a5b00e6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gksm5" Jul 16 09:01:04.418828 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:04.418799 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc22q\" (UniqueName: \"kubernetes.io/projected/038d7e6b-3a69-42fc-95c6-4da78a5b00e6-kube-api-access-sc22q\") pod \"openshift-lws-operator-fd8ccff4c-gksm5\" (UID: \"038d7e6b-3a69-42fc-95c6-4da78a5b00e6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gksm5" Jul 16 09:01:04.418941 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:04.418839 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/038d7e6b-3a69-42fc-95c6-4da78a5b00e6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gksm5\" (UID: \"038d7e6b-3a69-42fc-95c6-4da78a5b00e6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gksm5" Jul 16 09:01:04.419535 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:04.419515 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/038d7e6b-3a69-42fc-95c6-4da78a5b00e6-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gksm5\" (UID: \"038d7e6b-3a69-42fc-95c6-4da78a5b00e6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gksm5" Jul 16 09:01:04.427806 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:04.427755 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc22q\" (UniqueName: \"kubernetes.io/projected/038d7e6b-3a69-42fc-95c6-4da78a5b00e6-kube-api-access-sc22q\") pod \"openshift-lws-operator-fd8ccff4c-gksm5\" (UID: \"038d7e6b-3a69-42fc-95c6-4da78a5b00e6\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gksm5" Jul 16 09:01:04.491590 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:04.491569 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gksm5" Jul 16 09:01:04.649661 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:04.649638 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gksm5"] Jul 16 09:01:04.651773 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:01:04.651745 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod038d7e6b_3a69_42fc_95c6_4da78a5b00e6.slice/crio-274c65156cb706525d8d28c86303442835bad69519fefa0ae7e757467a0399a1 WatchSource:0}: Error finding container 274c65156cb706525d8d28c86303442835bad69519fefa0ae7e757467a0399a1: Status 404 returned error can't find the container with id 274c65156cb706525d8d28c86303442835bad69519fefa0ae7e757467a0399a1 Jul 16 09:01:05.028365 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:05.028332 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gksm5" event={"ID":"038d7e6b-3a69-42fc-95c6-4da78a5b00e6","Type":"ContainerStarted","Data":"274c65156cb706525d8d28c86303442835bad69519fefa0ae7e757467a0399a1"} Jul 16 09:01:08.046733 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:08.046690 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gksm5" event={"ID":"038d7e6b-3a69-42fc-95c6-4da78a5b00e6","Type":"ContainerStarted","Data":"4ce2ec775fb4460efbed7dad853445fa0a85d47ee3d1d233c4dcf45b5ecc62cd"} Jul 16 09:01:08.064439 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:08.064389 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gksm5" podStartSLOduration=1.7130188130000001 podStartE2EDuration="4.064374773s" totalImagesPullingTime="2.35135596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:01:08.063168556 +0000 UTC m=+396.352618823" watchObservedRunningTime="2026-07-16 09:01:08.064374773 +0000 UTC m=+396.353825033" Jul 16 09:01:10.388528 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:10.388495 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4"] Jul 16 09:01:10.391138 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:10.391122 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4" Jul 16 09:01:10.393525 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:10.393501 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 16 09:01:10.393686 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:10.393543 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fgwgs\"" Jul 16 09:01:10.393686 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:10.393595 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 16 09:01:10.404703 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:10.404680 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4"] Jul 16 09:01:10.463818 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:10.463792 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5864b64-7a05-48bc-b005-4ff6c9ed586b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4\" (UID: \"b5864b64-7a05-48bc-b005-4ff6c9ed586b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4" Jul 16 09:01:10.463923 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:10.463842 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swf5c\" (UniqueName: \"kubernetes.io/projected/b5864b64-7a05-48bc-b005-4ff6c9ed586b-kube-api-access-swf5c\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4\" (UID: \"b5864b64-7a05-48bc-b005-4ff6c9ed586b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4" Jul 16 09:01:10.463965 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:10.463941 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5864b64-7a05-48bc-b005-4ff6c9ed586b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4\" (UID: \"b5864b64-7a05-48bc-b005-4ff6c9ed586b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4" Jul 16 09:01:10.564221 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:10.564198 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swf5c\" (UniqueName: \"kubernetes.io/projected/b5864b64-7a05-48bc-b005-4ff6c9ed586b-kube-api-access-swf5c\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4\" (UID: \"b5864b64-7a05-48bc-b005-4ff6c9ed586b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4" Jul 16 09:01:10.564314 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:10.564244 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5864b64-7a05-48bc-b005-4ff6c9ed586b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4\" (UID: \"b5864b64-7a05-48bc-b005-4ff6c9ed586b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4" Jul 16 09:01:10.564314 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:10.564279 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5864b64-7a05-48bc-b005-4ff6c9ed586b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4\" (UID: \"b5864b64-7a05-48bc-b005-4ff6c9ed586b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4" Jul 16 09:01:10.564626 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:10.564612 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5864b64-7a05-48bc-b005-4ff6c9ed586b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4\" (UID: \"b5864b64-7a05-48bc-b005-4ff6c9ed586b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4" Jul 16 09:01:10.564671 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:10.564630 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5864b64-7a05-48bc-b005-4ff6c9ed586b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4\" (UID: \"b5864b64-7a05-48bc-b005-4ff6c9ed586b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4" Jul 16 09:01:10.573041 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:10.573022 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swf5c\" (UniqueName: \"kubernetes.io/projected/b5864b64-7a05-48bc-b005-4ff6c9ed586b-kube-api-access-swf5c\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4\" (UID: \"b5864b64-7a05-48bc-b005-4ff6c9ed586b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4" Jul 16 09:01:10.700186 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:10.700139 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4" Jul 16 09:01:10.828893 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:10.828822 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4"] Jul 16 09:01:10.831386 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:01:10.831356 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5864b64_7a05_48bc_b005_4ff6c9ed586b.slice/crio-c71648c03036382312d7db6e2d9bf04ea7fc386edb15ca708e32be404d430182 WatchSource:0}: Error finding container c71648c03036382312d7db6e2d9bf04ea7fc386edb15ca708e32be404d430182: Status 404 returned error can't find the container with id c71648c03036382312d7db6e2d9bf04ea7fc386edb15ca708e32be404d430182 Jul 16 09:01:11.061704 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:11.061673 2559 generic.go:356] "Generic (PLEG): container finished" podID="b5864b64-7a05-48bc-b005-4ff6c9ed586b" containerID="e9b8aff70bdda64f0260b7e890c18d312c06aa820f58f43a211883b9c3460235" exitCode=0 Jul 16 09:01:11.061821 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:11.061727 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4" event={"ID":"b5864b64-7a05-48bc-b005-4ff6c9ed586b","Type":"ContainerDied","Data":"e9b8aff70bdda64f0260b7e890c18d312c06aa820f58f43a211883b9c3460235"} Jul 16 09:01:11.061821 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:11.061762 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4" event={"ID":"b5864b64-7a05-48bc-b005-4ff6c9ed586b","Type":"ContainerStarted","Data":"c71648c03036382312d7db6e2d9bf04ea7fc386edb15ca708e32be404d430182"} Jul 16 09:01:14.076239 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:14.076195 2559 generic.go:356] "Generic (PLEG): container finished" podID="b5864b64-7a05-48bc-b005-4ff6c9ed586b" containerID="993021330baa63cc8fde2431f7f7588f3b74a3e8efd8773a485c95c84f74f70e" exitCode=0 Jul 16 09:01:14.076239 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:14.076238 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4" event={"ID":"b5864b64-7a05-48bc-b005-4ff6c9ed586b","Type":"ContainerDied","Data":"993021330baa63cc8fde2431f7f7588f3b74a3e8efd8773a485c95c84f74f70e"} Jul 16 09:01:15.082845 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:15.082814 2559 generic.go:356] "Generic (PLEG): container finished" podID="b5864b64-7a05-48bc-b005-4ff6c9ed586b" containerID="d6c400ca1b0ced21889f26bf243b68945b7acd00d1f0d0f7247fe2130683ec10" exitCode=0 Jul 16 09:01:15.083235 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:15.082903 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4" event={"ID":"b5864b64-7a05-48bc-b005-4ff6c9ed586b","Type":"ContainerDied","Data":"d6c400ca1b0ced21889f26bf243b68945b7acd00d1f0d0f7247fe2130683ec10"} Jul 16 09:01:16.217024 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:16.217002 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4" Jul 16 09:01:16.406489 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:16.406382 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5864b64-7a05-48bc-b005-4ff6c9ed586b-util\") pod \"b5864b64-7a05-48bc-b005-4ff6c9ed586b\" (UID: \"b5864b64-7a05-48bc-b005-4ff6c9ed586b\") " Jul 16 09:01:16.406489 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:16.406448 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5864b64-7a05-48bc-b005-4ff6c9ed586b-bundle\") pod \"b5864b64-7a05-48bc-b005-4ff6c9ed586b\" (UID: \"b5864b64-7a05-48bc-b005-4ff6c9ed586b\") " Jul 16 09:01:16.406701 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:16.406524 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swf5c\" (UniqueName: \"kubernetes.io/projected/b5864b64-7a05-48bc-b005-4ff6c9ed586b-kube-api-access-swf5c\") pod \"b5864b64-7a05-48bc-b005-4ff6c9ed586b\" (UID: \"b5864b64-7a05-48bc-b005-4ff6c9ed586b\") " Jul 16 09:01:16.407214 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:16.407175 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5864b64-7a05-48bc-b005-4ff6c9ed586b-bundle" (OuterVolumeSpecName: "bundle") pod "b5864b64-7a05-48bc-b005-4ff6c9ed586b" (UID: "b5864b64-7a05-48bc-b005-4ff6c9ed586b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 09:01:16.408788 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:16.408767 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5864b64-7a05-48bc-b005-4ff6c9ed586b-kube-api-access-swf5c" (OuterVolumeSpecName: "kube-api-access-swf5c") pod "b5864b64-7a05-48bc-b005-4ff6c9ed586b" (UID: "b5864b64-7a05-48bc-b005-4ff6c9ed586b"). InnerVolumeSpecName "kube-api-access-swf5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 09:01:16.411224 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:16.411183 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5864b64-7a05-48bc-b005-4ff6c9ed586b-util" (OuterVolumeSpecName: "util") pod "b5864b64-7a05-48bc-b005-4ff6c9ed586b" (UID: "b5864b64-7a05-48bc-b005-4ff6c9ed586b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 09:01:16.507323 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:16.507301 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swf5c\" (UniqueName: \"kubernetes.io/projected/b5864b64-7a05-48bc-b005-4ff6c9ed586b-kube-api-access-swf5c\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:01:16.507323 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:16.507321 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5864b64-7a05-48bc-b005-4ff6c9ed586b-util\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:01:16.507441 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:16.507329 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5864b64-7a05-48bc-b005-4ff6c9ed586b-bundle\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:01:17.094559 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:17.094529 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4" event={"ID":"b5864b64-7a05-48bc-b005-4ff6c9ed586b","Type":"ContainerDied","Data":"c71648c03036382312d7db6e2d9bf04ea7fc386edb15ca708e32be404d430182"} Jul 16 09:01:17.094692 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:17.094569 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c71648c03036382312d7db6e2d9bf04ea7fc386edb15ca708e32be404d430182" Jul 16 09:01:17.094692 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:17.094574 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxlwx4" Jul 16 09:01:27.953553 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:27.953520 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d"] Jul 16 09:01:27.953992 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:27.953819 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5864b64-7a05-48bc-b005-4ff6c9ed586b" containerName="extract" Jul 16 09:01:27.953992 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:27.953829 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5864b64-7a05-48bc-b005-4ff6c9ed586b" containerName="extract" Jul 16 09:01:27.953992 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:27.953839 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5864b64-7a05-48bc-b005-4ff6c9ed586b" containerName="util" Jul 16 09:01:27.953992 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:27.953844 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5864b64-7a05-48bc-b005-4ff6c9ed586b" containerName="util" Jul 16 09:01:27.953992 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:27.953853 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5864b64-7a05-48bc-b005-4ff6c9ed586b" containerName="pull" Jul 16 09:01:27.953992 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:27.953858 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5864b64-7a05-48bc-b005-4ff6c9ed586b" containerName="pull" Jul 16 09:01:27.953992 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:27.953912 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5864b64-7a05-48bc-b005-4ff6c9ed586b" containerName="extract" Jul 16 09:01:27.956288 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:27.956266 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" Jul 16 09:01:27.962172 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:27.962151 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 16 09:01:27.962324 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:27.962172 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 16 09:01:27.962930 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:27.962782 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 16 09:01:27.962930 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:27.962824 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hgv5l\"" Jul 16 09:01:27.963039 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:27.962934 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 16 09:01:27.977840 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:27.977810 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d"] Jul 16 09:01:27.981653 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:27.981633 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc57154d-bca1-4450-9356-b6a92b08c1cf-tmp\") pod \"opendatahub-operator-controller-manager-5b875787f8-4z46d\" (UID: \"fc57154d-bca1-4450-9356-b6a92b08c1cf\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" Jul 16 09:01:27.981742 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:27.981685 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fc57154d-bca1-4450-9356-b6a92b08c1cf-manifests\") pod \"opendatahub-operator-controller-manager-5b875787f8-4z46d\" (UID: \"fc57154d-bca1-4450-9356-b6a92b08c1cf\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" Jul 16 09:01:27.981742 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:27.981705 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b72b8\" (UniqueName: \"kubernetes.io/projected/fc57154d-bca1-4450-9356-b6a92b08c1cf-kube-api-access-b72b8\") pod \"opendatahub-operator-controller-manager-5b875787f8-4z46d\" (UID: \"fc57154d-bca1-4450-9356-b6a92b08c1cf\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" Jul 16 09:01:27.981742 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:27.981730 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc57154d-bca1-4450-9356-b6a92b08c1cf-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b875787f8-4z46d\" (UID: \"fc57154d-bca1-4450-9356-b6a92b08c1cf\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" Jul 16 09:01:27.981861 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:27.981804 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc57154d-bca1-4450-9356-b6a92b08c1cf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b875787f8-4z46d\" (UID: \"fc57154d-bca1-4450-9356-b6a92b08c1cf\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" Jul 16 09:01:28.082242 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:28.082217 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc57154d-bca1-4450-9356-b6a92b08c1cf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b875787f8-4z46d\" (UID: \"fc57154d-bca1-4450-9356-b6a92b08c1cf\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" Jul 16 09:01:28.082346 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:28.082250 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc57154d-bca1-4450-9356-b6a92b08c1cf-tmp\") pod \"opendatahub-operator-controller-manager-5b875787f8-4z46d\" (UID: \"fc57154d-bca1-4450-9356-b6a92b08c1cf\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" Jul 16 09:01:28.082395 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:28.082377 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fc57154d-bca1-4450-9356-b6a92b08c1cf-manifests\") pod \"opendatahub-operator-controller-manager-5b875787f8-4z46d\" (UID: \"fc57154d-bca1-4450-9356-b6a92b08c1cf\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" Jul 16 09:01:28.082435 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:28.082410 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b72b8\" (UniqueName: \"kubernetes.io/projected/fc57154d-bca1-4450-9356-b6a92b08c1cf-kube-api-access-b72b8\") pod \"opendatahub-operator-controller-manager-5b875787f8-4z46d\" (UID: \"fc57154d-bca1-4450-9356-b6a92b08c1cf\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" Jul 16 09:01:28.082513 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:28.082437 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc57154d-bca1-4450-9356-b6a92b08c1cf-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b875787f8-4z46d\" (UID: \"fc57154d-bca1-4450-9356-b6a92b08c1cf\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" Jul 16 09:01:28.082720 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:28.082698 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fc57154d-bca1-4450-9356-b6a92b08c1cf-manifests\") pod \"opendatahub-operator-controller-manager-5b875787f8-4z46d\" (UID: \"fc57154d-bca1-4450-9356-b6a92b08c1cf\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" Jul 16 09:01:28.084614 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:28.084576 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc57154d-bca1-4450-9356-b6a92b08c1cf-tmp\") pod \"opendatahub-operator-controller-manager-5b875787f8-4z46d\" (UID: \"fc57154d-bca1-4450-9356-b6a92b08c1cf\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" Jul 16 09:01:28.084842 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:28.084823 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc57154d-bca1-4450-9356-b6a92b08c1cf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b875787f8-4z46d\" (UID: \"fc57154d-bca1-4450-9356-b6a92b08c1cf\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" Jul 16 09:01:28.084931 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:28.084910 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc57154d-bca1-4450-9356-b6a92b08c1cf-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b875787f8-4z46d\" (UID: \"fc57154d-bca1-4450-9356-b6a92b08c1cf\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" Jul 16 09:01:28.095778 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:28.095757 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b72b8\" (UniqueName: \"kubernetes.io/projected/fc57154d-bca1-4450-9356-b6a92b08c1cf-kube-api-access-b72b8\") pod \"opendatahub-operator-controller-manager-5b875787f8-4z46d\" (UID: \"fc57154d-bca1-4450-9356-b6a92b08c1cf\") " pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" Jul 16 09:01:28.265688 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:28.265662 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" Jul 16 09:01:28.403147 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:28.403123 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d"] Jul 16 09:01:28.405849 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:01:28.405823 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc57154d_bca1_4450_9356_b6a92b08c1cf.slice/crio-0daac09cab78dae17c087c5de35c75f57411b8ffb31f6646071ab4ba52a6a6a4 WatchSource:0}: Error finding container 0daac09cab78dae17c087c5de35c75f57411b8ffb31f6646071ab4ba52a6a6a4: Status 404 returned error can't find the container with id 0daac09cab78dae17c087c5de35c75f57411b8ffb31f6646071ab4ba52a6a6a4 Jul 16 09:01:29.150489 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:29.150440 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" event={"ID":"fc57154d-bca1-4450-9356-b6a92b08c1cf","Type":"ContainerStarted","Data":"0daac09cab78dae17c087c5de35c75f57411b8ffb31f6646071ab4ba52a6a6a4"} Jul 16 09:01:33.173689 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:33.173648 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" event={"ID":"fc57154d-bca1-4450-9356-b6a92b08c1cf","Type":"ContainerStarted","Data":"ad8719251d3bb586a9d72015dd1f4079a56125c156faf873a7b914d7d891cff4"} Jul 16 09:01:34.180143 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:34.180108 2559 generic.go:356] "Generic (PLEG): container finished" podID="fc57154d-bca1-4450-9356-b6a92b08c1cf" containerID="ad8719251d3bb586a9d72015dd1f4079a56125c156faf873a7b914d7d891cff4" exitCode=0 Jul 16 09:01:34.180577 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:34.180198 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" event={"ID":"fc57154d-bca1-4450-9356-b6a92b08c1cf","Type":"ContainerDied","Data":"ad8719251d3bb586a9d72015dd1f4079a56125c156faf873a7b914d7d891cff4"} Jul 16 09:01:35.187420 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:35.187378 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" event={"ID":"fc57154d-bca1-4450-9356-b6a92b08c1cf","Type":"ContainerStarted","Data":"5456105a6df708824b9de599bcea351f90f15e261e25c4e09f19ce98bbf7a87c"} Jul 16 09:01:35.187815 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:35.187490 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" Jul 16 09:01:35.211982 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:35.211932 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" podStartSLOduration=2.812685772 podStartE2EDuration="8.211920446s" totalImagesPullingTime="4.393613081s" totalInitContainerRuntime="1.005621593s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:01:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:01:35.209268273 +0000 UTC m=+423.498718548" watchObservedRunningTime="2026-07-16 09:01:35.211920446 +0000 UTC m=+423.501370704" Jul 16 09:01:46.195081 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:46.195052 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b875787f8-4z46d" Jul 16 09:01:56.787356 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:56.787270 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf"] Jul 16 09:01:56.789954 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:56.789938 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:01:56.793115 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:56.793083 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 16 09:01:56.793359 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:56.793335 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 16 09:01:56.793426 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:56.793413 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 16 09:01:56.793607 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:56.793587 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-hjknr\"" Jul 16 09:01:56.793818 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:56.793798 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 16 09:01:56.794013 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:56.793997 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 16 09:01:56.794228 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:56.794204 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 16 09:01:56.803273 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:56.803126 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf"] Jul 16 09:01:56.906403 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:56.906376 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-tldtf\" (UID: \"c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:01:56.906557 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:56.906407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-tldtf\" (UID: \"c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:01:56.906557 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:56.906449 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-tldtf\" (UID: \"c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:01:56.906557 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:56.906495 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-tldtf\" (UID: \"c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:01:56.906557 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:56.906525 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-tldtf\" (UID: \"c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:01:56.906557 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:56.906542 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-tldtf\" (UID: \"c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:01:56.906557 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:56.906557 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5spgk\" (UniqueName: \"kubernetes.io/projected/c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7-kube-api-access-5spgk\") pod \"istiod-openshift-gateway-94bb8fbfd-tldtf\" (UID: \"c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:01:57.007773 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:57.007745 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-tldtf\" (UID: \"c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:01:57.007886 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:57.007776 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-tldtf\" (UID: \"c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:01:57.007886 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:57.007796 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-tldtf\" (UID: \"c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:01:57.007886 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:57.007814 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-tldtf\" (UID: \"c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:01:57.008011 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:57.007936 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-tldtf\" (UID: \"c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:01:57.008011 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:57.007976 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-tldtf\" (UID: \"c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:01:57.008011 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:57.008004 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5spgk\" (UniqueName: \"kubernetes.io/projected/c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7-kube-api-access-5spgk\") pod \"istiod-openshift-gateway-94bb8fbfd-tldtf\" (UID: \"c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:01:57.008453 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:57.008389 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-tldtf\" (UID: \"c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:01:57.010265 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:57.010243 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-tldtf\" (UID: \"c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:01:57.010370 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:57.010320 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-tldtf\" (UID: \"c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:01:57.010370 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:57.010343 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-tldtf\" (UID: \"c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:01:57.010370 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:57.010357 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-tldtf\" (UID: \"c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:01:57.016958 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:57.016940 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-tldtf\" (UID: \"c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:01:57.017143 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:57.017127 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5spgk\" (UniqueName: \"kubernetes.io/projected/c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7-kube-api-access-5spgk\") pod \"istiod-openshift-gateway-94bb8fbfd-tldtf\" (UID: \"c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:01:57.106838 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:57.106793 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:01:57.242133 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:57.242109 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf"] Jul 16 09:01:57.244652 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:01:57.244621 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6f2195f_39a1_4e4e_8bb8_ba0b71115fe7.slice/crio-2236ce8714c7fb4fae2cb55535265812a7dc5f6d0274fd33339187bf8428a5e5 WatchSource:0}: Error finding container 2236ce8714c7fb4fae2cb55535265812a7dc5f6d0274fd33339187bf8428a5e5: Status 404 returned error can't find the container with id 2236ce8714c7fb4fae2cb55535265812a7dc5f6d0274fd33339187bf8428a5e5 Jul 16 09:01:57.290587 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:57.290560 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" event={"ID":"c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7","Type":"ContainerStarted","Data":"2236ce8714c7fb4fae2cb55535265812a7dc5f6d0274fd33339187bf8428a5e5"} Jul 16 09:01:59.203242 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:59.203200 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-74556d96d9-wrrj9"] Jul 16 09:01:59.210065 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:59.210044 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-74556d96d9-wrrj9" Jul 16 09:01:59.213456 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:59.213407 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 16 09:01:59.214024 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:59.213991 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 16 09:01:59.215186 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:59.214992 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-m29c5\"" Jul 16 09:01:59.215314 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:59.215194 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 16 09:01:59.217688 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:59.217662 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-74556d96d9-wrrj9"] Jul 16 09:01:59.329869 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:59.329835 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2e52bae5-2a43-4a3f-9fa9-7684317bf59d-manager-config\") pod \"lws-controller-manager-74556d96d9-wrrj9\" (UID: \"2e52bae5-2a43-4a3f-9fa9-7684317bf59d\") " pod="openshift-lws-operator/lws-controller-manager-74556d96d9-wrrj9" Jul 16 09:01:59.330047 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:59.329893 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e52bae5-2a43-4a3f-9fa9-7684317bf59d-metrics-cert\") pod \"lws-controller-manager-74556d96d9-wrrj9\" (UID: \"2e52bae5-2a43-4a3f-9fa9-7684317bf59d\") " pod="openshift-lws-operator/lws-controller-manager-74556d96d9-wrrj9" Jul 16 09:01:59.330047 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:59.329957 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e52bae5-2a43-4a3f-9fa9-7684317bf59d-cert\") pod \"lws-controller-manager-74556d96d9-wrrj9\" (UID: \"2e52bae5-2a43-4a3f-9fa9-7684317bf59d\") " pod="openshift-lws-operator/lws-controller-manager-74556d96d9-wrrj9" Jul 16 09:01:59.330047 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:59.330004 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bwhz\" (UniqueName: \"kubernetes.io/projected/2e52bae5-2a43-4a3f-9fa9-7684317bf59d-kube-api-access-5bwhz\") pod \"lws-controller-manager-74556d96d9-wrrj9\" (UID: \"2e52bae5-2a43-4a3f-9fa9-7684317bf59d\") " pod="openshift-lws-operator/lws-controller-manager-74556d96d9-wrrj9" Jul 16 09:01:59.430859 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:59.430822 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2e52bae5-2a43-4a3f-9fa9-7684317bf59d-manager-config\") pod \"lws-controller-manager-74556d96d9-wrrj9\" (UID: \"2e52bae5-2a43-4a3f-9fa9-7684317bf59d\") " pod="openshift-lws-operator/lws-controller-manager-74556d96d9-wrrj9" Jul 16 09:01:59.431040 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:59.430888 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e52bae5-2a43-4a3f-9fa9-7684317bf59d-metrics-cert\") pod \"lws-controller-manager-74556d96d9-wrrj9\" (UID: \"2e52bae5-2a43-4a3f-9fa9-7684317bf59d\") " pod="openshift-lws-operator/lws-controller-manager-74556d96d9-wrrj9" Jul 16 09:01:59.431040 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:59.430932 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e52bae5-2a43-4a3f-9fa9-7684317bf59d-cert\") pod \"lws-controller-manager-74556d96d9-wrrj9\" (UID: \"2e52bae5-2a43-4a3f-9fa9-7684317bf59d\") " pod="openshift-lws-operator/lws-controller-manager-74556d96d9-wrrj9" Jul 16 09:01:59.431040 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:59.430958 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bwhz\" (UniqueName: \"kubernetes.io/projected/2e52bae5-2a43-4a3f-9fa9-7684317bf59d-kube-api-access-5bwhz\") pod \"lws-controller-manager-74556d96d9-wrrj9\" (UID: \"2e52bae5-2a43-4a3f-9fa9-7684317bf59d\") " pod="openshift-lws-operator/lws-controller-manager-74556d96d9-wrrj9" Jul 16 09:01:59.431641 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:59.431617 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2e52bae5-2a43-4a3f-9fa9-7684317bf59d-manager-config\") pod \"lws-controller-manager-74556d96d9-wrrj9\" (UID: \"2e52bae5-2a43-4a3f-9fa9-7684317bf59d\") " pod="openshift-lws-operator/lws-controller-manager-74556d96d9-wrrj9" Jul 16 09:01:59.433726 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:59.433681 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e52bae5-2a43-4a3f-9fa9-7684317bf59d-metrics-cert\") pod \"lws-controller-manager-74556d96d9-wrrj9\" (UID: \"2e52bae5-2a43-4a3f-9fa9-7684317bf59d\") " pod="openshift-lws-operator/lws-controller-manager-74556d96d9-wrrj9" Jul 16 09:01:59.433877 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:59.433845 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e52bae5-2a43-4a3f-9fa9-7684317bf59d-cert\") pod \"lws-controller-manager-74556d96d9-wrrj9\" (UID: \"2e52bae5-2a43-4a3f-9fa9-7684317bf59d\") " pod="openshift-lws-operator/lws-controller-manager-74556d96d9-wrrj9" Jul 16 09:01:59.450282 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:59.450259 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bwhz\" (UniqueName: \"kubernetes.io/projected/2e52bae5-2a43-4a3f-9fa9-7684317bf59d-kube-api-access-5bwhz\") pod \"lws-controller-manager-74556d96d9-wrrj9\" (UID: \"2e52bae5-2a43-4a3f-9fa9-7684317bf59d\") " pod="openshift-lws-operator/lws-controller-manager-74556d96d9-wrrj9" Jul 16 09:01:59.523578 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:59.523552 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-74556d96d9-wrrj9" Jul 16 09:01:59.683163 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:59.683126 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 16 09:01:59.683255 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:59.683194 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 16 09:01:59.770598 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:01:59.770577 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-74556d96d9-wrrj9"] Jul 16 09:01:59.772522 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:01:59.772499 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e52bae5_2a43_4a3f_9fa9_7684317bf59d.slice/crio-b9294fe23692655acd4a49b959baa314fc613a578f70316e3ef5ff032e009d27 WatchSource:0}: Error finding container b9294fe23692655acd4a49b959baa314fc613a578f70316e3ef5ff032e009d27: Status 404 returned error can't find the container with id b9294fe23692655acd4a49b959baa314fc613a578f70316e3ef5ff032e009d27 Jul 16 09:02:00.309679 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:02:00.309645 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-74556d96d9-wrrj9" event={"ID":"2e52bae5-2a43-4a3f-9fa9-7684317bf59d","Type":"ContainerStarted","Data":"b9294fe23692655acd4a49b959baa314fc613a578f70316e3ef5ff032e009d27"} Jul 16 09:02:00.311430 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:02:00.311394 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" event={"ID":"c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7","Type":"ContainerStarted","Data":"a5ba79a2979b6256677cd9383ec866646c2680c7d8c558c3172fd6fd4f9f90c1"} Jul 16 09:02:00.311620 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:02:00.311601 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:02:00.313130 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:02:00.313105 2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-tldtf container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 16 09:02:00.313260 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:02:00.313150 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" podUID="c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 09:02:00.349947 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:02:00.349890 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" podStartSLOduration=1.9141660759999999 podStartE2EDuration="4.34985926s" totalImagesPullingTime="2.435693184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:02:00.348262673 +0000 UTC m=+448.637712937" watchObservedRunningTime="2026-07-16 09:02:00.34985926 +0000 UTC m=+448.639309519" Jul 16 09:02:01.316891 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:02:01.316864 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tldtf" Jul 16 09:02:02.323043 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:02:02.323000 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-74556d96d9-wrrj9" event={"ID":"2e52bae5-2a43-4a3f-9fa9-7684317bf59d","Type":"ContainerStarted","Data":"5f5ae281735371caa0f3b58aae82a3eeda48adefadb03f7f4baf267a12608fef"} Jul 16 09:02:02.323512 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:02:02.323181 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-74556d96d9-wrrj9" Jul 16 09:02:02.343281 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:02:02.343234 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-74556d96d9-wrrj9" podStartSLOduration=1.539029524 podStartE2EDuration="3.343221138s" totalImagesPullingTime="1.804191614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:01:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:02:02.340974252 +0000 UTC m=+450.630424518" watchObservedRunningTime="2026-07-16 09:02:02.343221138 +0000 UTC m=+450.632671397" Jul 16 09:02:13.329760 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:02:13.329732 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-74556d96d9-wrrj9" Jul 16 09:03:05.797186 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:05.797157 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr"] Jul 16 09:03:05.799676 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:05.799658 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr" Jul 16 09:03:05.802646 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:05.802627 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6dz8w\"" Jul 16 09:03:05.802744 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:05.802727 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 16 09:03:05.803648 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:05.803630 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 16 09:03:05.820368 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:05.820348 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr"] Jul 16 09:03:05.931621 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:05.931593 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df665c82-df9b-4b44-af9b-1fdc432a0516-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr\" (UID: \"df665c82-df9b-4b44-af9b-1fdc432a0516\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr" Jul 16 09:03:05.931734 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:05.931627 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df665c82-df9b-4b44-af9b-1fdc432a0516-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr\" (UID: \"df665c82-df9b-4b44-af9b-1fdc432a0516\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr" Jul 16 09:03:05.931734 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:05.931679 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdfcr\" (UniqueName: \"kubernetes.io/projected/df665c82-df9b-4b44-af9b-1fdc432a0516-kube-api-access-xdfcr\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr\" (UID: \"df665c82-df9b-4b44-af9b-1fdc432a0516\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr" Jul 16 09:03:06.032786 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.032757 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df665c82-df9b-4b44-af9b-1fdc432a0516-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr\" (UID: \"df665c82-df9b-4b44-af9b-1fdc432a0516\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr" Jul 16 09:03:06.032900 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.032802 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df665c82-df9b-4b44-af9b-1fdc432a0516-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr\" (UID: \"df665c82-df9b-4b44-af9b-1fdc432a0516\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr" Jul 16 09:03:06.032900 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.032886 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdfcr\" (UniqueName: \"kubernetes.io/projected/df665c82-df9b-4b44-af9b-1fdc432a0516-kube-api-access-xdfcr\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr\" (UID: \"df665c82-df9b-4b44-af9b-1fdc432a0516\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr" Jul 16 09:03:06.033214 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.033196 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df665c82-df9b-4b44-af9b-1fdc432a0516-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr\" (UID: \"df665c82-df9b-4b44-af9b-1fdc432a0516\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr" Jul 16 09:03:06.033291 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.033200 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df665c82-df9b-4b44-af9b-1fdc432a0516-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr\" (UID: \"df665c82-df9b-4b44-af9b-1fdc432a0516\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr" Jul 16 09:03:06.041267 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.041238 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdfcr\" (UniqueName: \"kubernetes.io/projected/df665c82-df9b-4b44-af9b-1fdc432a0516-kube-api-access-xdfcr\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr\" (UID: \"df665c82-df9b-4b44-af9b-1fdc432a0516\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr" Jul 16 09:03:06.109575 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.109508 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr" Jul 16 09:03:06.246263 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.246241 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr"] Jul 16 09:03:06.248215 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:03:06.248189 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf665c82_df9b_4b44_af9b_1fdc432a0516.slice/crio-e275d607ae249f9724b3c523a9c3fa6f706d02d863a736d7348bd4e45c1ea82f WatchSource:0}: Error finding container e275d607ae249f9724b3c523a9c3fa6f706d02d863a736d7348bd4e45c1ea82f: Status 404 returned error can't find the container with id e275d607ae249f9724b3c523a9c3fa6f706d02d863a736d7348bd4e45c1ea82f Jul 16 09:03:06.368160 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.368099 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m"] Jul 16 09:03:06.370574 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.370559 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m" Jul 16 09:03:06.380689 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.380542 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m"] Jul 16 09:03:06.441723 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.436592 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t24pt\" (UniqueName: \"kubernetes.io/projected/e31e0c53-f84a-408e-8a34-138d80b5d092-kube-api-access-t24pt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m\" (UID: \"e31e0c53-f84a-408e-8a34-138d80b5d092\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m" Jul 16 09:03:06.441723 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.436718 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e31e0c53-f84a-408e-8a34-138d80b5d092-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m\" (UID: \"e31e0c53-f84a-408e-8a34-138d80b5d092\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m" Jul 16 09:03:06.441723 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.436806 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e31e0c53-f84a-408e-8a34-138d80b5d092-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m\" (UID: \"e31e0c53-f84a-408e-8a34-138d80b5d092\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m" Jul 16 09:03:06.538080 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.538046 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e31e0c53-f84a-408e-8a34-138d80b5d092-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m\" (UID: \"e31e0c53-f84a-408e-8a34-138d80b5d092\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m" Jul 16 09:03:06.538211 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.538099 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e31e0c53-f84a-408e-8a34-138d80b5d092-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m\" (UID: \"e31e0c53-f84a-408e-8a34-138d80b5d092\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m" Jul 16 09:03:06.538211 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.538141 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t24pt\" (UniqueName: \"kubernetes.io/projected/e31e0c53-f84a-408e-8a34-138d80b5d092-kube-api-access-t24pt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m\" (UID: \"e31e0c53-f84a-408e-8a34-138d80b5d092\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m" Jul 16 09:03:06.538444 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.538423 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e31e0c53-f84a-408e-8a34-138d80b5d092-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m\" (UID: \"e31e0c53-f84a-408e-8a34-138d80b5d092\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m" Jul 16 09:03:06.538545 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.538457 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e31e0c53-f84a-408e-8a34-138d80b5d092-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m\" (UID: \"e31e0c53-f84a-408e-8a34-138d80b5d092\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m" Jul 16 09:03:06.547297 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.547270 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t24pt\" (UniqueName: \"kubernetes.io/projected/e31e0c53-f84a-408e-8a34-138d80b5d092-kube-api-access-t24pt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m\" (UID: \"e31e0c53-f84a-408e-8a34-138d80b5d092\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m" Jul 16 09:03:06.623441 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.623372 2559 generic.go:356] "Generic (PLEG): container finished" podID="df665c82-df9b-4b44-af9b-1fdc432a0516" containerID="a87132cc6c4f2efcbd2cc82d4064ca2e60d8fa6e7031989987075222af424545" exitCode=0 Jul 16 09:03:06.623546 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.623462 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr" event={"ID":"df665c82-df9b-4b44-af9b-1fdc432a0516","Type":"ContainerDied","Data":"a87132cc6c4f2efcbd2cc82d4064ca2e60d8fa6e7031989987075222af424545"} Jul 16 09:03:06.623602 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.623563 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr" event={"ID":"df665c82-df9b-4b44-af9b-1fdc432a0516","Type":"ContainerStarted","Data":"e275d607ae249f9724b3c523a9c3fa6f706d02d863a736d7348bd4e45c1ea82f"} Jul 16 09:03:06.698274 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.698257 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m" Jul 16 09:03:06.765280 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.765254 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm"] Jul 16 09:03:06.768131 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.768112 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm" Jul 16 09:03:06.777404 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.777377 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm"] Jul 16 09:03:06.831130 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.831110 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m"] Jul 16 09:03:06.832980 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:03:06.832960 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode31e0c53_f84a_408e_8a34_138d80b5d092.slice/crio-f1f7c07fcb15307c3be16257cbe96f1e37b96e6fb0d284365728700117f9af31 WatchSource:0}: Error finding container f1f7c07fcb15307c3be16257cbe96f1e37b96e6fb0d284365728700117f9af31: Status 404 returned error can't find the container with id f1f7c07fcb15307c3be16257cbe96f1e37b96e6fb0d284365728700117f9af31 Jul 16 09:03:06.840775 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.840745 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d814caad-ef8c-4067-b9bf-2c88fa06b907-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm\" (UID: \"d814caad-ef8c-4067-b9bf-2c88fa06b907\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm" Jul 16 09:03:06.840851 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.840785 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkk52\" (UniqueName: \"kubernetes.io/projected/d814caad-ef8c-4067-b9bf-2c88fa06b907-kube-api-access-rkk52\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm\" (UID: \"d814caad-ef8c-4067-b9bf-2c88fa06b907\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm" Jul 16 09:03:06.840886 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.840858 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d814caad-ef8c-4067-b9bf-2c88fa06b907-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm\" (UID: \"d814caad-ef8c-4067-b9bf-2c88fa06b907\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm" Jul 16 09:03:06.941461 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.941433 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d814caad-ef8c-4067-b9bf-2c88fa06b907-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm\" (UID: \"d814caad-ef8c-4067-b9bf-2c88fa06b907\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm" Jul 16 09:03:06.941699 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.941465 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkk52\" (UniqueName: \"kubernetes.io/projected/d814caad-ef8c-4067-b9bf-2c88fa06b907-kube-api-access-rkk52\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm\" (UID: \"d814caad-ef8c-4067-b9bf-2c88fa06b907\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm" Jul 16 09:03:06.941699 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.941514 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d814caad-ef8c-4067-b9bf-2c88fa06b907-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm\" (UID: \"d814caad-ef8c-4067-b9bf-2c88fa06b907\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm" Jul 16 09:03:06.941804 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.941784 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d814caad-ef8c-4067-b9bf-2c88fa06b907-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm\" (UID: \"d814caad-ef8c-4067-b9bf-2c88fa06b907\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm" Jul 16 09:03:06.941846 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.941812 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d814caad-ef8c-4067-b9bf-2c88fa06b907-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm\" (UID: \"d814caad-ef8c-4067-b9bf-2c88fa06b907\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm" Jul 16 09:03:06.950766 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:06.950747 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkk52\" (UniqueName: \"kubernetes.io/projected/d814caad-ef8c-4067-b9bf-2c88fa06b907-kube-api-access-rkk52\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm\" (UID: \"d814caad-ef8c-4067-b9bf-2c88fa06b907\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm" Jul 16 09:03:07.078406 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.078388 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm" Jul 16 09:03:07.164883 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.164854 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5"] Jul 16 09:03:07.168398 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.168375 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5" Jul 16 09:03:07.176806 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.176779 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5"] Jul 16 09:03:07.214663 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.214636 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm"] Jul 16 09:03:07.231695 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:03:07.231665 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd814caad_ef8c_4067_b9bf_2c88fa06b907.slice/crio-1c8e85596193b2b7659867a8cd41c2e2dafc7cb4d888e77408702d6ab8d000d7 WatchSource:0}: Error finding container 1c8e85596193b2b7659867a8cd41c2e2dafc7cb4d888e77408702d6ab8d000d7: Status 404 returned error can't find the container with id 1c8e85596193b2b7659867a8cd41c2e2dafc7cb4d888e77408702d6ab8d000d7 Jul 16 09:03:07.244671 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.244644 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05d1a509-1367-44e1-9956-69efcae95b41-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5\" (UID: \"05d1a509-1367-44e1-9956-69efcae95b41\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5" Jul 16 09:03:07.244743 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.244686 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05d1a509-1367-44e1-9956-69efcae95b41-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5\" (UID: \"05d1a509-1367-44e1-9956-69efcae95b41\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5" Jul 16 09:03:07.244797 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.244746 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bzms\" (UniqueName: \"kubernetes.io/projected/05d1a509-1367-44e1-9956-69efcae95b41-kube-api-access-2bzms\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5\" (UID: \"05d1a509-1367-44e1-9956-69efcae95b41\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5" Jul 16 09:03:07.345275 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.345242 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05d1a509-1367-44e1-9956-69efcae95b41-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5\" (UID: \"05d1a509-1367-44e1-9956-69efcae95b41\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5" Jul 16 09:03:07.345395 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.345364 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bzms\" (UniqueName: \"kubernetes.io/projected/05d1a509-1367-44e1-9956-69efcae95b41-kube-api-access-2bzms\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5\" (UID: \"05d1a509-1367-44e1-9956-69efcae95b41\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5" Jul 16 09:03:07.345892 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.345859 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05d1a509-1367-44e1-9956-69efcae95b41-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5\" (UID: \"05d1a509-1367-44e1-9956-69efcae95b41\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5" Jul 16 09:03:07.346079 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.346058 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05d1a509-1367-44e1-9956-69efcae95b41-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5\" (UID: \"05d1a509-1367-44e1-9956-69efcae95b41\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5" Jul 16 09:03:07.346346 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.346328 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05d1a509-1367-44e1-9956-69efcae95b41-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5\" (UID: \"05d1a509-1367-44e1-9956-69efcae95b41\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5" Jul 16 09:03:07.354993 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.354920 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bzms\" (UniqueName: \"kubernetes.io/projected/05d1a509-1367-44e1-9956-69efcae95b41-kube-api-access-2bzms\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5\" (UID: \"05d1a509-1367-44e1-9956-69efcae95b41\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5" Jul 16 09:03:07.480632 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.480611 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5" Jul 16 09:03:07.613849 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.613825 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5"] Jul 16 09:03:07.616402 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:03:07.616377 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05d1a509_1367_44e1_9956_69efcae95b41.slice/crio-d38648e70a14ede85bee8309d4f05125b1963d61dc3967954938c54756de4b67 WatchSource:0}: Error finding container d38648e70a14ede85bee8309d4f05125b1963d61dc3967954938c54756de4b67: Status 404 returned error can't find the container with id d38648e70a14ede85bee8309d4f05125b1963d61dc3967954938c54756de4b67 Jul 16 09:03:07.632613 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.632594 2559 generic.go:356] "Generic (PLEG): container finished" podID="d814caad-ef8c-4067-b9bf-2c88fa06b907" containerID="5524f458de2abfa633086eb799aed5c49774217e030704284fb35dd976b4b026" exitCode=0 Jul 16 09:03:07.632737 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.632683 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm" event={"ID":"d814caad-ef8c-4067-b9bf-2c88fa06b907","Type":"ContainerDied","Data":"5524f458de2abfa633086eb799aed5c49774217e030704284fb35dd976b4b026"} Jul 16 09:03:07.632812 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.632735 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm" event={"ID":"d814caad-ef8c-4067-b9bf-2c88fa06b907","Type":"ContainerStarted","Data":"1c8e85596193b2b7659867a8cd41c2e2dafc7cb4d888e77408702d6ab8d000d7"} Jul 16 09:03:07.634010 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.633946 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5" event={"ID":"05d1a509-1367-44e1-9956-69efcae95b41","Type":"ContainerStarted","Data":"d38648e70a14ede85bee8309d4f05125b1963d61dc3967954938c54756de4b67"} Jul 16 09:03:07.635397 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.635376 2559 generic.go:356] "Generic (PLEG): container finished" podID="e31e0c53-f84a-408e-8a34-138d80b5d092" containerID="b2108879b86bf4025e0c6c826c86ff9bf50c84f06680e43e4422d046b409fbb3" exitCode=0 Jul 16 09:03:07.635511 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.635454 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m" event={"ID":"e31e0c53-f84a-408e-8a34-138d80b5d092","Type":"ContainerDied","Data":"b2108879b86bf4025e0c6c826c86ff9bf50c84f06680e43e4422d046b409fbb3"} Jul 16 09:03:07.635576 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.635527 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m" event={"ID":"e31e0c53-f84a-408e-8a34-138d80b5d092","Type":"ContainerStarted","Data":"f1f7c07fcb15307c3be16257cbe96f1e37b96e6fb0d284365728700117f9af31"} Jul 16 09:03:07.637586 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.637566 2559 generic.go:356] "Generic (PLEG): container finished" podID="df665c82-df9b-4b44-af9b-1fdc432a0516" containerID="6a764fcf3b5dcb736f18a0cf9558e382a84d3533eff3373ed2a2f3104419e72b" exitCode=0 Jul 16 09:03:07.637728 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:07.637648 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr" event={"ID":"df665c82-df9b-4b44-af9b-1fdc432a0516","Type":"ContainerDied","Data":"6a764fcf3b5dcb736f18a0cf9558e382a84d3533eff3373ed2a2f3104419e72b"} Jul 16 09:03:08.650527 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:08.650430 2559 generic.go:356] "Generic (PLEG): container finished" podID="05d1a509-1367-44e1-9956-69efcae95b41" containerID="85e51bc6eb8eac187a85fc487656e30f64defa8680e37954ffff1d2106058361" exitCode=0 Jul 16 09:03:08.650527 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:08.650505 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5" event={"ID":"05d1a509-1367-44e1-9956-69efcae95b41","Type":"ContainerDied","Data":"85e51bc6eb8eac187a85fc487656e30f64defa8680e37954ffff1d2106058361"} Jul 16 09:03:08.653027 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:08.653001 2559 generic.go:356] "Generic (PLEG): container finished" podID="df665c82-df9b-4b44-af9b-1fdc432a0516" containerID="67f9af5a6d46a7a8526743b427091ef1daf9b8b87a70e773f9d337d6c292dbd7" exitCode=0 Jul 16 09:03:08.653131 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:08.653075 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr" event={"ID":"df665c82-df9b-4b44-af9b-1fdc432a0516","Type":"ContainerDied","Data":"67f9af5a6d46a7a8526743b427091ef1daf9b8b87a70e773f9d337d6c292dbd7"} Jul 16 09:03:08.654909 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:08.654885 2559 generic.go:356] "Generic (PLEG): container finished" podID="d814caad-ef8c-4067-b9bf-2c88fa06b907" containerID="791be5c43882e79d059be914e08f7d16b140b37611ec5678c482b7552407abcb" exitCode=0 Jul 16 09:03:08.655007 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:08.654909 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm" event={"ID":"d814caad-ef8c-4067-b9bf-2c88fa06b907","Type":"ContainerDied","Data":"791be5c43882e79d059be914e08f7d16b140b37611ec5678c482b7552407abcb"} Jul 16 09:03:09.662225 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:09.662202 2559 generic.go:356] "Generic (PLEG): container finished" podID="d814caad-ef8c-4067-b9bf-2c88fa06b907" containerID="33ba1c032e0b762c5484442eef386fdeca3ae42e4b0f648b0f6d61ddced0708a" exitCode=0 Jul 16 09:03:09.662597 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:09.662277 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm" event={"ID":"d814caad-ef8c-4067-b9bf-2c88fa06b907","Type":"ContainerDied","Data":"33ba1c032e0b762c5484442eef386fdeca3ae42e4b0f648b0f6d61ddced0708a"} Jul 16 09:03:09.810172 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:09.810147 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr" Jul 16 09:03:09.868392 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:09.868369 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df665c82-df9b-4b44-af9b-1fdc432a0516-util\") pod \"df665c82-df9b-4b44-af9b-1fdc432a0516\" (UID: \"df665c82-df9b-4b44-af9b-1fdc432a0516\") " Jul 16 09:03:09.868540 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:09.868401 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df665c82-df9b-4b44-af9b-1fdc432a0516-bundle\") pod \"df665c82-df9b-4b44-af9b-1fdc432a0516\" (UID: \"df665c82-df9b-4b44-af9b-1fdc432a0516\") " Jul 16 09:03:09.868540 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:09.868483 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdfcr\" (UniqueName: \"kubernetes.io/projected/df665c82-df9b-4b44-af9b-1fdc432a0516-kube-api-access-xdfcr\") pod \"df665c82-df9b-4b44-af9b-1fdc432a0516\" (UID: \"df665c82-df9b-4b44-af9b-1fdc432a0516\") " Jul 16 09:03:09.869052 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:09.869029 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df665c82-df9b-4b44-af9b-1fdc432a0516-bundle" (OuterVolumeSpecName: "bundle") pod "df665c82-df9b-4b44-af9b-1fdc432a0516" (UID: "df665c82-df9b-4b44-af9b-1fdc432a0516"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 09:03:09.870812 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:09.870783 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df665c82-df9b-4b44-af9b-1fdc432a0516-kube-api-access-xdfcr" (OuterVolumeSpecName: "kube-api-access-xdfcr") pod "df665c82-df9b-4b44-af9b-1fdc432a0516" (UID: "df665c82-df9b-4b44-af9b-1fdc432a0516"). InnerVolumeSpecName "kube-api-access-xdfcr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 09:03:09.874037 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:09.874005 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df665c82-df9b-4b44-af9b-1fdc432a0516-util" (OuterVolumeSpecName: "util") pod "df665c82-df9b-4b44-af9b-1fdc432a0516" (UID: "df665c82-df9b-4b44-af9b-1fdc432a0516"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 09:03:09.969158 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:09.969136 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdfcr\" (UniqueName: \"kubernetes.io/projected/df665c82-df9b-4b44-af9b-1fdc432a0516-kube-api-access-xdfcr\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:03:09.969248 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:09.969161 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df665c82-df9b-4b44-af9b-1fdc432a0516-util\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:03:09.969248 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:09.969174 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df665c82-df9b-4b44-af9b-1fdc432a0516-bundle\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:03:10.668773 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:10.668665 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr" Jul 16 09:03:10.668773 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:10.668691 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr" event={"ID":"df665c82-df9b-4b44-af9b-1fdc432a0516","Type":"ContainerDied","Data":"e275d607ae249f9724b3c523a9c3fa6f706d02d863a736d7348bd4e45c1ea82f"} Jul 16 09:03:10.668773 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:10.668740 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e275d607ae249f9724b3c523a9c3fa6f706d02d863a736d7348bd4e45c1ea82f" Jul 16 09:03:10.670617 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:10.670595 2559 generic.go:356] "Generic (PLEG): container finished" podID="05d1a509-1367-44e1-9956-69efcae95b41" containerID="c5414f577f4b82cb4702a66cf659adf310240615e84ca5d6d552c2cc901ab62f" exitCode=0 Jul 16 09:03:10.670749 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:10.670680 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5" event={"ID":"05d1a509-1367-44e1-9956-69efcae95b41","Type":"ContainerDied","Data":"c5414f577f4b82cb4702a66cf659adf310240615e84ca5d6d552c2cc901ab62f"} Jul 16 09:03:10.672775 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:10.672748 2559 generic.go:356] "Generic (PLEG): container finished" podID="e31e0c53-f84a-408e-8a34-138d80b5d092" containerID="dc2e7ac4a6d3b6a0fd5547e960b95c3fce61a587b7efb3225cb875e4ca870ea3" exitCode=0 Jul 16 09:03:10.672872 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:10.672835 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m" event={"ID":"e31e0c53-f84a-408e-8a34-138d80b5d092","Type":"ContainerDied","Data":"dc2e7ac4a6d3b6a0fd5547e960b95c3fce61a587b7efb3225cb875e4ca870ea3"} Jul 16 09:03:10.817414 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:10.817390 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm" Jul 16 09:03:10.877551 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:10.877518 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d814caad-ef8c-4067-b9bf-2c88fa06b907-bundle\") pod \"d814caad-ef8c-4067-b9bf-2c88fa06b907\" (UID: \"d814caad-ef8c-4067-b9bf-2c88fa06b907\") " Jul 16 09:03:10.877665 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:10.877596 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d814caad-ef8c-4067-b9bf-2c88fa06b907-util\") pod \"d814caad-ef8c-4067-b9bf-2c88fa06b907\" (UID: \"d814caad-ef8c-4067-b9bf-2c88fa06b907\") " Jul 16 09:03:10.877665 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:10.877654 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkk52\" (UniqueName: \"kubernetes.io/projected/d814caad-ef8c-4067-b9bf-2c88fa06b907-kube-api-access-rkk52\") pod \"d814caad-ef8c-4067-b9bf-2c88fa06b907\" (UID: \"d814caad-ef8c-4067-b9bf-2c88fa06b907\") " Jul 16 09:03:10.879498 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:10.878829 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d814caad-ef8c-4067-b9bf-2c88fa06b907-bundle" (OuterVolumeSpecName: "bundle") pod "d814caad-ef8c-4067-b9bf-2c88fa06b907" (UID: "d814caad-ef8c-4067-b9bf-2c88fa06b907"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 09:03:10.885337 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:10.885312 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d814caad-ef8c-4067-b9bf-2c88fa06b907-kube-api-access-rkk52" (OuterVolumeSpecName: "kube-api-access-rkk52") pod "d814caad-ef8c-4067-b9bf-2c88fa06b907" (UID: "d814caad-ef8c-4067-b9bf-2c88fa06b907"). InnerVolumeSpecName "kube-api-access-rkk52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 09:03:10.885540 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:10.885497 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d814caad-ef8c-4067-b9bf-2c88fa06b907-util" (OuterVolumeSpecName: "util") pod "d814caad-ef8c-4067-b9bf-2c88fa06b907" (UID: "d814caad-ef8c-4067-b9bf-2c88fa06b907"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 09:03:10.979244 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:10.979196 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkk52\" (UniqueName: \"kubernetes.io/projected/d814caad-ef8c-4067-b9bf-2c88fa06b907-kube-api-access-rkk52\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:03:10.979244 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:10.979217 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d814caad-ef8c-4067-b9bf-2c88fa06b907-bundle\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:03:10.979244 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:10.979226 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d814caad-ef8c-4067-b9bf-2c88fa06b907-util\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:03:11.679076 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:11.679053 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm" Jul 16 09:03:11.679402 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:11.679052 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm" event={"ID":"d814caad-ef8c-4067-b9bf-2c88fa06b907","Type":"ContainerDied","Data":"1c8e85596193b2b7659867a8cd41c2e2dafc7cb4d888e77408702d6ab8d000d7"} Jul 16 09:03:11.679402 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:11.679163 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c8e85596193b2b7659867a8cd41c2e2dafc7cb4d888e77408702d6ab8d000d7" Jul 16 09:03:11.681068 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:11.681036 2559 generic.go:356] "Generic (PLEG): container finished" podID="05d1a509-1367-44e1-9956-69efcae95b41" containerID="808aff200958e38c425c417fc4969006a020102df519388f9470ca127dd1cf49" exitCode=0 Jul 16 09:03:11.681206 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:11.681079 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5" event={"ID":"05d1a509-1367-44e1-9956-69efcae95b41","Type":"ContainerDied","Data":"808aff200958e38c425c417fc4969006a020102df519388f9470ca127dd1cf49"} Jul 16 09:03:11.683115 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:11.683096 2559 generic.go:356] "Generic (PLEG): container finished" podID="e31e0c53-f84a-408e-8a34-138d80b5d092" containerID="2a05c6c55948e8d74c2e664d502e3bb72bbe3bdbc6c248d3d5c15a01b4c1546c" exitCode=0 Jul 16 09:03:11.683235 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:11.683145 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m" event={"ID":"e31e0c53-f84a-408e-8a34-138d80b5d092","Type":"ContainerDied","Data":"2a05c6c55948e8d74c2e664d502e3bb72bbe3bdbc6c248d3d5c15a01b4c1546c"} Jul 16 09:03:12.839980 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:12.839958 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5" Jul 16 09:03:12.842687 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:12.842672 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m" Jul 16 09:03:12.893902 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:12.893878 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bzms\" (UniqueName: \"kubernetes.io/projected/05d1a509-1367-44e1-9956-69efcae95b41-kube-api-access-2bzms\") pod \"05d1a509-1367-44e1-9956-69efcae95b41\" (UID: \"05d1a509-1367-44e1-9956-69efcae95b41\") " Jul 16 09:03:12.894025 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:12.893949 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e31e0c53-f84a-408e-8a34-138d80b5d092-util\") pod \"e31e0c53-f84a-408e-8a34-138d80b5d092\" (UID: \"e31e0c53-f84a-408e-8a34-138d80b5d092\") " Jul 16 09:03:12.894025 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:12.894011 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t24pt\" (UniqueName: \"kubernetes.io/projected/e31e0c53-f84a-408e-8a34-138d80b5d092-kube-api-access-t24pt\") pod \"e31e0c53-f84a-408e-8a34-138d80b5d092\" (UID: \"e31e0c53-f84a-408e-8a34-138d80b5d092\") " Jul 16 09:03:12.894132 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:12.894026 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05d1a509-1367-44e1-9956-69efcae95b41-bundle\") pod \"05d1a509-1367-44e1-9956-69efcae95b41\" (UID: \"05d1a509-1367-44e1-9956-69efcae95b41\") " Jul 16 09:03:12.894132 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:12.894071 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e31e0c53-f84a-408e-8a34-138d80b5d092-bundle\") pod \"e31e0c53-f84a-408e-8a34-138d80b5d092\" (UID: \"e31e0c53-f84a-408e-8a34-138d80b5d092\") " Jul 16 09:03:12.894132 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:12.894098 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05d1a509-1367-44e1-9956-69efcae95b41-util\") pod \"05d1a509-1367-44e1-9956-69efcae95b41\" (UID: \"05d1a509-1367-44e1-9956-69efcae95b41\") " Jul 16 09:03:12.894669 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:12.894634 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05d1a509-1367-44e1-9956-69efcae95b41-bundle" (OuterVolumeSpecName: "bundle") pod "05d1a509-1367-44e1-9956-69efcae95b41" (UID: "05d1a509-1367-44e1-9956-69efcae95b41"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 09:03:12.894916 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:12.894860 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e31e0c53-f84a-408e-8a34-138d80b5d092-bundle" (OuterVolumeSpecName: "bundle") pod "e31e0c53-f84a-408e-8a34-138d80b5d092" (UID: "e31e0c53-f84a-408e-8a34-138d80b5d092"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 09:03:12.896294 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:12.896270 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e31e0c53-f84a-408e-8a34-138d80b5d092-kube-api-access-t24pt" (OuterVolumeSpecName: "kube-api-access-t24pt") pod "e31e0c53-f84a-408e-8a34-138d80b5d092" (UID: "e31e0c53-f84a-408e-8a34-138d80b5d092"). InnerVolumeSpecName "kube-api-access-t24pt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 09:03:12.896633 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:12.896610 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05d1a509-1367-44e1-9956-69efcae95b41-kube-api-access-2bzms" (OuterVolumeSpecName: "kube-api-access-2bzms") pod "05d1a509-1367-44e1-9956-69efcae95b41" (UID: "05d1a509-1367-44e1-9956-69efcae95b41"). InnerVolumeSpecName "kube-api-access-2bzms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 09:03:12.899526 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:12.899503 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e31e0c53-f84a-408e-8a34-138d80b5d092-util" (OuterVolumeSpecName: "util") pod "e31e0c53-f84a-408e-8a34-138d80b5d092" (UID: "e31e0c53-f84a-408e-8a34-138d80b5d092"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 09:03:12.900203 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:12.900184 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05d1a509-1367-44e1-9956-69efcae95b41-util" (OuterVolumeSpecName: "util") pod "05d1a509-1367-44e1-9956-69efcae95b41" (UID: "05d1a509-1367-44e1-9956-69efcae95b41"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 09:03:12.995108 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:12.995088 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e31e0c53-f84a-408e-8a34-138d80b5d092-util\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:03:12.995108 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:12.995107 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t24pt\" (UniqueName: \"kubernetes.io/projected/e31e0c53-f84a-408e-8a34-138d80b5d092-kube-api-access-t24pt\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:03:12.995222 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:12.995117 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/05d1a509-1367-44e1-9956-69efcae95b41-bundle\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:03:12.995222 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:12.995124 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e31e0c53-f84a-408e-8a34-138d80b5d092-bundle\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:03:12.995222 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:12.995133 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/05d1a509-1367-44e1-9956-69efcae95b41-util\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:03:12.995222 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:12.995140 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bzms\" (UniqueName: \"kubernetes.io/projected/05d1a509-1367-44e1-9956-69efcae95b41-kube-api-access-2bzms\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:03:13.697433 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:13.697388 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5" event={"ID":"05d1a509-1367-44e1-9956-69efcae95b41","Type":"ContainerDied","Data":"d38648e70a14ede85bee8309d4f05125b1963d61dc3967954938c54756de4b67"} Jul 16 09:03:13.697609 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:13.697443 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d38648e70a14ede85bee8309d4f05125b1963d61dc3967954938c54756de4b67" Jul 16 09:03:13.697609 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:13.697405 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5" Jul 16 09:03:13.699254 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:13.699231 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m" event={"ID":"e31e0c53-f84a-408e-8a34-138d80b5d092","Type":"ContainerDied","Data":"f1f7c07fcb15307c3be16257cbe96f1e37b96e6fb0d284365728700117f9af31"} Jul 16 09:03:13.699354 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:13.699254 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m" Jul 16 09:03:13.699354 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:13.699269 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1f7c07fcb15307c3be16257cbe96f1e37b96e6fb0d284365728700117f9af31" Jul 16 09:03:17.107486 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:17.107434 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c8dd6895-cmkks"] Jul 16 09:03:42.127992 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.127934 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c8dd6895-cmkks" podUID="65ced7f2-f5f2-4377-a9f3-54ade33555cc" containerName="console" containerID="cri-o://7af42d315d6257e242b4bccbe1569ef7daa93a1602223e16bb85e9de7ebe9ed8" gracePeriod=15 Jul 16 09:03:42.380103 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.380050 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 09:03:42.522651 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.522627 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-trusted-ca-bundle\") pod \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " Jul 16 09:03:42.522824 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.522659 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-console-config\") pod \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " Jul 16 09:03:42.522824 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.522685 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-service-ca\") pod \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " Jul 16 09:03:42.522824 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.522708 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-oauth-serving-cert\") pod \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " Jul 16 09:03:42.523007 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.522912 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65ced7f2-f5f2-4377-a9f3-54ade33555cc-console-oauth-config\") pod \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " Jul 16 09:03:42.523007 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.522967 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65ced7f2-f5f2-4377-a9f3-54ade33555cc-console-serving-cert\") pod \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " Jul 16 09:03:42.523115 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.523013 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzkdv\" (UniqueName: \"kubernetes.io/projected/65ced7f2-f5f2-4377-a9f3-54ade33555cc-kube-api-access-qzkdv\") pod \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\" (UID: \"65ced7f2-f5f2-4377-a9f3-54ade33555cc\") " Jul 16 09:03:42.523182 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.523110 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-console-config" (OuterVolumeSpecName: "console-config") pod "65ced7f2-f5f2-4377-a9f3-54ade33555cc" (UID: "65ced7f2-f5f2-4377-a9f3-54ade33555cc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 09:03:42.523182 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.523139 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-service-ca" (OuterVolumeSpecName: "service-ca") pod "65ced7f2-f5f2-4377-a9f3-54ade33555cc" (UID: "65ced7f2-f5f2-4377-a9f3-54ade33555cc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 09:03:42.523182 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.523152 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "65ced7f2-f5f2-4377-a9f3-54ade33555cc" (UID: "65ced7f2-f5f2-4377-a9f3-54ade33555cc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 09:03:42.523182 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.523161 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "65ced7f2-f5f2-4377-a9f3-54ade33555cc" (UID: "65ced7f2-f5f2-4377-a9f3-54ade33555cc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 09:03:42.523381 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.523344 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-trusted-ca-bundle\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:03:42.523381 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.523357 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-console-config\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:03:42.523381 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.523366 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-service-ca\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:03:42.523381 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.523373 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65ced7f2-f5f2-4377-a9f3-54ade33555cc-oauth-serving-cert\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:03:42.525209 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.525184 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65ced7f2-f5f2-4377-a9f3-54ade33555cc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "65ced7f2-f5f2-4377-a9f3-54ade33555cc" (UID: "65ced7f2-f5f2-4377-a9f3-54ade33555cc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 09:03:42.525307 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.525241 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65ced7f2-f5f2-4377-a9f3-54ade33555cc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "65ced7f2-f5f2-4377-a9f3-54ade33555cc" (UID: "65ced7f2-f5f2-4377-a9f3-54ade33555cc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 09:03:42.525307 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.525278 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65ced7f2-f5f2-4377-a9f3-54ade33555cc-kube-api-access-qzkdv" (OuterVolumeSpecName: "kube-api-access-qzkdv") pod "65ced7f2-f5f2-4377-a9f3-54ade33555cc" (UID: "65ced7f2-f5f2-4377-a9f3-54ade33555cc"). InnerVolumeSpecName "kube-api-access-qzkdv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 09:03:42.624577 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.624555 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65ced7f2-f5f2-4377-a9f3-54ade33555cc-console-oauth-config\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:03:42.624577 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.624575 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65ced7f2-f5f2-4377-a9f3-54ade33555cc-console-serving-cert\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:03:42.624707 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.624583 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzkdv\" (UniqueName: \"kubernetes.io/projected/65ced7f2-f5f2-4377-a9f3-54ade33555cc-kube-api-access-qzkdv\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:03:42.848328 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.848302 2559 generic.go:356] "Generic (PLEG): container finished" podID="65ced7f2-f5f2-4377-a9f3-54ade33555cc" containerID="7af42d315d6257e242b4bccbe1569ef7daa93a1602223e16bb85e9de7ebe9ed8" exitCode=0 Jul 16 09:03:42.848494 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.848343 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8dd6895-cmkks" event={"ID":"65ced7f2-f5f2-4377-a9f3-54ade33555cc","Type":"ContainerDied","Data":"7af42d315d6257e242b4bccbe1569ef7daa93a1602223e16bb85e9de7ebe9ed8"} Jul 16 09:03:42.848494 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.848352 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8dd6895-cmkks" Jul 16 09:03:42.848494 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.848380 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8dd6895-cmkks" event={"ID":"65ced7f2-f5f2-4377-a9f3-54ade33555cc","Type":"ContainerDied","Data":"372d2a4e9c5e4013f5baf2cac3d4e632a449d5e75efa7760740f5976caab99e0"} Jul 16 09:03:42.848494 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.848413 2559 scope.go:117] "RemoveContainer" containerID="7af42d315d6257e242b4bccbe1569ef7daa93a1602223e16bb85e9de7ebe9ed8" Jul 16 09:03:42.860296 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.860269 2559 scope.go:117] "RemoveContainer" containerID="7af42d315d6257e242b4bccbe1569ef7daa93a1602223e16bb85e9de7ebe9ed8" Jul 16 09:03:42.860740 ip-10-0-140-31 kubenswrapper[2559]: E0716 09:03:42.860704 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7af42d315d6257e242b4bccbe1569ef7daa93a1602223e16bb85e9de7ebe9ed8\": container with ID starting with 7af42d315d6257e242b4bccbe1569ef7daa93a1602223e16bb85e9de7ebe9ed8 not found: ID does not exist" containerID="7af42d315d6257e242b4bccbe1569ef7daa93a1602223e16bb85e9de7ebe9ed8" Jul 16 09:03:42.860814 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.860752 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7af42d315d6257e242b4bccbe1569ef7daa93a1602223e16bb85e9de7ebe9ed8"} err="failed to get container status \"7af42d315d6257e242b4bccbe1569ef7daa93a1602223e16bb85e9de7ebe9ed8\": rpc error: code = NotFound desc = could not find container \"7af42d315d6257e242b4bccbe1569ef7daa93a1602223e16bb85e9de7ebe9ed8\": container with ID starting with 7af42d315d6257e242b4bccbe1569ef7daa93a1602223e16bb85e9de7ebe9ed8 not found: ID does not exist" Jul 16 09:03:42.871337 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.871316 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c8dd6895-cmkks"] Jul 16 09:03:42.877583 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:42.877564 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c8dd6895-cmkks"] Jul 16 09:03:44.244313 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:44.244274 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65ced7f2-f5f2-4377-a9f3-54ade33555cc" path="/var/lib/kubelet/pods/65ced7f2-f5f2-4377-a9f3-54ade33555cc/volumes" Jul 16 09:03:54.011611 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.011582 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj"] Jul 16 09:03:54.011957 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.011893 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d814caad-ef8c-4067-b9bf-2c88fa06b907" containerName="extract" Jul 16 09:03:54.011957 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.011903 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d814caad-ef8c-4067-b9bf-2c88fa06b907" containerName="extract" Jul 16 09:03:54.011957 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.011915 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df665c82-df9b-4b44-af9b-1fdc432a0516" containerName="extract" Jul 16 09:03:54.011957 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.011920 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="df665c82-df9b-4b44-af9b-1fdc432a0516" containerName="extract" Jul 16 09:03:54.011957 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.011928 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e31e0c53-f84a-408e-8a34-138d80b5d092" containerName="extract" Jul 16 09:03:54.011957 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.011933 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e31e0c53-f84a-408e-8a34-138d80b5d092" containerName="extract" Jul 16 09:03:54.011957 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.011941 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d814caad-ef8c-4067-b9bf-2c88fa06b907" containerName="pull" Jul 16 09:03:54.011957 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.011946 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d814caad-ef8c-4067-b9bf-2c88fa06b907" containerName="pull" Jul 16 09:03:54.011957 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.011952 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65ced7f2-f5f2-4377-a9f3-54ade33555cc" containerName="console" Jul 16 09:03:54.011957 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.011958 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="65ced7f2-f5f2-4377-a9f3-54ade33555cc" containerName="console" Jul 16 09:03:54.011957 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.011964 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e31e0c53-f84a-408e-8a34-138d80b5d092" containerName="util" Jul 16 09:03:54.012300 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.011969 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e31e0c53-f84a-408e-8a34-138d80b5d092" containerName="util" Jul 16 09:03:54.012300 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.011977 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df665c82-df9b-4b44-af9b-1fdc432a0516" containerName="util" Jul 16 09:03:54.012300 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.011981 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="df665c82-df9b-4b44-af9b-1fdc432a0516" containerName="util" Jul 16 09:03:54.012300 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.011987 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05d1a509-1367-44e1-9956-69efcae95b41" containerName="extract" Jul 16 09:03:54.012300 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.011993 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="05d1a509-1367-44e1-9956-69efcae95b41" containerName="extract" Jul 16 09:03:54.012300 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.012000 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d814caad-ef8c-4067-b9bf-2c88fa06b907" containerName="util" Jul 16 09:03:54.012300 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.012004 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d814caad-ef8c-4067-b9bf-2c88fa06b907" containerName="util" Jul 16 09:03:54.012300 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.012010 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e31e0c53-f84a-408e-8a34-138d80b5d092" containerName="pull" Jul 16 09:03:54.012300 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.012015 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e31e0c53-f84a-408e-8a34-138d80b5d092" containerName="pull" Jul 16 09:03:54.012300 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.012022 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05d1a509-1367-44e1-9956-69efcae95b41" containerName="util" Jul 16 09:03:54.012300 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.012027 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="05d1a509-1367-44e1-9956-69efcae95b41" containerName="util" Jul 16 09:03:54.012300 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.012035 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df665c82-df9b-4b44-af9b-1fdc432a0516" containerName="pull" Jul 16 09:03:54.012300 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.012040 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="df665c82-df9b-4b44-af9b-1fdc432a0516" containerName="pull" Jul 16 09:03:54.012300 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.012045 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05d1a509-1367-44e1-9956-69efcae95b41" containerName="pull" Jul 16 09:03:54.012300 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.012050 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="05d1a509-1367-44e1-9956-69efcae95b41" containerName="pull" Jul 16 09:03:54.012300 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.012096 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d814caad-ef8c-4067-b9bf-2c88fa06b907" containerName="extract" Jul 16 09:03:54.012300 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.012104 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="05d1a509-1367-44e1-9956-69efcae95b41" containerName="extract" Jul 16 09:03:54.012300 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.012112 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="df665c82-df9b-4b44-af9b-1fdc432a0516" containerName="extract" Jul 16 09:03:54.012300 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.012118 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e31e0c53-f84a-408e-8a34-138d80b5d092" containerName="extract" Jul 16 09:03:54.012300 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.012122 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="65ced7f2-f5f2-4377-a9f3-54ade33555cc" containerName="console" Jul 16 09:03:54.016384 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.016364 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj" Jul 16 09:03:54.018880 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.018859 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 16 09:03:54.018980 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.018950 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 16 09:03:54.019035 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.018950 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wxqz8\"" Jul 16 09:03:54.030709 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.030688 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj"] Jul 16 09:03:54.111799 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.111770 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/13d25556-3828-4b12-9a80-afbee6b910c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-h2tgj\" (UID: \"13d25556-3828-4b12-9a80-afbee6b910c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj" Jul 16 09:03:54.111947 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.111809 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6rdv\" (UniqueName: \"kubernetes.io/projected/13d25556-3828-4b12-9a80-afbee6b910c1-kube-api-access-b6rdv\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-h2tgj\" (UID: \"13d25556-3828-4b12-9a80-afbee6b910c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj" Jul 16 09:03:54.213101 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.213070 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6rdv\" (UniqueName: \"kubernetes.io/projected/13d25556-3828-4b12-9a80-afbee6b910c1-kube-api-access-b6rdv\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-h2tgj\" (UID: \"13d25556-3828-4b12-9a80-afbee6b910c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj" Jul 16 09:03:54.213275 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.213145 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/13d25556-3828-4b12-9a80-afbee6b910c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-h2tgj\" (UID: \"13d25556-3828-4b12-9a80-afbee6b910c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj" Jul 16 09:03:54.213491 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.213448 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/13d25556-3828-4b12-9a80-afbee6b910c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-h2tgj\" (UID: \"13d25556-3828-4b12-9a80-afbee6b910c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj" Jul 16 09:03:54.222536 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.222512 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6rdv\" (UniqueName: \"kubernetes.io/projected/13d25556-3828-4b12-9a80-afbee6b910c1-kube-api-access-b6rdv\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-h2tgj\" (UID: \"13d25556-3828-4b12-9a80-afbee6b910c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj" Jul 16 09:03:54.327327 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.327256 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj" Jul 16 09:03:54.469772 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.469745 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj"] Jul 16 09:03:54.471242 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:03:54.471214 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d25556_3828_4b12_9a80_afbee6b910c1.slice/crio-a3fc15ada786e8d2f4e1f1a9723c65a774d10dea7fbf1064da1c6d575b906f09 WatchSource:0}: Error finding container a3fc15ada786e8d2f4e1f1a9723c65a774d10dea7fbf1064da1c6d575b906f09: Status 404 returned error can't find the container with id a3fc15ada786e8d2f4e1f1a9723c65a774d10dea7fbf1064da1c6d575b906f09 Jul 16 09:03:54.912120 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:54.912091 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj" event={"ID":"13d25556-3828-4b12-9a80-afbee6b910c1","Type":"ContainerStarted","Data":"a3fc15ada786e8d2f4e1f1a9723c65a774d10dea7fbf1064da1c6d575b906f09"} Jul 16 09:03:59.947644 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:59.947613 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj" event={"ID":"13d25556-3828-4b12-9a80-afbee6b910c1","Type":"ContainerStarted","Data":"514c9c4b370bfab5dc954830a6e368c04992a8c2da4b6120a74f122633c53a42"} Jul 16 09:03:59.948026 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:59.947776 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj" Jul 16 09:03:59.981976 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:03:59.981929 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj" podStartSLOduration=2.112115583 podStartE2EDuration="6.981914557s" totalImagesPullingTime="4.869798974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:03:59.979070655 +0000 UTC m=+568.268520917" watchObservedRunningTime="2026-07-16 09:03:59.981914557 +0000 UTC m=+568.271364814" Jul 16 09:04:10.955990 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:10.955956 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj" Jul 16 09:04:11.352899 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:11.352872 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4"] Jul 16 09:04:11.356577 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:11.356555 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4" Jul 16 09:04:11.372857 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:11.372833 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4"] Jul 16 09:04:11.440466 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:11.440440 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e445c495-82dd-4967-9079-4a0a157f920a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9ztm4\" (UID: \"e445c495-82dd-4967-9079-4a0a157f920a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4" Jul 16 09:04:11.440595 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:11.440521 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tplf\" (UniqueName: \"kubernetes.io/projected/e445c495-82dd-4967-9079-4a0a157f920a-kube-api-access-8tplf\") pod \"kuadrant-operator-controller-manager-86878c769f-9ztm4\" (UID: \"e445c495-82dd-4967-9079-4a0a157f920a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4" Jul 16 09:04:11.541375 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:11.541312 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tplf\" (UniqueName: \"kubernetes.io/projected/e445c495-82dd-4967-9079-4a0a157f920a-kube-api-access-8tplf\") pod \"kuadrant-operator-controller-manager-86878c769f-9ztm4\" (UID: \"e445c495-82dd-4967-9079-4a0a157f920a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4" Jul 16 09:04:11.541375 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:11.541368 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e445c495-82dd-4967-9079-4a0a157f920a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9ztm4\" (UID: \"e445c495-82dd-4967-9079-4a0a157f920a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4" Jul 16 09:04:11.541719 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:11.541704 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e445c495-82dd-4967-9079-4a0a157f920a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9ztm4\" (UID: \"e445c495-82dd-4967-9079-4a0a157f920a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4" Jul 16 09:04:11.554991 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:11.554967 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tplf\" (UniqueName: \"kubernetes.io/projected/e445c495-82dd-4967-9079-4a0a157f920a-kube-api-access-8tplf\") pod \"kuadrant-operator-controller-manager-86878c769f-9ztm4\" (UID: \"e445c495-82dd-4967-9079-4a0a157f920a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4" Jul 16 09:04:11.665589 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:11.665553 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4" Jul 16 09:04:11.804655 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:11.804633 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4"] Jul 16 09:04:11.806444 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:04:11.806416 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode445c495_82dd_4967_9079_4a0a157f920a.slice/crio-581c6b582c4feb3474b1e71bf6d18fd7f09eeea4648b8272d1b013cc01fa7577 WatchSource:0}: Error finding container 581c6b582c4feb3474b1e71bf6d18fd7f09eeea4648b8272d1b013cc01fa7577: Status 404 returned error can't find the container with id 581c6b582c4feb3474b1e71bf6d18fd7f09eeea4648b8272d1b013cc01fa7577 Jul 16 09:04:12.012539 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:12.012503 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4" event={"ID":"e445c495-82dd-4967-9079-4a0a157f920a","Type":"ContainerStarted","Data":"bf5f9935c385779311f825d5317d567514f43afec145b87acbe922b7971d90f8"} Jul 16 09:04:12.012889 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:12.012562 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4" event={"ID":"e445c495-82dd-4967-9079-4a0a157f920a","Type":"ContainerStarted","Data":"581c6b582c4feb3474b1e71bf6d18fd7f09eeea4648b8272d1b013cc01fa7577"} Jul 16 09:04:12.012889 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:12.012608 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4" Jul 16 09:04:12.032222 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:12.032181 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4" podStartSLOduration=1.032165992 podStartE2EDuration="1.032165992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:04:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:04:12.030521805 +0000 UTC m=+580.319972064" watchObservedRunningTime="2026-07-16 09:04:12.032165992 +0000 UTC m=+580.321616251" Jul 16 09:04:23.020728 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:23.020695 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4" Jul 16 09:04:23.105364 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:23.105302 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj"] Jul 16 09:04:23.105606 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:23.105578 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj" podUID="13d25556-3828-4b12-9a80-afbee6b910c1" containerName="manager" containerID="cri-o://514c9c4b370bfab5dc954830a6e368c04992a8c2da4b6120a74f122633c53a42" gracePeriod=10 Jul 16 09:04:23.376173 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:23.376152 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj" Jul 16 09:04:23.433039 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:23.433015 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/13d25556-3828-4b12-9a80-afbee6b910c1-extensions-socket-volume\") pod \"13d25556-3828-4b12-9a80-afbee6b910c1\" (UID: \"13d25556-3828-4b12-9a80-afbee6b910c1\") " Jul 16 09:04:23.433181 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:23.433053 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6rdv\" (UniqueName: \"kubernetes.io/projected/13d25556-3828-4b12-9a80-afbee6b910c1-kube-api-access-b6rdv\") pod \"13d25556-3828-4b12-9a80-afbee6b910c1\" (UID: \"13d25556-3828-4b12-9a80-afbee6b910c1\") " Jul 16 09:04:23.433531 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:23.433505 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13d25556-3828-4b12-9a80-afbee6b910c1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "13d25556-3828-4b12-9a80-afbee6b910c1" (UID: "13d25556-3828-4b12-9a80-afbee6b910c1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 09:04:23.435150 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:23.435127 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13d25556-3828-4b12-9a80-afbee6b910c1-kube-api-access-b6rdv" (OuterVolumeSpecName: "kube-api-access-b6rdv") pod "13d25556-3828-4b12-9a80-afbee6b910c1" (UID: "13d25556-3828-4b12-9a80-afbee6b910c1"). InnerVolumeSpecName "kube-api-access-b6rdv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 09:04:23.533892 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:23.533860 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/13d25556-3828-4b12-9a80-afbee6b910c1-extensions-socket-volume\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:04:23.533892 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:23.533886 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6rdv\" (UniqueName: \"kubernetes.io/projected/13d25556-3828-4b12-9a80-afbee6b910c1-kube-api-access-b6rdv\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:04:24.082338 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:24.082299 2559 generic.go:356] "Generic (PLEG): container finished" podID="13d25556-3828-4b12-9a80-afbee6b910c1" containerID="514c9c4b370bfab5dc954830a6e368c04992a8c2da4b6120a74f122633c53a42" exitCode=0 Jul 16 09:04:24.082763 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:24.082347 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj" Jul 16 09:04:24.082763 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:24.082383 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj" event={"ID":"13d25556-3828-4b12-9a80-afbee6b910c1","Type":"ContainerDied","Data":"514c9c4b370bfab5dc954830a6e368c04992a8c2da4b6120a74f122633c53a42"} Jul 16 09:04:24.082763 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:24.082440 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj" event={"ID":"13d25556-3828-4b12-9a80-afbee6b910c1","Type":"ContainerDied","Data":"a3fc15ada786e8d2f4e1f1a9723c65a774d10dea7fbf1064da1c6d575b906f09"} Jul 16 09:04:24.082763 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:24.082465 2559 scope.go:117] "RemoveContainer" containerID="514c9c4b370bfab5dc954830a6e368c04992a8c2da4b6120a74f122633c53a42" Jul 16 09:04:24.091407 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:24.091384 2559 scope.go:117] "RemoveContainer" containerID="514c9c4b370bfab5dc954830a6e368c04992a8c2da4b6120a74f122633c53a42" Jul 16 09:04:24.091717 ip-10-0-140-31 kubenswrapper[2559]: E0716 09:04:24.091697 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"514c9c4b370bfab5dc954830a6e368c04992a8c2da4b6120a74f122633c53a42\": container with ID starting with 514c9c4b370bfab5dc954830a6e368c04992a8c2da4b6120a74f122633c53a42 not found: ID does not exist" containerID="514c9c4b370bfab5dc954830a6e368c04992a8c2da4b6120a74f122633c53a42" Jul 16 09:04:24.091767 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:24.091730 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514c9c4b370bfab5dc954830a6e368c04992a8c2da4b6120a74f122633c53a42"} err="failed to get container status \"514c9c4b370bfab5dc954830a6e368c04992a8c2da4b6120a74f122633c53a42\": rpc error: code = NotFound desc = could not find container \"514c9c4b370bfab5dc954830a6e368c04992a8c2da4b6120a74f122633c53a42\": container with ID starting with 514c9c4b370bfab5dc954830a6e368c04992a8c2da4b6120a74f122633c53a42 not found: ID does not exist" Jul 16 09:04:24.106445 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:24.106425 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj"] Jul 16 09:04:24.115898 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:24.114838 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-h2tgj"] Jul 16 09:04:24.243348 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:24.243320 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13d25556-3828-4b12-9a80-afbee6b910c1" path="/var/lib/kubelet/pods/13d25556-3828-4b12-9a80-afbee6b910c1/volumes" Jul 16 09:04:32.169494 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:32.169450 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/2.log" Jul 16 09:04:32.172729 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:32.172708 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/2.log" Jul 16 09:04:32.176390 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:32.176373 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sb2b7_4aa01755-587c-4e81-bf62-974df0ddbf82/ovn-acl-logging/0.log" Jul 16 09:04:32.179913 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:04:32.179894 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sb2b7_4aa01755-587c-4e81-bf62-974df0ddbf82/ovn-acl-logging/0.log" Jul 16 09:05:54.220067 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:05:54.220033 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-hsnxz"] Jul 16 09:05:54.220619 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:05:54.220378 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13d25556-3828-4b12-9a80-afbee6b910c1" containerName="manager" Jul 16 09:05:54.220619 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:05:54.220390 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="13d25556-3828-4b12-9a80-afbee6b910c1" containerName="manager" Jul 16 09:05:54.220619 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:05:54.220461 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="13d25556-3828-4b12-9a80-afbee6b910c1" containerName="manager" Jul 16 09:05:54.223679 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:05:54.223662 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-hsnxz" Jul 16 09:05:54.226235 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:05:54.226215 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-c9hwf\"" Jul 16 09:05:54.226333 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:05:54.226223 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 16 09:05:54.235568 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:05:54.235546 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-hsnxz"] Jul 16 09:05:54.317611 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:05:54.317581 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m4dk\" (UniqueName: \"kubernetes.io/projected/1aeaec3b-3487-4069-9960-7e2ecc064c8c-kube-api-access-5m4dk\") pod \"payload-pre-processing-74584bb9f8-hsnxz\" (UID: \"1aeaec3b-3487-4069-9960-7e2ecc064c8c\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-hsnxz" Jul 16 09:05:54.317758 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:05:54.317640 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1aeaec3b-3487-4069-9960-7e2ecc064c8c-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-hsnxz\" (UID: \"1aeaec3b-3487-4069-9960-7e2ecc064c8c\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-hsnxz" Jul 16 09:05:54.418584 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:05:54.418550 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1aeaec3b-3487-4069-9960-7e2ecc064c8c-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-hsnxz\" (UID: \"1aeaec3b-3487-4069-9960-7e2ecc064c8c\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-hsnxz" Jul 16 09:05:54.418740 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:05:54.418647 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m4dk\" (UniqueName: \"kubernetes.io/projected/1aeaec3b-3487-4069-9960-7e2ecc064c8c-kube-api-access-5m4dk\") pod \"payload-pre-processing-74584bb9f8-hsnxz\" (UID: \"1aeaec3b-3487-4069-9960-7e2ecc064c8c\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-hsnxz" Jul 16 09:05:54.419280 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:05:54.419260 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1aeaec3b-3487-4069-9960-7e2ecc064c8c-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-hsnxz\" (UID: \"1aeaec3b-3487-4069-9960-7e2ecc064c8c\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-hsnxz" Jul 16 09:05:54.428216 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:05:54.428194 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m4dk\" (UniqueName: \"kubernetes.io/projected/1aeaec3b-3487-4069-9960-7e2ecc064c8c-kube-api-access-5m4dk\") pod \"payload-pre-processing-74584bb9f8-hsnxz\" (UID: \"1aeaec3b-3487-4069-9960-7e2ecc064c8c\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-hsnxz" Jul 16 09:05:54.534452 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:05:54.534426 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-hsnxz" Jul 16 09:05:54.675483 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:05:54.675441 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-hsnxz"] Jul 16 09:05:54.676682 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:05:54.676651 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aeaec3b_3487_4069_9960_7e2ecc064c8c.slice/crio-018882fe31897a21ea23813f19623776daf5f3d4b7e7f1d7669a3fe69ecd540a WatchSource:0}: Error finding container 018882fe31897a21ea23813f19623776daf5f3d4b7e7f1d7669a3fe69ecd540a: Status 404 returned error can't find the container with id 018882fe31897a21ea23813f19623776daf5f3d4b7e7f1d7669a3fe69ecd540a Jul 16 09:05:54.678774 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:05:54.678756 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 09:05:55.535423 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:05:55.535388 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-hsnxz" event={"ID":"1aeaec3b-3487-4069-9960-7e2ecc064c8c","Type":"ContainerStarted","Data":"018882fe31897a21ea23813f19623776daf5f3d4b7e7f1d7669a3fe69ecd540a"} Jul 16 09:05:56.543722 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:05:56.543688 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-hsnxz" event={"ID":"1aeaec3b-3487-4069-9960-7e2ecc064c8c","Type":"ContainerStarted","Data":"85574afe7d930a866e2c9bfc0fb803792597d93c549b9f7a628cbec7290d6764"} Jul 16 09:05:56.544090 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:05:56.543797 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-hsnxz" Jul 16 09:05:56.561762 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:05:56.561012 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-hsnxz" podStartSLOduration=1.003188135 podStartE2EDuration="2.560995492s" totalImagesPullingTime="1.557807357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:05:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:05:56.559691077 +0000 UTC m=+684.849141340" watchObservedRunningTime="2026-07-16 09:05:56.560995492 +0000 UTC m=+684.850445753" Jul 16 09:06:07.550862 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:07.550833 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-hsnxz" Jul 16 09:06:35.550797 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.550759 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv"] Jul 16 09:06:35.554308 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.554287 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:35.557912 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.557886 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 16 09:06:35.557912 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.557906 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 16 09:06:35.557912 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.557886 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 16 09:06:35.558126 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.557936 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jn4fs\"" Jul 16 09:06:35.565984 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.565962 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv"] Jul 16 09:06:35.634379 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.634352 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80c992fa-5bda-4b03-b29a-e0113cad39e7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wkxzv\" (UID: \"80c992fa-5bda-4b03-b29a-e0113cad39e7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:35.634505 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.634413 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80c992fa-5bda-4b03-b29a-e0113cad39e7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wkxzv\" (UID: \"80c992fa-5bda-4b03-b29a-e0113cad39e7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:35.634505 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.634457 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80c992fa-5bda-4b03-b29a-e0113cad39e7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wkxzv\" (UID: \"80c992fa-5bda-4b03-b29a-e0113cad39e7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:35.634581 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.634507 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fjsd\" (UniqueName: \"kubernetes.io/projected/80c992fa-5bda-4b03-b29a-e0113cad39e7-kube-api-access-5fjsd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wkxzv\" (UID: \"80c992fa-5bda-4b03-b29a-e0113cad39e7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:35.634581 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.634527 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80c992fa-5bda-4b03-b29a-e0113cad39e7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wkxzv\" (UID: \"80c992fa-5bda-4b03-b29a-e0113cad39e7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:35.634581 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.634556 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80c992fa-5bda-4b03-b29a-e0113cad39e7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wkxzv\" (UID: \"80c992fa-5bda-4b03-b29a-e0113cad39e7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:35.735421 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.735393 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80c992fa-5bda-4b03-b29a-e0113cad39e7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wkxzv\" (UID: \"80c992fa-5bda-4b03-b29a-e0113cad39e7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:35.735550 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.735437 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80c992fa-5bda-4b03-b29a-e0113cad39e7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wkxzv\" (UID: \"80c992fa-5bda-4b03-b29a-e0113cad39e7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:35.735550 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.735497 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80c992fa-5bda-4b03-b29a-e0113cad39e7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wkxzv\" (UID: \"80c992fa-5bda-4b03-b29a-e0113cad39e7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:35.735550 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.735515 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80c992fa-5bda-4b03-b29a-e0113cad39e7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wkxzv\" (UID: \"80c992fa-5bda-4b03-b29a-e0113cad39e7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:35.735550 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.735537 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fjsd\" (UniqueName: \"kubernetes.io/projected/80c992fa-5bda-4b03-b29a-e0113cad39e7-kube-api-access-5fjsd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wkxzv\" (UID: \"80c992fa-5bda-4b03-b29a-e0113cad39e7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:35.735733 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.735555 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80c992fa-5bda-4b03-b29a-e0113cad39e7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wkxzv\" (UID: \"80c992fa-5bda-4b03-b29a-e0113cad39e7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:35.735928 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.735899 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80c992fa-5bda-4b03-b29a-e0113cad39e7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wkxzv\" (UID: \"80c992fa-5bda-4b03-b29a-e0113cad39e7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:35.736049 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.735960 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80c992fa-5bda-4b03-b29a-e0113cad39e7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wkxzv\" (UID: \"80c992fa-5bda-4b03-b29a-e0113cad39e7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:35.736049 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.735992 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80c992fa-5bda-4b03-b29a-e0113cad39e7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wkxzv\" (UID: \"80c992fa-5bda-4b03-b29a-e0113cad39e7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:35.737948 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.737927 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80c992fa-5bda-4b03-b29a-e0113cad39e7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wkxzv\" (UID: \"80c992fa-5bda-4b03-b29a-e0113cad39e7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:35.738110 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.738093 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80c992fa-5bda-4b03-b29a-e0113cad39e7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wkxzv\" (UID: \"80c992fa-5bda-4b03-b29a-e0113cad39e7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:35.744119 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.744100 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fjsd\" (UniqueName: \"kubernetes.io/projected/80c992fa-5bda-4b03-b29a-e0113cad39e7-kube-api-access-5fjsd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-wkxzv\" (UID: \"80c992fa-5bda-4b03-b29a-e0113cad39e7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:35.866255 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:35.866193 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:36.002426 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:36.002394 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv"] Jul 16 09:06:36.003396 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:06:36.003372 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c992fa_5bda_4b03_b29a_e0113cad39e7.slice/crio-5d28580fdaa5e3f54eaabed6903411139ed6146d66e0a3b1665cff343fd44f2a WatchSource:0}: Error finding container 5d28580fdaa5e3f54eaabed6903411139ed6146d66e0a3b1665cff343fd44f2a: Status 404 returned error can't find the container with id 5d28580fdaa5e3f54eaabed6903411139ed6146d66e0a3b1665cff343fd44f2a Jul 16 09:06:36.751038 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:36.750999 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" event={"ID":"80c992fa-5bda-4b03-b29a-e0113cad39e7","Type":"ContainerStarted","Data":"5d28580fdaa5e3f54eaabed6903411139ed6146d66e0a3b1665cff343fd44f2a"} Jul 16 09:06:37.758730 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:37.758692 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" event={"ID":"80c992fa-5bda-4b03-b29a-e0113cad39e7","Type":"ContainerStarted","Data":"36fe957e542d4a91e0094aa87b302f6383038df645dba987b1d0ced097ccac78"} Jul 16 09:06:37.789936 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:37.789886 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" podStartSLOduration=1.724998214 podStartE2EDuration="2.789870999s" totalImagesPullingTime="1.064872785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:06:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:06:37.787177579 +0000 UTC m=+726.076627841" watchObservedRunningTime="2026-07-16 09:06:37.789870999 +0000 UTC m=+726.079321260" Jul 16 09:06:45.256280 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.256246 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp"] Jul 16 09:06:45.260389 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.260369 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:06:45.262762 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.262740 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 16 09:06:45.269413 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.269392 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp"] Jul 16 09:06:45.409230 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.409204 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5552ea00-7d9a-42e2-8279-33f7a9a5273a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp\" (UID: \"5552ea00-7d9a-42e2-8279-33f7a9a5273a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:06:45.409434 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.409407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmcng\" (UniqueName: \"kubernetes.io/projected/5552ea00-7d9a-42e2-8279-33f7a9a5273a-kube-api-access-pmcng\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp\" (UID: \"5552ea00-7d9a-42e2-8279-33f7a9a5273a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:06:45.409530 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.409517 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5552ea00-7d9a-42e2-8279-33f7a9a5273a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp\" (UID: \"5552ea00-7d9a-42e2-8279-33f7a9a5273a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:06:45.409587 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.409572 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5552ea00-7d9a-42e2-8279-33f7a9a5273a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp\" (UID: \"5552ea00-7d9a-42e2-8279-33f7a9a5273a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:06:45.409648 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.409600 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5552ea00-7d9a-42e2-8279-33f7a9a5273a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp\" (UID: \"5552ea00-7d9a-42e2-8279-33f7a9a5273a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:06:45.409824 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.409798 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5552ea00-7d9a-42e2-8279-33f7a9a5273a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp\" (UID: \"5552ea00-7d9a-42e2-8279-33f7a9a5273a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:06:45.510520 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.510440 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5552ea00-7d9a-42e2-8279-33f7a9a5273a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp\" (UID: \"5552ea00-7d9a-42e2-8279-33f7a9a5273a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:06:45.510520 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.510506 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmcng\" (UniqueName: \"kubernetes.io/projected/5552ea00-7d9a-42e2-8279-33f7a9a5273a-kube-api-access-pmcng\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp\" (UID: \"5552ea00-7d9a-42e2-8279-33f7a9a5273a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:06:45.510659 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.510543 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5552ea00-7d9a-42e2-8279-33f7a9a5273a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp\" (UID: \"5552ea00-7d9a-42e2-8279-33f7a9a5273a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:06:45.510659 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.510573 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5552ea00-7d9a-42e2-8279-33f7a9a5273a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp\" (UID: \"5552ea00-7d9a-42e2-8279-33f7a9a5273a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:06:45.510659 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.510591 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5552ea00-7d9a-42e2-8279-33f7a9a5273a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp\" (UID: \"5552ea00-7d9a-42e2-8279-33f7a9a5273a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:06:45.510659 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.510644 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5552ea00-7d9a-42e2-8279-33f7a9a5273a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp\" (UID: \"5552ea00-7d9a-42e2-8279-33f7a9a5273a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:06:45.510887 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.510866 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5552ea00-7d9a-42e2-8279-33f7a9a5273a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp\" (UID: \"5552ea00-7d9a-42e2-8279-33f7a9a5273a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:06:45.510935 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.510897 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5552ea00-7d9a-42e2-8279-33f7a9a5273a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp\" (UID: \"5552ea00-7d9a-42e2-8279-33f7a9a5273a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:06:45.510972 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.510949 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5552ea00-7d9a-42e2-8279-33f7a9a5273a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp\" (UID: \"5552ea00-7d9a-42e2-8279-33f7a9a5273a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:06:45.512924 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.512901 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5552ea00-7d9a-42e2-8279-33f7a9a5273a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp\" (UID: \"5552ea00-7d9a-42e2-8279-33f7a9a5273a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:06:45.513096 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.513079 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5552ea00-7d9a-42e2-8279-33f7a9a5273a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp\" (UID: \"5552ea00-7d9a-42e2-8279-33f7a9a5273a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:06:45.519718 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.519697 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmcng\" (UniqueName: \"kubernetes.io/projected/5552ea00-7d9a-42e2-8279-33f7a9a5273a-kube-api-access-pmcng\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp\" (UID: \"5552ea00-7d9a-42e2-8279-33f7a9a5273a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:06:45.572300 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.572279 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:06:45.718485 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.718448 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp"] Jul 16 09:06:45.720525 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:06:45.720496 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5552ea00_7d9a_42e2_8279_33f7a9a5273a.slice/crio-909a3beef0c8abdf4b62e355cd6dd38107073f1612326c3d37cfb929257873b6 WatchSource:0}: Error finding container 909a3beef0c8abdf4b62e355cd6dd38107073f1612326c3d37cfb929257873b6: Status 404 returned error can't find the container with id 909a3beef0c8abdf4b62e355cd6dd38107073f1612326c3d37cfb929257873b6 Jul 16 09:06:45.800130 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.800074 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" event={"ID":"5552ea00-7d9a-42e2-8279-33f7a9a5273a","Type":"ContainerStarted","Data":"909a3beef0c8abdf4b62e355cd6dd38107073f1612326c3d37cfb929257873b6"} Jul 16 09:06:45.866528 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.866508 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:45.866631 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.866553 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:45.879194 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:45.879175 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:46.807327 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:46.807288 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" event={"ID":"5552ea00-7d9a-42e2-8279-33f7a9a5273a","Type":"ContainerStarted","Data":"b35951afeefbae6fc63daff04bf9d23ef33770ff01a518732e42a58e5dab0c5e"} Jul 16 09:06:46.819071 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:46.819048 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-wkxzv" Jul 16 09:06:46.824413 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:46.824376 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" podStartSLOduration=1.602179875 podStartE2EDuration="1.824362793s" totalImagesPullingTime="222.182918ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:06:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:06:46.823289284 +0000 UTC m=+735.112739543" watchObservedRunningTime="2026-07-16 09:06:46.824362793 +0000 UTC m=+735.113813054" Jul 16 09:06:55.573429 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:55.573400 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:06:55.573851 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:55.573512 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:06:55.585861 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:55.585838 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:06:55.864032 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:06:55.863963 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp" Jul 16 09:09:32.207061 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:09:32.206988 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/2.log" Jul 16 09:09:32.207894 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:09:32.207874 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/2.log" Jul 16 09:09:32.217979 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:09:32.217957 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sb2b7_4aa01755-587c-4e81-bf62-974df0ddbf82/ovn-acl-logging/0.log" Jul 16 09:09:32.218985 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:09:32.218964 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sb2b7_4aa01755-587c-4e81-bf62-974df0ddbf82/ovn-acl-logging/0.log" Jul 16 09:14:18.781599 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:14:18.781525 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4"] Jul 16 09:14:18.782133 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:14:18.781741 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4" podUID="e445c495-82dd-4967-9079-4a0a157f920a" containerName="manager" containerID="cri-o://bf5f9935c385779311f825d5317d567514f43afec145b87acbe922b7971d90f8" gracePeriod=10 Jul 16 09:14:21.832153 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:14:21.832122 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4" Jul 16 09:14:21.883606 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:14:21.883567 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tplf\" (UniqueName: \"kubernetes.io/projected/e445c495-82dd-4967-9079-4a0a157f920a-kube-api-access-8tplf\") pod \"e445c495-82dd-4967-9079-4a0a157f920a\" (UID: \"e445c495-82dd-4967-9079-4a0a157f920a\") " Jul 16 09:14:21.883756 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:14:21.883639 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e445c495-82dd-4967-9079-4a0a157f920a-extensions-socket-volume\") pod \"e445c495-82dd-4967-9079-4a0a157f920a\" (UID: \"e445c495-82dd-4967-9079-4a0a157f920a\") " Jul 16 09:14:21.883990 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:14:21.883966 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e445c495-82dd-4967-9079-4a0a157f920a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e445c495-82dd-4967-9079-4a0a157f920a" (UID: "e445c495-82dd-4967-9079-4a0a157f920a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 09:14:21.885722 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:14:21.885698 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e445c495-82dd-4967-9079-4a0a157f920a-kube-api-access-8tplf" (OuterVolumeSpecName: "kube-api-access-8tplf") pod "e445c495-82dd-4967-9079-4a0a157f920a" (UID: "e445c495-82dd-4967-9079-4a0a157f920a"). InnerVolumeSpecName "kube-api-access-8tplf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 09:14:21.984927 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:14:21.984871 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tplf\" (UniqueName: \"kubernetes.io/projected/e445c495-82dd-4967-9079-4a0a157f920a-kube-api-access-8tplf\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:14:21.984927 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:14:21.984895 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e445c495-82dd-4967-9079-4a0a157f920a-extensions-socket-volume\") on node \"ip-10-0-140-31.ec2.internal\" DevicePath \"\"" Jul 16 09:14:22.207375 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:14:22.207348 2559 generic.go:356] "Generic (PLEG): container finished" podID="e445c495-82dd-4967-9079-4a0a157f920a" containerID="bf5f9935c385779311f825d5317d567514f43afec145b87acbe922b7971d90f8" exitCode=0 Jul 16 09:14:22.207526 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:14:22.207405 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4" Jul 16 09:14:22.207526 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:14:22.207443 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4" event={"ID":"e445c495-82dd-4967-9079-4a0a157f920a","Type":"ContainerDied","Data":"bf5f9935c385779311f825d5317d567514f43afec145b87acbe922b7971d90f8"} Jul 16 09:14:22.207606 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:14:22.207545 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4" event={"ID":"e445c495-82dd-4967-9079-4a0a157f920a","Type":"ContainerDied","Data":"581c6b582c4feb3474b1e71bf6d18fd7f09eeea4648b8272d1b013cc01fa7577"} Jul 16 09:14:22.207606 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:14:22.207574 2559 scope.go:117] "RemoveContainer" containerID="bf5f9935c385779311f825d5317d567514f43afec145b87acbe922b7971d90f8" Jul 16 09:14:22.217997 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:14:22.217980 2559 scope.go:117] "RemoveContainer" containerID="bf5f9935c385779311f825d5317d567514f43afec145b87acbe922b7971d90f8" Jul 16 09:14:22.218223 ip-10-0-140-31 kubenswrapper[2559]: E0716 09:14:22.218207 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf5f9935c385779311f825d5317d567514f43afec145b87acbe922b7971d90f8\": container with ID starting with bf5f9935c385779311f825d5317d567514f43afec145b87acbe922b7971d90f8 not found: ID does not exist" containerID="bf5f9935c385779311f825d5317d567514f43afec145b87acbe922b7971d90f8" Jul 16 09:14:22.218279 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:14:22.218230 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf5f9935c385779311f825d5317d567514f43afec145b87acbe922b7971d90f8"} err="failed to get container status \"bf5f9935c385779311f825d5317d567514f43afec145b87acbe922b7971d90f8\": rpc error: code = NotFound desc = could not find container \"bf5f9935c385779311f825d5317d567514f43afec145b87acbe922b7971d90f8\": container with ID starting with bf5f9935c385779311f825d5317d567514f43afec145b87acbe922b7971d90f8 not found: ID does not exist" Jul 16 09:14:22.231394 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:14:22.231376 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4"] Jul 16 09:14:22.235844 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:14:22.235797 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9ztm4"] Jul 16 09:14:22.243403 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:14:22.243384 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e445c495-82dd-4967-9079-4a0a157f920a" path="/var/lib/kubelet/pods/e445c495-82dd-4967-9079-4a0a157f920a/volumes" Jul 16 09:14:32.254272 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:14:32.254229 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/2.log" Jul 16 09:14:32.256512 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:14:32.256488 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/2.log" Jul 16 09:14:32.261774 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:14:32.261752 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sb2b7_4aa01755-587c-4e81-bf62-974df0ddbf82/ovn-acl-logging/0.log" Jul 16 09:14:32.263648 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:14:32.263633 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sb2b7_4aa01755-587c-4e81-bf62-974df0ddbf82/ovn-acl-logging/0.log" Jul 16 09:15:00.147604 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:00.147568 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736555-z7wx5"] Jul 16 09:15:00.148055 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:00.147965 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e445c495-82dd-4967-9079-4a0a157f920a" containerName="manager" Jul 16 09:15:00.148055 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:00.147977 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e445c495-82dd-4967-9079-4a0a157f920a" containerName="manager" Jul 16 09:15:00.148127 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:00.148059 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e445c495-82dd-4967-9079-4a0a157f920a" containerName="manager" Jul 16 09:15:00.151077 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:00.151061 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736555-z7wx5" Jul 16 09:15:00.153586 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:00.153566 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lc9lc\"" Jul 16 09:15:00.158245 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:00.158222 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736555-z7wx5"] Jul 16 09:15:00.162341 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:00.162322 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736555-z7wx5" Jul 16 09:15:00.297506 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:00.297459 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736555-z7wx5"] Jul 16 09:15:00.299437 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:15:00.299412 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fddf71d_768b_49e4_88f4_3c97f6560c74.slice/crio-654917a0c7bdfd6d6ad562cab0f92b813255ac55c78455e67cf7c13b522e0569 WatchSource:0}: Error finding container 654917a0c7bdfd6d6ad562cab0f92b813255ac55c78455e67cf7c13b522e0569: Status 404 returned error can't find the container with id 654917a0c7bdfd6d6ad562cab0f92b813255ac55c78455e67cf7c13b522e0569 Jul 16 09:15:00.301736 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:00.301721 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 09:15:00.398701 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:00.398635 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736555-z7wx5" event={"ID":"6fddf71d-768b-49e4-88f4-3c97f6560c74","Type":"ContainerStarted","Data":"654917a0c7bdfd6d6ad562cab0f92b813255ac55c78455e67cf7c13b522e0569"} Jul 16 09:15:03.418706 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:03.418670 2559 generic.go:356] "Generic (PLEG): container finished" podID="6fddf71d-768b-49e4-88f4-3c97f6560c74" containerID="c8c6f4b76ea5cbe82e2d7fe2b464b0c6c81f59cf208238ed1447835970b1ad91" exitCode=0 Jul 16 09:15:03.419031 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:03.418750 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736555-z7wx5" event={"ID":"6fddf71d-768b-49e4-88f4-3c97f6560c74","Type":"ContainerDied","Data":"c8c6f4b76ea5cbe82e2d7fe2b464b0c6c81f59cf208238ed1447835970b1ad91"} Jul 16 09:15:04.554631 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:04.554605 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736555-z7wx5" Jul 16 09:15:05.430605 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:05.430577 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736555-z7wx5" Jul 16 09:15:05.430605 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:05.430596 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736555-z7wx5" event={"ID":"6fddf71d-768b-49e4-88f4-3c97f6560c74","Type":"ContainerDied","Data":"654917a0c7bdfd6d6ad562cab0f92b813255ac55c78455e67cf7c13b522e0569"} Jul 16 09:15:05.430829 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:05.430634 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="654917a0c7bdfd6d6ad562cab0f92b813255ac55c78455e67cf7c13b522e0569" Jul 16 09:15:19.989781 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:19.989748 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5bk5q"] Jul 16 09:15:19.990184 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:19.990125 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fddf71d-768b-49e4-88f4-3c97f6560c74" containerName="cleanup" Jul 16 09:15:19.990184 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:19.990142 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fddf71d-768b-49e4-88f4-3c97f6560c74" containerName="cleanup" Jul 16 09:15:19.990272 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:19.990225 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fddf71d-768b-49e4-88f4-3c97f6560c74" containerName="cleanup" Jul 16 09:15:19.995984 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:19.995967 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5bk5q" Jul 16 09:15:19.998895 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:19.998872 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 16 09:15:19.999015 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:19.998987 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 16 09:15:19.999015 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:19.998993 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wxqz8\"" Jul 16 09:15:20.004987 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:20.004964 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5bk5q"] Jul 16 09:15:20.027151 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:20.027125 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da88efb9-bf8a-4904-94f1-dfdfe886ba7e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5bk5q\" (UID: \"da88efb9-bf8a-4904-94f1-dfdfe886ba7e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5bk5q" Jul 16 09:15:20.027253 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:20.027212 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmplv\" (UniqueName: \"kubernetes.io/projected/da88efb9-bf8a-4904-94f1-dfdfe886ba7e-kube-api-access-jmplv\") pod \"kuadrant-operator-controller-manager-86878c769f-5bk5q\" (UID: \"da88efb9-bf8a-4904-94f1-dfdfe886ba7e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5bk5q" Jul 16 09:15:20.127683 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:20.127657 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmplv\" (UniqueName: \"kubernetes.io/projected/da88efb9-bf8a-4904-94f1-dfdfe886ba7e-kube-api-access-jmplv\") pod \"kuadrant-operator-controller-manager-86878c769f-5bk5q\" (UID: \"da88efb9-bf8a-4904-94f1-dfdfe886ba7e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5bk5q" Jul 16 09:15:20.127780 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:20.127734 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da88efb9-bf8a-4904-94f1-dfdfe886ba7e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5bk5q\" (UID: \"da88efb9-bf8a-4904-94f1-dfdfe886ba7e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5bk5q" Jul 16 09:15:20.128017 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:20.128002 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da88efb9-bf8a-4904-94f1-dfdfe886ba7e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5bk5q\" (UID: \"da88efb9-bf8a-4904-94f1-dfdfe886ba7e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5bk5q" Jul 16 09:15:20.137042 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:20.136990 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmplv\" (UniqueName: \"kubernetes.io/projected/da88efb9-bf8a-4904-94f1-dfdfe886ba7e-kube-api-access-jmplv\") pod \"kuadrant-operator-controller-manager-86878c769f-5bk5q\" (UID: \"da88efb9-bf8a-4904-94f1-dfdfe886ba7e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5bk5q" Jul 16 09:15:20.306735 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:20.306655 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5bk5q" Jul 16 09:15:20.447187 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:20.447162 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5bk5q"] Jul 16 09:15:20.448968 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:15:20.448932 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda88efb9_bf8a_4904_94f1_dfdfe886ba7e.slice/crio-637068c1bb2161982da64bef446a545b9fbe4356769c976a2d61303908ceae60 WatchSource:0}: Error finding container 637068c1bb2161982da64bef446a545b9fbe4356769c976a2d61303908ceae60: Status 404 returned error can't find the container with id 637068c1bb2161982da64bef446a545b9fbe4356769c976a2d61303908ceae60 Jul 16 09:15:20.506369 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:20.506338 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5bk5q" event={"ID":"da88efb9-bf8a-4904-94f1-dfdfe886ba7e","Type":"ContainerStarted","Data":"637068c1bb2161982da64bef446a545b9fbe4356769c976a2d61303908ceae60"} Jul 16 09:15:21.514843 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:21.514805 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5bk5q" event={"ID":"da88efb9-bf8a-4904-94f1-dfdfe886ba7e","Type":"ContainerStarted","Data":"9685653903a4802ed8e2af135c9ae13bcf8596c91ce01e84685cb3db559fe68a"} Jul 16 09:15:21.515259 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:21.514944 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5bk5q" Jul 16 09:15:21.538749 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:21.538703 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5bk5q" podStartSLOduration=2.53868917 podStartE2EDuration="2.53868917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:15:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:15:21.53606973 +0000 UTC m=+1249.825520001" watchObservedRunningTime="2026-07-16 09:15:21.53868917 +0000 UTC m=+1249.828139489" Jul 16 09:15:32.522147 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:15:32.522118 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5bk5q" Jul 16 09:19:32.292261 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:19:32.292234 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/2.log" Jul 16 09:19:32.296765 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:19:32.296746 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/2.log" Jul 16 09:19:32.299441 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:19:32.299423 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sb2b7_4aa01755-587c-4e81-bf62-974df0ddbf82/ovn-acl-logging/0.log" Jul 16 09:19:32.303617 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:19:32.303603 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sb2b7_4aa01755-587c-4e81-bf62-974df0ddbf82/ovn-acl-logging/0.log" Jul 16 09:24:32.326989 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:24:32.326894 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/2.log" Jul 16 09:24:32.334694 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:24:32.333941 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sb2b7_4aa01755-587c-4e81-bf62-974df0ddbf82/ovn-acl-logging/0.log" Jul 16 09:24:32.334694 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:24:32.334596 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/2.log" Jul 16 09:24:32.340716 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:24:32.340699 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sb2b7_4aa01755-587c-4e81-bf62-974df0ddbf82/ovn-acl-logging/0.log" Jul 16 09:29:32.361456 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:29:32.361359 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/2.log" Jul 16 09:29:32.369838 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:29:32.369817 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sb2b7_4aa01755-587c-4e81-bf62-974df0ddbf82/ovn-acl-logging/0.log" Jul 16 09:29:32.373369 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:29:32.373351 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/2.log" Jul 16 09:29:32.380045 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:29:32.380027 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sb2b7_4aa01755-587c-4e81-bf62-974df0ddbf82/ovn-acl-logging/0.log" Jul 16 09:30:00.133841 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:00.133811 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736570-6p6lg"] Jul 16 09:30:00.137121 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:00.137100 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-800be8-29736570-ks78m"] Jul 16 09:30:00.137250 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:00.137227 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736570-6p6lg" Jul 16 09:30:00.139783 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:00.139761 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lc9lc\"" Jul 16 09:30:00.140061 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:00.140045 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-923c3a-29736570-jkgrv"] Jul 16 09:30:00.140150 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:00.140138 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-800be8-29736570-ks78m" Jul 16 09:30:00.143222 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:00.143175 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-923c3a-29736570-jkgrv" Jul 16 09:30:00.146220 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:00.146194 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736570-6p6lg"] Jul 16 09:30:00.149326 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:00.149304 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-800be8-29736570-ks78m"] Jul 16 09:30:00.150649 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:00.150632 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736570-6p6lg" Jul 16 09:30:00.151744 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:00.151723 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-923c3a-29736570-jkgrv"] Jul 16 09:30:00.160977 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:00.160958 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-800be8-29736570-ks78m" Jul 16 09:30:00.197721 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:00.197697 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-923c3a-29736570-jkgrv" Jul 16 09:30:00.316211 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:00.316182 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736570-6p6lg"] Jul 16 09:30:00.318828 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:30:00.318642 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a85da3_ee83_4760_ae29_c5d013b764d3.slice/crio-813f8e376a2d70a69f4879c711162fbd611cd9ecfc797dc47105371efe8c6963 WatchSource:0}: Error finding container 813f8e376a2d70a69f4879c711162fbd611cd9ecfc797dc47105371efe8c6963: Status 404 returned error can't find the container with id 813f8e376a2d70a69f4879c711162fbd611cd9ecfc797dc47105371efe8c6963 Jul 16 09:30:00.371332 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:00.371308 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-923c3a-29736570-jkgrv"] Jul 16 09:30:00.372408 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:30:00.372378 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b3dbb91_a2fa_4f4b_ae89_9e12ac615a01.slice/crio-694b6e504edce42990da57f874220a58dfcd8a242b15d79dad49aee406223f32 WatchSource:0}: Error finding container 694b6e504edce42990da57f874220a58dfcd8a242b15d79dad49aee406223f32: Status 404 returned error can't find the container with id 694b6e504edce42990da57f874220a58dfcd8a242b15d79dad49aee406223f32 Jul 16 09:30:00.556572 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:00.556540 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-800be8-29736570-ks78m"] Jul 16 09:30:00.567540 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:30:00.567513 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8aea679_3aef_476e_aed0_a1b07941e058.slice/crio-547c489feaba5f2ea96c2b979adba86878fb83911d1e394bb6fb92b37f456b42 WatchSource:0}: Error finding container 547c489feaba5f2ea96c2b979adba86878fb83911d1e394bb6fb92b37f456b42: Status 404 returned error can't find the container with id 547c489feaba5f2ea96c2b979adba86878fb83911d1e394bb6fb92b37f456b42 Jul 16 09:30:01.188618 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:01.188573 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-923c3a-29736570-jkgrv" event={"ID":"8b3dbb91-a2fa-4f4b-ae89-9e12ac615a01","Type":"ContainerStarted","Data":"f41f03598016ed8ebb9a7423d61140a7b76cc0f2c0070cb28a8c3ec51d9a6c11"} Jul 16 09:30:01.189050 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:01.188672 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-923c3a-29736570-jkgrv" event={"ID":"8b3dbb91-a2fa-4f4b-ae89-9e12ac615a01","Type":"ContainerStarted","Data":"694b6e504edce42990da57f874220a58dfcd8a242b15d79dad49aee406223f32"} Jul 16 09:30:01.190146 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:01.190114 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-800be8-29736570-ks78m" event={"ID":"c8aea679-3aef-476e-aed0-a1b07941e058","Type":"ContainerStarted","Data":"e086376ed928b28171987cbd61ba2e131d78c9c01d8354528a1150517ab44d8d"} Jul 16 09:30:01.190281 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:01.190163 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-800be8-29736570-ks78m" event={"ID":"c8aea679-3aef-476e-aed0-a1b07941e058","Type":"ContainerStarted","Data":"547c489feaba5f2ea96c2b979adba86878fb83911d1e394bb6fb92b37f456b42"} Jul 16 09:30:01.191533 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:01.191503 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736570-6p6lg" event={"ID":"44a85da3-ee83-4760-ae29-c5d013b764d3","Type":"ContainerStarted","Data":"48fb06cd027878f182af188be8cf7f32ba561ab23d6e5a7381f9e9a6b4b4e8f6"} Jul 16 09:30:01.191640 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:01.191556 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736570-6p6lg" event={"ID":"44a85da3-ee83-4760-ae29-c5d013b764d3","Type":"ContainerStarted","Data":"813f8e376a2d70a69f4879c711162fbd611cd9ecfc797dc47105371efe8c6963"} Jul 16 09:30:01.207109 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:01.207068 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-923c3a-29736570-jkgrv" podStartSLOduration=1.2070547440000001 podStartE2EDuration="1.207054744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:30:01.205395828 +0000 UTC m=+2129.494846088" watchObservedRunningTime="2026-07-16 09:30:01.207054744 +0000 UTC m=+2129.496505002" Jul 16 09:30:01.223607 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:01.223556 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-800be8-29736570-ks78m" podStartSLOduration=1.223542935 podStartE2EDuration="1.223542935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:30:01.223065672 +0000 UTC m=+2129.512515932" watchObservedRunningTime="2026-07-16 09:30:01.223542935 +0000 UTC m=+2129.512993194" Jul 16 09:30:01.240478 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:01.240439 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736570-6p6lg" podStartSLOduration=1.240428206 podStartE2EDuration="1.240428206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 09:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:30:01.239715541 +0000 UTC m=+2129.529165799" watchObservedRunningTime="2026-07-16 09:30:01.240428206 +0000 UTC m=+2129.529878466" Jul 16 09:30:02.198696 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:02.198664 2559 generic.go:356] "Generic (PLEG): container finished" podID="8b3dbb91-a2fa-4f4b-ae89-9e12ac615a01" containerID="f41f03598016ed8ebb9a7423d61140a7b76cc0f2c0070cb28a8c3ec51d9a6c11" exitCode=0 Jul 16 09:30:02.199117 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:02.198757 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-923c3a-29736570-jkgrv" event={"ID":"8b3dbb91-a2fa-4f4b-ae89-9e12ac615a01","Type":"ContainerDied","Data":"f41f03598016ed8ebb9a7423d61140a7b76cc0f2c0070cb28a8c3ec51d9a6c11"} Jul 16 09:30:02.200153 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:02.200130 2559 generic.go:356] "Generic (PLEG): container finished" podID="c8aea679-3aef-476e-aed0-a1b07941e058" containerID="e086376ed928b28171987cbd61ba2e131d78c9c01d8354528a1150517ab44d8d" exitCode=0 Jul 16 09:30:02.200278 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:02.200157 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-800be8-29736570-ks78m" event={"ID":"c8aea679-3aef-476e-aed0-a1b07941e058","Type":"ContainerDied","Data":"e086376ed928b28171987cbd61ba2e131d78c9c01d8354528a1150517ab44d8d"} Jul 16 09:30:02.201582 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:02.201563 2559 generic.go:356] "Generic (PLEG): container finished" podID="44a85da3-ee83-4760-ae29-c5d013b764d3" containerID="48fb06cd027878f182af188be8cf7f32ba561ab23d6e5a7381f9e9a6b4b4e8f6" exitCode=0 Jul 16 09:30:02.201673 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:02.201607 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736570-6p6lg" event={"ID":"44a85da3-ee83-4760-ae29-c5d013b764d3","Type":"ContainerDied","Data":"48fb06cd027878f182af188be8cf7f32ba561ab23d6e5a7381f9e9a6b4b4e8f6"} Jul 16 09:30:03.374502 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:03.372637 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-800be8-29736570-ks78m" Jul 16 09:30:03.413072 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:03.413051 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736570-6p6lg" Jul 16 09:30:03.416059 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:03.416040 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-923c3a-29736570-jkgrv" Jul 16 09:30:04.213739 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:04.213714 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-923c3a-29736570-jkgrv" Jul 16 09:30:04.213739 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:04.213715 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-923c3a-29736570-jkgrv" event={"ID":"8b3dbb91-a2fa-4f4b-ae89-9e12ac615a01","Type":"ContainerDied","Data":"694b6e504edce42990da57f874220a58dfcd8a242b15d79dad49aee406223f32"} Jul 16 09:30:04.213963 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:04.213771 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="694b6e504edce42990da57f874220a58dfcd8a242b15d79dad49aee406223f32" Jul 16 09:30:04.215007 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:04.214979 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-800be8-29736570-ks78m" Jul 16 09:30:04.215007 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:04.214993 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-800be8-29736570-ks78m" event={"ID":"c8aea679-3aef-476e-aed0-a1b07941e058","Type":"ContainerDied","Data":"547c489feaba5f2ea96c2b979adba86878fb83911d1e394bb6fb92b37f456b42"} Jul 16 09:30:04.215184 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:04.215033 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="547c489feaba5f2ea96c2b979adba86878fb83911d1e394bb6fb92b37f456b42" Jul 16 09:30:04.216424 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:04.216405 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736570-6p6lg" event={"ID":"44a85da3-ee83-4760-ae29-c5d013b764d3","Type":"ContainerDied","Data":"813f8e376a2d70a69f4879c711162fbd611cd9ecfc797dc47105371efe8c6963"} Jul 16 09:30:04.216557 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:04.216447 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="813f8e376a2d70a69f4879c711162fbd611cd9ecfc797dc47105371efe8c6963" Jul 16 09:30:04.216557 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:30:04.216412 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736570-6p6lg" Jul 16 09:34:32.405493 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:34:32.405362 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/2.log" Jul 16 09:34:32.412284 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:34:32.412263 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sb2b7_4aa01755-587c-4e81-bf62-974df0ddbf82/ovn-acl-logging/0.log" Jul 16 09:34:32.418959 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:34:32.418942 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/2.log" Jul 16 09:34:32.425744 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:34:32.425727 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sb2b7_4aa01755-587c-4e81-bf62-974df0ddbf82/ovn-acl-logging/0.log" Jul 16 09:35:55.204843 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:35:55.204811 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-923c3a-29736570-jkgrv"] Jul 16 09:35:55.208734 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:35:55.208707 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-923c3a-29736570-jkgrv"] Jul 16 09:35:56.244728 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:35:56.244692 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b3dbb91-a2fa-4f4b-ae89-9e12ac615a01" path="/var/lib/kubelet/pods/8b3dbb91-a2fa-4f4b-ae89-9e12ac615a01/volumes" Jul 16 09:36:08.061046 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:08.061011 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-800be8-29736570-ks78m"] Jul 16 09:36:08.064268 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:08.064245 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-800be8-29736570-ks78m"] Jul 16 09:36:08.243147 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:08.243114 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8aea679-3aef-476e-aed0-a1b07941e058" path="/var/lib/kubelet/pods/c8aea679-3aef-476e-aed0-a1b07941e058/volumes" Jul 16 09:36:21.543412 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:21.543378 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b875787f8-4z46d_fc57154d-bca1-4450-9356-b6a92b08c1cf/copy-manifests/0.log" Jul 16 09:36:21.551846 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:21.551821 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b875787f8-4z46d_fc57154d-bca1-4450-9356-b6a92b08c1cf/manager/0.log" Jul 16 09:36:22.316355 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:22.316315 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29736555-z7wx5_6fddf71d-768b-49e4-88f4-3c97f6560c74/cleanup/0.log" Jul 16 09:36:22.435651 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:22.435626 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29736570-6p6lg_44a85da3-ee83-4760-ae29-c5d013b764d3/cleanup/0.log" Jul 16 09:36:23.409141 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:23.409110 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5_05d1a509-1367-44e1-9956-69efcae95b41/util/0.log" Jul 16 09:36:23.416085 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:23.416066 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5_05d1a509-1367-44e1-9956-69efcae95b41/pull/0.log" Jul 16 09:36:23.422409 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:23.422382 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5_05d1a509-1367-44e1-9956-69efcae95b41/extract/0.log" Jul 16 09:36:23.549046 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:23.548965 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m_e31e0c53-f84a-408e-8a34-138d80b5d092/util/0.log" Jul 16 09:36:23.556181 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:23.556157 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m_e31e0c53-f84a-408e-8a34-138d80b5d092/pull/0.log" Jul 16 09:36:23.562899 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:23.562877 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m_e31e0c53-f84a-408e-8a34-138d80b5d092/extract/0.log" Jul 16 09:36:23.694412 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:23.694341 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm_d814caad-ef8c-4067-b9bf-2c88fa06b907/util/0.log" Jul 16 09:36:23.713649 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:23.713628 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm_d814caad-ef8c-4067-b9bf-2c88fa06b907/pull/0.log" Jul 16 09:36:23.720617 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:23.720597 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm_d814caad-ef8c-4067-b9bf-2c88fa06b907/extract/0.log" Jul 16 09:36:23.844986 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:23.844967 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr_df665c82-df9b-4b44-af9b-1fdc432a0516/util/0.log" Jul 16 09:36:23.851535 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:23.851517 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr_df665c82-df9b-4b44-af9b-1fdc432a0516/pull/0.log" Jul 16 09:36:23.857914 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:23.857892 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr_df665c82-df9b-4b44-af9b-1fdc432a0516/extract/0.log" Jul 16 09:36:24.652991 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:24.652967 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5bk5q_da88efb9-bf8a-4904-94f1-dfdfe886ba7e/manager/0.log" Jul 16 09:36:25.453748 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:25.453719 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tldtf_c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7/discovery/0.log" Jul 16 09:36:25.976577 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:25.976549 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-hsnxz_1aeaec3b-3487-4069-9960-7e2ecc064c8c/payload-pre-processing/0.log" Jul 16 09:36:26.861102 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:26.861076 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-wkxzv_80c992fa-5bda-4b03-b29a-e0113cad39e7/main/0.log" Jul 16 09:36:26.982600 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:26.982577 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjbmxp_5552ea00-7d9a-42e2-8279-33f7a9a5273a/main/0.log" Jul 16 09:36:32.455662 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:32.455632 2559 scope.go:117] "RemoveContainer" containerID="f41f03598016ed8ebb9a7423d61140a7b76cc0f2c0070cb28a8c3ec51d9a6c11" Jul 16 09:36:32.464239 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:32.464221 2559 scope.go:117] "RemoveContainer" containerID="e086376ed928b28171987cbd61ba2e131d78c9c01d8354528a1150517ab44d8d" Jul 16 09:36:35.945612 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:35.945584 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-m448k_d5a0fba0-4c13-4592-a836-4f1f9d20c663/global-pull-secret-syncer/0.log" Jul 16 09:36:36.072018 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:36.071987 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ktm4b_81d0c1f9-5da8-4b91-9e3d-ebeaf9df84f7/konnectivity-agent/0.log" Jul 16 09:36:36.169546 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:36.169525 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-31.ec2.internal_fb396c0835f4deca175bfbe7b025b3ae/haproxy/0.log" Jul 16 09:36:40.708540 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:40.708507 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5_05d1a509-1367-44e1-9956-69efcae95b41/extract/0.log" Jul 16 09:36:40.737715 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:40.737692 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5_05d1a509-1367-44e1-9956-69efcae95b41/util/0.log" Jul 16 09:36:40.771668 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:40.771646 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jfpk5_05d1a509-1367-44e1-9956-69efcae95b41/pull/0.log" Jul 16 09:36:40.801628 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:40.801608 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m_e31e0c53-f84a-408e-8a34-138d80b5d092/extract/0.log" Jul 16 09:36:40.822551 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:40.822535 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m_e31e0c53-f84a-408e-8a34-138d80b5d092/util/0.log" Jul 16 09:36:40.844732 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:40.844711 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzj2m_e31e0c53-f84a-408e-8a34-138d80b5d092/pull/0.log" Jul 16 09:36:40.880284 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:40.880264 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm_d814caad-ef8c-4067-b9bf-2c88fa06b907/extract/0.log" Jul 16 09:36:40.902169 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:40.902154 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm_d814caad-ef8c-4067-b9bf-2c88fa06b907/util/0.log" Jul 16 09:36:40.923046 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:40.923027 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73454zm_d814caad-ef8c-4067-b9bf-2c88fa06b907/pull/0.log" Jul 16 09:36:40.973440 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:40.973384 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr_df665c82-df9b-4b44-af9b-1fdc432a0516/extract/0.log" Jul 16 09:36:40.994953 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:40.994934 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr_df665c82-df9b-4b44-af9b-1fdc432a0516/util/0.log" Jul 16 09:36:41.015889 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:41.015875 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbxbr_df665c82-df9b-4b44-af9b-1fdc432a0516/pull/0.log" Jul 16 09:36:41.814571 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:41.814545 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5bk5q_da88efb9-bf8a-4904-94f1-dfdfe886ba7e/manager/0.log" Jul 16 09:36:43.529295 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:43.529270 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4e4e67d4-db8e-48fa-aff1-85e116528a10/alertmanager/0.log" Jul 16 09:36:43.550613 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:43.550589 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4e4e67d4-db8e-48fa-aff1-85e116528a10/config-reloader/0.log" Jul 16 09:36:43.572149 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:43.572125 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4e4e67d4-db8e-48fa-aff1-85e116528a10/kube-rbac-proxy-web/0.log" Jul 16 09:36:43.593824 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:43.593806 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4e4e67d4-db8e-48fa-aff1-85e116528a10/kube-rbac-proxy/0.log" Jul 16 09:36:43.614727 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:43.614710 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4e4e67d4-db8e-48fa-aff1-85e116528a10/kube-rbac-proxy-metric/0.log" Jul 16 09:36:43.635218 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:43.635200 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4e4e67d4-db8e-48fa-aff1-85e116528a10/prom-label-proxy/0.log" Jul 16 09:36:43.662812 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:43.662794 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4e4e67d4-db8e-48fa-aff1-85e116528a10/init-config-reloader/0.log" Jul 16 09:36:43.801527 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:43.801448 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-747f8ddb64-llbx5_9f41c9cd-045e-4233-856d-c3729e134b44/metrics-server/0.log" Jul 16 09:36:43.825517 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:43.825463 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-6rmzv_82c18da3-8ff5-44fe-8381-59cd2ca4c037/monitoring-plugin/0.log" Jul 16 09:36:43.857943 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:43.857921 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cpgmc_4c4ed468-0928-4f6b-80c7-e26186154ccc/node-exporter/0.log" Jul 16 09:36:43.879366 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:43.879347 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cpgmc_4c4ed468-0928-4f6b-80c7-e26186154ccc/kube-rbac-proxy/0.log" Jul 16 09:36:43.899507 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:43.899491 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cpgmc_4c4ed468-0928-4f6b-80c7-e26186154ccc/init-textfile/0.log" Jul 16 09:36:44.393731 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:44.393708 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-sqvkg_1618f57a-1ec3-4fbc-b427-43f1481052aa/prometheus-operator-admission-webhook/0.log" Jul 16 09:36:44.429288 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:44.429262 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-666c5b7df6-srfvh_134a308a-1be9-4021-ac9a-c0dbf8820518/telemeter-client/0.log" Jul 16 09:36:44.451815 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:44.451793 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-666c5b7df6-srfvh_134a308a-1be9-4021-ac9a-c0dbf8820518/reload/0.log" Jul 16 09:36:44.472712 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:44.472694 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-666c5b7df6-srfvh_134a308a-1be9-4021-ac9a-c0dbf8820518/kube-rbac-proxy/0.log" Jul 16 09:36:44.504685 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:44.504665 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8cdbfd7d-fjz8x_6d265134-857e-427c-9333-50b7bc7c4fbc/thanos-query/0.log" Jul 16 09:36:44.527384 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:44.527363 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8cdbfd7d-fjz8x_6d265134-857e-427c-9333-50b7bc7c4fbc/kube-rbac-proxy-web/0.log" Jul 16 09:36:44.548038 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:44.548023 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8cdbfd7d-fjz8x_6d265134-857e-427c-9333-50b7bc7c4fbc/kube-rbac-proxy/0.log" Jul 16 09:36:44.572640 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:44.572611 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8cdbfd7d-fjz8x_6d265134-857e-427c-9333-50b7bc7c4fbc/prom-label-proxy/0.log" Jul 16 09:36:44.594013 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:44.593994 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8cdbfd7d-fjz8x_6d265134-857e-427c-9333-50b7bc7c4fbc/kube-rbac-proxy-rules/0.log" Jul 16 09:36:44.614607 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:44.614586 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-c8cdbfd7d-fjz8x_6d265134-857e-427c-9333-50b7bc7c4fbc/kube-rbac-proxy-metrics/0.log" Jul 16 09:36:45.508423 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.508394 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94"] Jul 16 09:36:45.508925 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.508895 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b3dbb91-a2fa-4f4b-ae89-9e12ac615a01" containerName="cleanup" Jul 16 09:36:45.508925 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.508921 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b3dbb91-a2fa-4f4b-ae89-9e12ac615a01" containerName="cleanup" Jul 16 09:36:45.509100 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.508942 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44a85da3-ee83-4760-ae29-c5d013b764d3" containerName="cleanup" Jul 16 09:36:45.509100 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.508948 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="44a85da3-ee83-4760-ae29-c5d013b764d3" containerName="cleanup" Jul 16 09:36:45.509100 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.508958 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8aea679-3aef-476e-aed0-a1b07941e058" containerName="cleanup" Jul 16 09:36:45.509100 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.508962 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8aea679-3aef-476e-aed0-a1b07941e058" containerName="cleanup" Jul 16 09:36:45.509100 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.509040 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8aea679-3aef-476e-aed0-a1b07941e058" containerName="cleanup" Jul 16 09:36:45.509100 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.509050 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="44a85da3-ee83-4760-ae29-c5d013b764d3" containerName="cleanup" Jul 16 09:36:45.509100 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.509056 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b3dbb91-a2fa-4f4b-ae89-9e12ac615a01" containerName="cleanup" Jul 16 09:36:45.512248 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.512231 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94" Jul 16 09:36:45.514680 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.514659 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8xjqh\"/\"kube-root-ca.crt\"" Jul 16 09:36:45.514857 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.514835 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8xjqh\"/\"openshift-service-ca.crt\"" Jul 16 09:36:45.514915 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.514896 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8xjqh\"/\"default-dockercfg-lv2zr\"" Jul 16 09:36:45.519581 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.519462 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94"] Jul 16 09:36:45.580501 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.580458 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a59e5b5-c68e-48e6-8688-73ad60628851-proc\") pod \"perf-node-gather-daemonset-vrb94\" (UID: \"3a59e5b5-c68e-48e6-8688-73ad60628851\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94" Jul 16 09:36:45.580842 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.580537 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a59e5b5-c68e-48e6-8688-73ad60628851-sys\") pod \"perf-node-gather-daemonset-vrb94\" (UID: \"3a59e5b5-c68e-48e6-8688-73ad60628851\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94" Jul 16 09:36:45.580842 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.580577 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7wv9\" (UniqueName: \"kubernetes.io/projected/3a59e5b5-c68e-48e6-8688-73ad60628851-kube-api-access-r7wv9\") pod \"perf-node-gather-daemonset-vrb94\" (UID: \"3a59e5b5-c68e-48e6-8688-73ad60628851\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94" Jul 16 09:36:45.580842 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.580595 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a59e5b5-c68e-48e6-8688-73ad60628851-podres\") pod \"perf-node-gather-daemonset-vrb94\" (UID: \"3a59e5b5-c68e-48e6-8688-73ad60628851\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94" Jul 16 09:36:45.580842 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.580624 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a59e5b5-c68e-48e6-8688-73ad60628851-lib-modules\") pod \"perf-node-gather-daemonset-vrb94\" (UID: \"3a59e5b5-c68e-48e6-8688-73ad60628851\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94" Jul 16 09:36:45.681287 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.681265 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a59e5b5-c68e-48e6-8688-73ad60628851-sys\") pod \"perf-node-gather-daemonset-vrb94\" (UID: \"3a59e5b5-c68e-48e6-8688-73ad60628851\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94" Jul 16 09:36:45.681404 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.681295 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7wv9\" (UniqueName: \"kubernetes.io/projected/3a59e5b5-c68e-48e6-8688-73ad60628851-kube-api-access-r7wv9\") pod \"perf-node-gather-daemonset-vrb94\" (UID: \"3a59e5b5-c68e-48e6-8688-73ad60628851\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94" Jul 16 09:36:45.681404 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.681313 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a59e5b5-c68e-48e6-8688-73ad60628851-podres\") pod \"perf-node-gather-daemonset-vrb94\" (UID: \"3a59e5b5-c68e-48e6-8688-73ad60628851\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94" Jul 16 09:36:45.681404 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.681332 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a59e5b5-c68e-48e6-8688-73ad60628851-lib-modules\") pod \"perf-node-gather-daemonset-vrb94\" (UID: \"3a59e5b5-c68e-48e6-8688-73ad60628851\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94" Jul 16 09:36:45.681404 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.681371 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a59e5b5-c68e-48e6-8688-73ad60628851-proc\") pod \"perf-node-gather-daemonset-vrb94\" (UID: \"3a59e5b5-c68e-48e6-8688-73ad60628851\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94" Jul 16 09:36:45.681404 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.681386 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a59e5b5-c68e-48e6-8688-73ad60628851-sys\") pod \"perf-node-gather-daemonset-vrb94\" (UID: \"3a59e5b5-c68e-48e6-8688-73ad60628851\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94" Jul 16 09:36:45.681624 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.681451 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a59e5b5-c68e-48e6-8688-73ad60628851-podres\") pod \"perf-node-gather-daemonset-vrb94\" (UID: \"3a59e5b5-c68e-48e6-8688-73ad60628851\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94" Jul 16 09:36:45.681624 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.681462 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a59e5b5-c68e-48e6-8688-73ad60628851-proc\") pod \"perf-node-gather-daemonset-vrb94\" (UID: \"3a59e5b5-c68e-48e6-8688-73ad60628851\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94" Jul 16 09:36:45.681624 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.681499 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a59e5b5-c68e-48e6-8688-73ad60628851-lib-modules\") pod \"perf-node-gather-daemonset-vrb94\" (UID: \"3a59e5b5-c68e-48e6-8688-73ad60628851\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94" Jul 16 09:36:45.690117 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.690097 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7wv9\" (UniqueName: \"kubernetes.io/projected/3a59e5b5-c68e-48e6-8688-73ad60628851-kube-api-access-r7wv9\") pod \"perf-node-gather-daemonset-vrb94\" (UID: \"3a59e5b5-c68e-48e6-8688-73ad60628851\") " pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94" Jul 16 09:36:45.823334 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.823284 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94" Jul 16 09:36:45.960683 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:45.960660 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94"] Jul 16 09:36:45.962399 ip-10-0-140-31 kubenswrapper[2559]: W0716 09:36:45.962374 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3a59e5b5_c68e_48e6_8688_73ad60628851.slice/crio-d24ea8aa0bdad79825b839d76f2f063b5aa3c1f298436dd6114d4171b1e77fec WatchSource:0}: Error finding container d24ea8aa0bdad79825b839d76f2f063b5aa3c1f298436dd6114d4171b1e77fec: Status 404 returned error can't find the container with id d24ea8aa0bdad79825b839d76f2f063b5aa3c1f298436dd6114d4171b1e77fec Jul 16 09:36:46.378353 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:46.378322 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/2.log" Jul 16 09:36:46.381746 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:46.381731 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-sxhqk_dc91df41-e89e-4bbc-9a7c-9ffff3904a71/console-operator/3.log" Jul 16 09:36:46.390876 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:46.390849 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94" event={"ID":"3a59e5b5-c68e-48e6-8688-73ad60628851","Type":"ContainerStarted","Data":"4b98ea944ae32a557c65a1cc078860b8baf36e1584882fc8eea98c8f74b6eb6b"} Jul 16 09:36:46.391020 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:46.391004 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94" Jul 16 09:36:46.391080 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:46.391040 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94" event={"ID":"3a59e5b5-c68e-48e6-8688-73ad60628851","Type":"ContainerStarted","Data":"d24ea8aa0bdad79825b839d76f2f063b5aa3c1f298436dd6114d4171b1e77fec"} Jul 16 09:36:46.409011 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:46.408967 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94" podStartSLOduration=1.408954596 podStartE2EDuration="1.408954596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 09:36:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 09:36:46.408144542 +0000 UTC m=+2534.697594801" watchObservedRunningTime="2026-07-16 09:36:46.408954596 +0000 UTC m=+2534.698404856" Jul 16 09:36:48.502009 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:48.501984 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-75c9m_f2176e0d-3fed-4101-9978-2794784b401f/dns/0.log" Jul 16 09:36:48.523485 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:48.523456 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-75c9m_f2176e0d-3fed-4101-9978-2794784b401f/kube-rbac-proxy/0.log" Jul 16 09:36:48.656614 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:48.656590 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-46vpz_b2eb4d12-f3cb-47eb-8b13-12c907658c4e/dns-node-resolver/0.log" Jul 16 09:36:49.355252 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:49.355225 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bmrd2_ca239b38-b1b7-410e-9ef2-2de2ea8c432f/node-ca/0.log" Jul 16 09:36:50.422088 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:50.422058 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tldtf_c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7/discovery/0.log" Jul 16 09:36:50.592460 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:50.592430 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-hsnxz_1aeaec3b-3487-4069-9960-7e2ecc064c8c/payload-pre-processing/0.log" Jul 16 09:36:51.368368 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:51.368339 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jz65z_b87a93e0-5fb5-4172-81ec-762bc4c51643/serve-healthcheck-canary/0.log" Jul 16 09:36:52.029848 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:52.029818 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wxss2_0335dcfb-5b7b-4a9e-a618-346f4b7a662f/kube-rbac-proxy/0.log" Jul 16 09:36:52.055163 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:52.055139 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wxss2_0335dcfb-5b7b-4a9e-a618-346f4b7a662f/exporter/0.log" Jul 16 09:36:52.080195 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:52.080178 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wxss2_0335dcfb-5b7b-4a9e-a618-346f4b7a662f/extractor/0.log" Jul 16 09:36:52.406660 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:52.406597 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8xjqh/perf-node-gather-daemonset-vrb94" Jul 16 09:36:54.709493 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:54.709446 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b875787f8-4z46d_fc57154d-bca1-4450-9356-b6a92b08c1cf/manager/0.log" Jul 16 09:36:54.734710 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:54.734687 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b875787f8-4z46d_fc57154d-bca1-4450-9356-b6a92b08c1cf/copy-manifests/0.log" Jul 16 09:36:55.699778 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:55.699750 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tldtf_c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7/discovery/0.log" Jul 16 09:36:55.843102 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:55.843083 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-hsnxz_1aeaec3b-3487-4069-9960-7e2ecc064c8c/payload-pre-processing/0.log" Jul 16 09:36:56.437668 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:56.437606 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-74556d96d9-wrrj9_2e52bae5-2a43-4a3f-9fa9-7684317bf59d/manager/0.log" Jul 16 09:36:56.496644 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:56.496616 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-gksm5_038d7e6b-3a69-42fc-95c6-4da78a5b00e6/openshift-lws-operator/0.log" Jul 16 09:36:57.347398 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:57.347374 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tldtf_c6f2195f-39a1-4e4e-8bb8-ba0b71115fe7/discovery/0.log" Jul 16 09:36:57.483504 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:36:57.483462 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-hsnxz_1aeaec3b-3487-4069-9960-7e2ecc064c8c/payload-pre-processing/0.log" Jul 16 09:37:01.550187 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:37:01.550146 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-qz9qt_0123f994-7643-473c-a1e4-dfcfd3296b15/migrator/0.log" Jul 16 09:37:01.572278 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:37:01.572256 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-qz9qt_0123f994-7643-473c-a1e4-dfcfd3296b15/graceful-termination/0.log" Jul 16 09:37:03.389003 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:37:03.388972 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x7tqv_b88636c3-8f04-4ea8-9753-bc53ee9e8aca/kube-multus-additional-cni-plugins/0.log" Jul 16 09:37:03.410199 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:37:03.410177 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x7tqv_b88636c3-8f04-4ea8-9753-bc53ee9e8aca/egress-router-binary-copy/0.log" Jul 16 09:37:03.432055 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:37:03.432037 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x7tqv_b88636c3-8f04-4ea8-9753-bc53ee9e8aca/cni-plugins/0.log" Jul 16 09:37:03.456084 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:37:03.456066 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x7tqv_b88636c3-8f04-4ea8-9753-bc53ee9e8aca/bond-cni-plugin/0.log" Jul 16 09:37:03.480974 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:37:03.480953 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x7tqv_b88636c3-8f04-4ea8-9753-bc53ee9e8aca/routeoverride-cni/0.log" Jul 16 09:37:03.502968 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:37:03.502952 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x7tqv_b88636c3-8f04-4ea8-9753-bc53ee9e8aca/whereabouts-cni-bincopy/0.log" Jul 16 09:37:03.524656 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:37:03.524636 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x7tqv_b88636c3-8f04-4ea8-9753-bc53ee9e8aca/whereabouts-cni/0.log" Jul 16 09:37:03.602169 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:37:03.602144 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-x8qvw_0cbf6d91-52de-4250-9f07-dd1223a2e533/kube-multus/0.log" Jul 16 09:37:03.705398 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:37:03.705315 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-czllj_7589804c-eb08-481e-a23c-431f53d6e559/network-metrics-daemon/0.log" Jul 16 09:37:03.739855 ip-10-0-140-31 kubenswrapper[2559]: I0716 09:37:03.739820 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-czllj_7589804c-eb08-481e-a23c-431f53d6e559/kube-rbac-proxy/0.log"