Jul 07 18:20:29.107932 ip-10-0-141-187 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 18:20:29.107945 ip-10-0-141-187 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 18:20:29.107954 ip-10-0-141-187 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 18:20:29.108340 ip-10-0-141-187 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 18:20:39.232666 ip-10-0-141-187 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 18:20:39.232688 ip-10-0-141-187 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e2b2a3f617ed4cb2af149f5fb99f729b -- Jul 07 18:22:38.473719 ip-10-0-141-187 systemd[1]: Starting Kubernetes Kubelet... Jul 07 18:22:39.949354 ip-10-0-141-187 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 18:22:39.949354 ip-10-0-141-187 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 18:22:39.949354 ip-10-0-141-187 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 18:22:39.949354 ip-10-0-141-187 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 18:22:39.949354 ip-10-0-141-187 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 18:22:39.950533 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.950391 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 18:22:39.954275 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954258 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 18:22:39.954275 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954275 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 18:22:39.954341 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954280 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 18:22:39.954341 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954284 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 18:22:39.954341 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954287 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 18:22:39.954341 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954291 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 18:22:39.954341 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954294 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 18:22:39.954341 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954297 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 18:22:39.954341 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954300 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 18:22:39.954341 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954303 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 18:22:39.954341 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954306 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 18:22:39.954341 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954314 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 18:22:39.954341 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954317 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 18:22:39.954341 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954320 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 18:22:39.954341 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954323 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 18:22:39.954341 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954326 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 18:22:39.954341 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954328 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 18:22:39.954341 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954331 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 18:22:39.954341 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954334 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 18:22:39.954341 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954337 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 18:22:39.954341 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954339 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 18:22:39.954827 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954342 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 18:22:39.954827 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954345 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 18:22:39.954827 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954349 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 18:22:39.954827 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954352 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 18:22:39.954827 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954355 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 18:22:39.954827 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954358 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 18:22:39.954827 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954361 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 18:22:39.954827 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954363 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 18:22:39.954827 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954366 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 18:22:39.954827 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954369 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 18:22:39.954827 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954372 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 18:22:39.954827 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954375 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 18:22:39.954827 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954377 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 18:22:39.954827 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954380 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 18:22:39.954827 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954383 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 18:22:39.954827 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954386 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 18:22:39.954827 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954391 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 18:22:39.954827 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954396 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 18:22:39.954827 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954399 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 18:22:39.954827 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954402 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 18:22:39.955330 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954405 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 18:22:39.955330 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954408 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 18:22:39.955330 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954411 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 18:22:39.955330 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954414 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 18:22:39.955330 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954417 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 18:22:39.955330 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954420 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 18:22:39.955330 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954423 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 18:22:39.955330 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954426 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 18:22:39.955330 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954429 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 18:22:39.955330 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954432 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 18:22:39.955330 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954435 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 18:22:39.955330 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954438 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 18:22:39.955330 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954441 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 18:22:39.955330 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954444 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 18:22:39.955330 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954447 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 18:22:39.955330 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954451 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 18:22:39.955330 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954454 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 18:22:39.955330 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954457 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 18:22:39.955330 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954460 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 18:22:39.955330 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954464 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 18:22:39.955871 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954468 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 18:22:39.955871 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954471 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 18:22:39.955871 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954474 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 18:22:39.955871 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954477 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 07 18:22:39.955871 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954479 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 18:22:39.955871 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954482 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 18:22:39.955871 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954485 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 18:22:39.955871 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954487 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 18:22:39.955871 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954490 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 18:22:39.955871 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954493 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 18:22:39.955871 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954496 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 18:22:39.955871 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954499 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 18:22:39.955871 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954502 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 18:22:39.955871 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954505 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 18:22:39.955871 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954508 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 18:22:39.955871 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954510 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 18:22:39.955871 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954513 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 18:22:39.955871 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954516 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 18:22:39.955871 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954519 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 18:22:39.955871 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954521 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 18:22:39.956368 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954524 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 18:22:39.956368 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954527 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 18:22:39.956368 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954548 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 18:22:39.956368 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954552 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 18:22:39.956368 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954557 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 18:22:39.956368 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954561 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 18:22:39.956368 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954564 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 18:22:39.956368 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954567 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 18:22:39.956368 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954570 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 18:22:39.956368 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954573 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 18:22:39.956368 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954576 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 18:22:39.956368 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954579 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 18:22:39.956368 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954582 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 18:22:39.956368 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954584 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 18:22:39.956368 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954587 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 18:22:39.956368 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954590 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 18:22:39.956368 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954593 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 18:22:39.956368 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.954597 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 18:22:39.956368 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955362 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 18:22:39.956855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955370 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 18:22:39.956855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955375 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 18:22:39.956855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955378 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 18:22:39.956855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955381 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 18:22:39.956855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955385 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 18:22:39.956855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955389 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 18:22:39.956855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955393 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 18:22:39.956855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955397 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 18:22:39.956855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955401 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 18:22:39.956855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955404 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 18:22:39.956855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955408 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 18:22:39.956855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955412 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 18:22:39.956855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955415 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 18:22:39.956855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955420 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 18:22:39.956855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955423 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 18:22:39.956855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955426 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 18:22:39.956855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955429 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 18:22:39.956855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955432 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 18:22:39.956855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955436 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 18:22:39.957340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955439 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 18:22:39.957340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955442 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 18:22:39.957340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955445 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 18:22:39.957340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955448 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 18:22:39.957340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955451 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 18:22:39.957340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955453 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 18:22:39.957340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955456 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 18:22:39.957340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955459 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 18:22:39.957340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955462 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 18:22:39.957340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955465 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 18:22:39.957340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955467 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 18:22:39.957340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955470 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 18:22:39.957340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955473 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 18:22:39.957340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955475 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 18:22:39.957340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955478 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 18:22:39.957340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955481 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 18:22:39.957340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955483 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 18:22:39.957340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955486 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 18:22:39.957340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955495 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 18:22:39.957844 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955498 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 18:22:39.957844 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955501 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 18:22:39.957844 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955503 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 18:22:39.957844 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955506 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 18:22:39.957844 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955509 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 18:22:39.957844 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955512 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 18:22:39.957844 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955515 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 18:22:39.957844 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955518 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 18:22:39.957844 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955520 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 18:22:39.957844 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955523 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 18:22:39.957844 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955526 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 18:22:39.957844 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955543 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 18:22:39.957844 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955546 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 18:22:39.957844 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955549 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 18:22:39.957844 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955552 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 18:22:39.957844 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955555 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 18:22:39.957844 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955558 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 18:22:39.957844 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955561 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 18:22:39.957844 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955564 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 18:22:39.957844 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955567 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 18:22:39.958377 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955570 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 18:22:39.958377 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955573 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 18:22:39.958377 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955575 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 18:22:39.958377 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955578 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 18:22:39.958377 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955581 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 18:22:39.958377 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955584 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 18:22:39.958377 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955586 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 18:22:39.958377 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955589 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 18:22:39.958377 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955592 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 18:22:39.958377 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955596 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 18:22:39.958377 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955599 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 18:22:39.958377 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955602 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 18:22:39.958377 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955611 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 18:22:39.958377 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955614 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 18:22:39.958377 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955617 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 18:22:39.958377 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955620 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 18:22:39.958377 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955623 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 18:22:39.958377 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955625 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 18:22:39.958377 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955628 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 18:22:39.958377 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955631 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 18:22:39.958900 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955634 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 18:22:39.958900 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955637 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 18:22:39.958900 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955640 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 18:22:39.958900 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955642 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 07 18:22:39.958900 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955645 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 18:22:39.958900 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955648 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 18:22:39.958900 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955651 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 18:22:39.958900 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955654 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 18:22:39.958900 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955657 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 18:22:39.958900 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955660 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 18:22:39.958900 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955662 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 18:22:39.958900 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955665 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 18:22:39.958900 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955669 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 18:22:39.958900 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955672 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 18:22:39.958900 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955674 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 18:22:39.958900 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955677 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 18:22:39.958900 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955680 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 18:22:39.958900 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955685 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 18:22:39.958900 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955688 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 18:22:39.958900 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.955692 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 18:22:39.959402 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956113 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 18:22:39.959402 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956118 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 18:22:39.959402 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956121 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 18:22:39.959402 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956124 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 18:22:39.959402 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956127 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 18:22:39.959402 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956131 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 18:22:39.959402 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956133 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 18:22:39.959402 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956136 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 18:22:39.959402 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956139 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 18:22:39.959402 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956142 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 18:22:39.959402 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956145 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 18:22:39.959402 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956150 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 18:22:39.959402 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956154 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 18:22:39.959402 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956157 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 18:22:39.959402 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956161 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 18:22:39.959402 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956168 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 18:22:39.959402 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956171 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 18:22:39.959402 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956175 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 18:22:39.959402 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956178 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 18:22:39.959938 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956181 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 18:22:39.959938 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956184 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 18:22:39.959938 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956187 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 18:22:39.959938 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956190 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 18:22:39.959938 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956193 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 18:22:39.959938 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956196 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 18:22:39.959938 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956199 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 18:22:39.959938 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956202 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 18:22:39.959938 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956205 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 18:22:39.959938 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956208 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 18:22:39.959938 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956210 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 18:22:39.959938 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956213 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 18:22:39.959938 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956216 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 18:22:39.959938 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956218 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 18:22:39.959938 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956221 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 18:22:39.959938 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956224 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 18:22:39.959938 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956227 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 18:22:39.959938 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956231 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 18:22:39.959938 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956236 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 18:22:39.959938 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956240 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 18:22:39.960447 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956243 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 18:22:39.960447 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956246 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 18:22:39.960447 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956249 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 18:22:39.960447 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956251 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 18:22:39.960447 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956255 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 18:22:39.960447 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956257 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 18:22:39.960447 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956260 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 18:22:39.960447 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956263 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 18:22:39.960447 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956268 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 18:22:39.960447 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956270 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 07 18:22:39.960447 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956273 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 18:22:39.960447 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956276 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 18:22:39.960447 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956279 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 18:22:39.960447 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956282 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 18:22:39.960447 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956284 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 18:22:39.960447 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956289 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 18:22:39.960447 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956291 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 18:22:39.960447 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956294 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 18:22:39.960447 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956298 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 18:22:39.960447 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956302 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 18:22:39.960968 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956305 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 18:22:39.960968 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956308 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 18:22:39.960968 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956311 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 18:22:39.960968 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956314 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 18:22:39.960968 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956317 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 18:22:39.960968 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956320 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 18:22:39.960968 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956323 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 18:22:39.960968 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956326 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 18:22:39.960968 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956329 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 18:22:39.960968 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956332 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 18:22:39.960968 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956335 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 18:22:39.960968 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956338 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 18:22:39.960968 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956341 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 18:22:39.960968 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956344 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 18:22:39.960968 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956346 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 18:22:39.960968 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956349 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 18:22:39.960968 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956352 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 18:22:39.960968 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956355 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 18:22:39.960968 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956357 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 18:22:39.960968 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956360 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 18:22:39.961638 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956364 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 18:22:39.961638 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956367 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 18:22:39.961638 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956370 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 18:22:39.961638 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956373 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 18:22:39.961638 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956376 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 18:22:39.961638 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956379 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 18:22:39.961638 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956382 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 18:22:39.961638 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956385 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 18:22:39.961638 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956387 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 18:22:39.961638 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956390 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 18:22:39.961638 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956393 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 18:22:39.961638 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956396 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 18:22:39.961638 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956401 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 18:22:39.961638 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956403 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 18:22:39.961638 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956406 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 18:22:39.961638 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956409 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 18:22:39.961638 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956412 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 18:22:39.961638 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956415 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 18:22:39.961638 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956418 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.956421 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956496 2580 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956502 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956509 2580 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956514 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956519 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956522 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956527 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956548 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956554 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956558 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956561 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956565 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956569 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956572 2580 flags.go:64] FLAG: --cgroup-root="" Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956575 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956578 2580 flags.go:64] FLAG: --client-ca-file="" Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956581 2580 flags.go:64] FLAG: --cloud-provider="external" Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956585 2580 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956589 2580 flags.go:64] FLAG: --cluster-domain="" Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956592 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956596 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956599 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 18:22:39.962136 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956602 2580 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956606 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956611 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956614 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956618 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956621 2580 flags.go:64] FLAG: --contention-profiling="false" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956624 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956628 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956631 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956634 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956639 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956642 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956645 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956648 2580 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956651 2580 flags.go:64] FLAG: --enable-server="true" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956655 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956660 2580 flags.go:64] FLAG: --event-burst="100" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956663 2580 flags.go:64] FLAG: --event-qps="50" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956666 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956670 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956673 2580 flags.go:64] FLAG: --eviction-hard="" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956677 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956680 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956683 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956687 2580 flags.go:64] FLAG: --eviction-soft="" Jul 07 18:22:39.962809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956690 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 18:22:39.963444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956693 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 18:22:39.963444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956696 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 18:22:39.963444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956699 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 18:22:39.963444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956702 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 18:22:39.963444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956706 2580 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 18:22:39.963444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956708 2580 flags.go:64] FLAG: --feature-gates="" Jul 07 18:22:39.963444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956724 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 18:22:39.963444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956727 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 18:22:39.963444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956733 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 18:22:39.963444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956736 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 18:22:39.963444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956739 2580 flags.go:64] FLAG: --healthz-port="10248" Jul 07 18:22:39.963444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956743 2580 flags.go:64] FLAG: --help="false" Jul 07 18:22:39.963444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956745 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-141-187.ec2.internal" Jul 07 18:22:39.963444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956749 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 18:22:39.963444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956752 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 18:22:39.963444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956755 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 18:22:39.963444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956759 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 18:22:39.963444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956762 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 18:22:39.963444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956765 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 18:22:39.963444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956768 2580 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 18:22:39.963444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956771 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 18:22:39.963444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956774 2580 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 18:22:39.963444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956778 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956782 2580 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956784 2580 flags.go:64] FLAG: --kube-reserved="" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956788 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956790 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956794 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956797 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956800 2580 flags.go:64] FLAG: --lock-file="" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956803 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956806 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956810 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956816 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956819 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956822 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956825 2580 flags.go:64] FLAG: --logging-format="text" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956828 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956831 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956834 2580 flags.go:64] FLAG: --manifest-url="" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956838 2580 flags.go:64] FLAG: --manifest-url-header="" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956843 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956846 2580 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956850 2580 flags.go:64] FLAG: --max-pods="110" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956853 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956856 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956860 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 18:22:39.964553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956863 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956867 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956870 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956873 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956880 2580 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956883 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956886 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956890 2580 flags.go:64] FLAG: --pod-cidr="" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956893 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956899 2580 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956902 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956905 2580 flags.go:64] FLAG: --pods-per-core="0" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956908 2580 flags.go:64] FLAG: --port="10250" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956911 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956914 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-041466cf55d7adb95" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956918 2580 flags.go:64] FLAG: --qos-reserved="" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956921 2580 flags.go:64] FLAG: --read-only-port="10255" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956924 2580 flags.go:64] FLAG: --register-node="true" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956927 2580 flags.go:64] FLAG: --register-with-taints="" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956931 2580 flags.go:64] FLAG: --registry-burst="10" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956934 2580 flags.go:64] FLAG: --registry-qps="5" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956937 2580 flags.go:64] FLAG: --reserved-cpus="" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956940 2580 flags.go:64] FLAG: --reserved-memory="" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956943 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956947 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 18:22:39.965685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956950 2580 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956953 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956956 2580 flags.go:64] FLAG: --runonce="false" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956960 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956963 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956966 2580 flags.go:64] FLAG: --seccomp-default="false" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956969 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956972 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956975 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956978 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956981 2580 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956984 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956988 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956991 2580 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956993 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.956997 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.957000 2580 flags.go:64] FLAG: --system-cgroups="" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.957003 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.957008 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.957011 2580 flags.go:64] FLAG: --tls-cert-file="" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.957016 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.957020 2580 flags.go:64] FLAG: --tls-min-version="" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.957023 2580 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.957026 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.957029 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 18:22:39.966844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.957032 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 18:22:39.967845 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.957035 2580 flags.go:64] FLAG: --v="2" Jul 07 18:22:39.967845 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.957039 2580 flags.go:64] FLAG: --version="false" Jul 07 18:22:39.967845 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.957043 2580 flags.go:64] FLAG: --vmodule="" Jul 07 18:22:39.967845 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.957047 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 18:22:39.967845 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.957050 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 18:22:39.967845 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957162 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 18:22:39.967845 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957166 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 18:22:39.967845 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957170 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 18:22:39.967845 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957173 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 18:22:39.967845 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957176 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 18:22:39.967845 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957179 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 18:22:39.967845 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957182 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 18:22:39.967845 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957185 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 18:22:39.967845 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957190 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 18:22:39.967845 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957194 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 18:22:39.967845 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957197 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 18:22:39.967845 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957200 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 18:22:39.967845 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957203 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 18:22:39.967845 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957206 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 18:22:39.967845 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957209 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 18:22:39.967845 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957212 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 18:22:39.968805 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957215 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 18:22:39.968805 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957217 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 18:22:39.968805 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957221 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 18:22:39.968805 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957224 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 18:22:39.968805 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957227 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 18:22:39.968805 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957232 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 18:22:39.968805 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957235 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 18:22:39.968805 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957237 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 18:22:39.968805 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957240 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 18:22:39.968805 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957243 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 18:22:39.968805 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957245 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 18:22:39.968805 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957248 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 18:22:39.968805 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957251 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 18:22:39.968805 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957254 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 18:22:39.968805 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957257 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 18:22:39.968805 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957259 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 18:22:39.968805 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957262 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 18:22:39.968805 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957265 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 18:22:39.968805 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957268 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 18:22:39.968805 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957271 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 18:22:39.969707 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957275 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 18:22:39.969707 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957279 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 18:22:39.969707 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957282 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 18:22:39.969707 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957285 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 18:22:39.969707 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957288 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 18:22:39.969707 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957290 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 18:22:39.969707 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957293 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 18:22:39.969707 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957296 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 18:22:39.969707 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957299 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 18:22:39.969707 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957302 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 18:22:39.969707 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957304 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 18:22:39.969707 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957307 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 18:22:39.969707 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957310 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 18:22:39.969707 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957313 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 18:22:39.969707 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957316 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 18:22:39.969707 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957319 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 18:22:39.969707 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957322 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 18:22:39.969707 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957326 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 18:22:39.969707 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957329 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 07 18:22:39.970266 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957332 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 18:22:39.970266 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957335 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 18:22:39.970266 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957338 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 18:22:39.970266 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957341 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 18:22:39.970266 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957344 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 18:22:39.970266 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957347 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 18:22:39.970266 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957350 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 18:22:39.970266 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957353 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 18:22:39.970266 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957356 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 18:22:39.970266 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957360 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 18:22:39.970266 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957363 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 18:22:39.970266 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957367 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 18:22:39.970266 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957370 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 18:22:39.970266 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957373 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 18:22:39.970266 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957376 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 18:22:39.970266 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957379 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 18:22:39.970266 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957383 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 18:22:39.970266 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957386 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 18:22:39.970266 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957389 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 18:22:39.970859 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957392 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 18:22:39.970859 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957395 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 18:22:39.970859 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957398 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 18:22:39.970859 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957400 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 18:22:39.970859 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957403 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 18:22:39.970859 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957406 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 18:22:39.970859 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957409 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 18:22:39.970859 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957411 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 18:22:39.970859 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957414 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 18:22:39.970859 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957417 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 18:22:39.970859 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957420 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 18:22:39.970859 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957424 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 18:22:39.970859 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957427 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 18:22:39.970859 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957429 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 18:22:39.970859 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957432 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 18:22:39.970859 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957435 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 18:22:39.970859 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957438 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 18:22:39.970859 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957441 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 18:22:39.970859 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957445 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 18:22:39.970859 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957448 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 18:22:39.971389 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957451 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 18:22:39.971389 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957454 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 18:22:39.971389 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957457 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 18:22:39.971389 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957460 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 18:22:39.971389 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.957463 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 18:22:39.971389 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.958020 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 18:22:39.971389 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.965965 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 18:22:39.971389 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.965984 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 18:22:39.971389 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.966010 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 18:22:39.971389 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.966020 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 18:22:39.971389 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966106 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 18:22:39.971389 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966115 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 07 18:22:39.971389 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966121 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 18:22:39.971389 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966126 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 18:22:39.971389 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966130 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 18:22:39.971855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966134 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 18:22:39.971855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966139 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 18:22:39.971855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966143 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 18:22:39.971855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966148 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 18:22:39.971855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966153 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 18:22:39.971855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966157 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 18:22:39.971855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966162 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 18:22:39.971855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966167 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 18:22:39.971855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966172 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 18:22:39.971855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966176 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 18:22:39.971855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966186 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 18:22:39.971855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966190 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 18:22:39.971855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966195 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 18:22:39.971855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966199 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 18:22:39.971855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966204 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 18:22:39.971855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966209 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 18:22:39.971855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966213 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 18:22:39.971855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966218 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 18:22:39.971855 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966222 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 18:22:39.972468 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966227 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 18:22:39.972468 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966231 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 18:22:39.972468 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966236 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 18:22:39.972468 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966240 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 18:22:39.972468 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966245 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 18:22:39.972468 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966251 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 18:22:39.972468 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966256 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 18:22:39.972468 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966260 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 18:22:39.972468 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966265 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 18:22:39.972468 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966270 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 18:22:39.972468 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966274 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 18:22:39.972468 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966279 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 18:22:39.972468 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966283 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 18:22:39.972468 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966287 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 18:22:39.972468 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966292 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 18:22:39.972468 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966297 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 18:22:39.972468 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966301 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 18:22:39.972468 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966309 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 18:22:39.972468 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966315 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 18:22:39.972468 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966320 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 18:22:39.973340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966325 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 18:22:39.973340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966332 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 18:22:39.973340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966337 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 18:22:39.973340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966342 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 18:22:39.973340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966347 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 18:22:39.973340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966351 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 18:22:39.973340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966356 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 18:22:39.973340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966360 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 18:22:39.973340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966365 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 18:22:39.973340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966369 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 18:22:39.973340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966373 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 18:22:39.973340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966378 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 18:22:39.973340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966382 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 18:22:39.973340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966387 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 18:22:39.973340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966391 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 18:22:39.973340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966396 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 18:22:39.973340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966400 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 18:22:39.973340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966407 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 18:22:39.973340 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966412 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 18:22:39.973898 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966416 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 18:22:39.973898 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966423 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 18:22:39.973898 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966429 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 18:22:39.973898 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966434 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 18:22:39.973898 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966441 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 18:22:39.973898 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966447 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 18:22:39.973898 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966453 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 18:22:39.973898 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966457 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 18:22:39.973898 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966462 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 18:22:39.973898 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966467 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 18:22:39.973898 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966471 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 18:22:39.973898 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966476 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 18:22:39.973898 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966481 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 18:22:39.973898 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966485 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 18:22:39.973898 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966489 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 18:22:39.973898 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966494 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 18:22:39.973898 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966499 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 18:22:39.973898 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966503 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 18:22:39.973898 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966508 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 18:22:39.974378 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966512 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 18:22:39.974378 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966517 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 18:22:39.974378 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966521 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 18:22:39.974378 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966526 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 18:22:39.974378 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966550 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 18:22:39.974378 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966555 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 18:22:39.974378 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966560 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 18:22:39.974378 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966564 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 18:22:39.974378 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966569 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 18:22:39.974378 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966573 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 18:22:39.974378 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966577 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 18:22:39.974378 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966583 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 18:22:39.974378 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966587 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 18:22:39.974378 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966592 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 18:22:39.974378 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966597 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 18:22:39.974378 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966602 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 18:22:39.974378 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966607 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 18:22:39.974831 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.966615 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 18:22:39.974831 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966834 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 18:22:39.974831 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966843 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 18:22:39.974831 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966848 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 18:22:39.974831 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966853 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 18:22:39.974831 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966858 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 18:22:39.974831 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966863 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 18:22:39.974831 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966867 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 18:22:39.974831 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966872 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 18:22:39.974831 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966876 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 18:22:39.974831 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966881 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 18:22:39.974831 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966886 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 18:22:39.974831 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966891 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 18:22:39.974831 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966896 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 18:22:39.974831 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966901 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 18:22:39.975226 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966905 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 18:22:39.975226 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966910 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 18:22:39.975226 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966914 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 18:22:39.975226 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966919 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 18:22:39.975226 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966923 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 18:22:39.975226 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966928 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 18:22:39.975226 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966932 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 18:22:39.975226 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966937 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 18:22:39.975226 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966942 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 18:22:39.975226 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966946 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 18:22:39.975226 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966951 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 18:22:39.975226 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966956 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 18:22:39.975226 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966961 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 18:22:39.975226 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966966 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 18:22:39.975226 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966971 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 18:22:39.975226 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966975 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 18:22:39.975226 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966980 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 18:22:39.975226 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966984 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 18:22:39.975226 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966989 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 18:22:39.975226 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966993 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 18:22:39.975781 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.966998 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 18:22:39.975781 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967002 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 18:22:39.975781 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967007 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 18:22:39.975781 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967012 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 18:22:39.975781 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967016 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 18:22:39.975781 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967022 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 18:22:39.975781 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967026 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 18:22:39.975781 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967030 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 18:22:39.975781 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967035 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 18:22:39.975781 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967039 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 18:22:39.975781 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967045 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 18:22:39.975781 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967049 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 18:22:39.975781 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967053 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 18:22:39.975781 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967058 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 07 18:22:39.975781 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967063 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 18:22:39.975781 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967067 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 18:22:39.975781 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967072 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 18:22:39.975781 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967076 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 18:22:39.975781 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967081 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 18:22:39.976263 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967086 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 18:22:39.976263 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967090 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 18:22:39.976263 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967095 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 18:22:39.976263 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967100 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 18:22:39.976263 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967107 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 18:22:39.976263 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967114 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 18:22:39.976263 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967119 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 18:22:39.976263 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967123 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 18:22:39.976263 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967128 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 18:22:39.976263 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967132 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 18:22:39.976263 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967137 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 18:22:39.976263 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967141 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 18:22:39.976263 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967145 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 18:22:39.976263 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967150 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 18:22:39.976263 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967154 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 18:22:39.976263 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967159 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 18:22:39.976263 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967163 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 18:22:39.976263 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967168 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 18:22:39.976263 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967173 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 18:22:39.976263 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967178 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 18:22:39.976790 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967182 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 18:22:39.976790 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967187 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 18:22:39.976790 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967191 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 18:22:39.976790 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967195 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 18:22:39.976790 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967200 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 18:22:39.976790 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967205 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 18:22:39.976790 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967210 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 18:22:39.976790 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967214 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 18:22:39.976790 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967219 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 18:22:39.976790 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967223 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 18:22:39.976790 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967228 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 18:22:39.976790 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967233 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 18:22:39.976790 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967238 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 18:22:39.976790 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967242 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 18:22:39.976790 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967247 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 18:22:39.976790 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967252 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 18:22:39.976790 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967257 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 18:22:39.976790 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967261 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 18:22:39.976790 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967266 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 18:22:39.977282 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967273 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 18:22:39.977282 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967280 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 18:22:39.977282 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967285 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 18:22:39.977282 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967290 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 18:22:39.977282 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967296 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 18:22:39.977282 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967300 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 18:22:39.977282 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:39.967305 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 18:22:39.977282 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.967314 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 18:22:39.977282 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.967457 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 18:22:39.977282 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.970225 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 18:22:39.977282 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.974522 2580 server.go:1019] "Starting client certificate rotation" Jul 07 18:22:39.977282 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.974656 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 18:22:39.977282 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.974710 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 18:22:39.977681 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.977282 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 18:22:39.980456 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.980435 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 18:22:39.987183 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.987168 2580 log.go:25] "Validated CRI v1 runtime API" Jul 07 18:22:39.990492 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.990478 2580 log.go:25] "Validated CRI v1 image API" Jul 07 18:22:39.993659 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.993638 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 18:22:39.996025 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.996007 2580 fs.go:135] Filesystem UUIDs: map[71c8e5ec-fc29-4938-80b3-55c78e56257d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a16891e2-06af-451c-a32a-9e920ea7cfd4:/dev/nvme0n1p4] Jul 07 18:22:39.996078 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:39.996025 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 18:22:40.003598 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.003473 2580 manager.go:216] Machine: {Timestamp:2026-07-07 18:22:40.002147259 +0000 UTC m=+1.132799282 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101784 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec239b4d806402c5582c25011795ea28 SystemUUID:ec239b4d-8064-02c5-582c-25011795ea28 BootID:e2b2a3f6-17ed-4cb2-af14-9f5fb99f729b Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ad:73:5a:70:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ad:73:5a:70:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:2b:7a:4a:9b:eb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 18:22:40.003598 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.003590 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 18:22:40.003724 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.003672 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 18:22:40.004767 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.004743 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 18:22:40.004931 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.004770 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-187.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 18:22:40.005568 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.005554 2580 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 18:22:40.005633 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.005574 2580 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 18:22:40.005633 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.005594 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 18:22:40.005633 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.005614 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 18:22:40.006958 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.006946 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 18:22:40.009741 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.009723 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 18:22:40.010732 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.010718 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 07 18:22:40.010909 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.010896 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 18:22:40.010969 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.010935 2580 kubelet.go:486] "Attempting to sync node with API server" Jul 07 18:22:40.010969 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.010952 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 18:22:40.011058 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.010973 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 18:22:40.011058 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.010988 2580 kubelet.go:398] "Adding apiserver pod source" Jul 07 18:22:40.011058 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.011001 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 18:22:40.011373 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.011359 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 18:22:40.011471 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.011384 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 18:22:40.015616 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.015594 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 18:22:40.017706 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.017689 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 18:22:40.017811 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.017730 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 18:22:40.018847 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.018832 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 18:22:40.018928 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.018853 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 18:22:40.018928 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.018863 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 18:22:40.018928 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.018872 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 18:22:40.018928 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.018886 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 18:22:40.018928 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.018895 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 18:22:40.018928 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.018908 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 18:22:40.018928 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.018917 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 18:22:40.018928 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.018927 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 18:22:40.019179 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.018936 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 18:22:40.019179 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.018949 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 18:22:40.019179 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.018959 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 18:22:40.019667 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.019646 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 18:22:40.019667 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.019670 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 18:22:40.022699 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.022666 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-187.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 18:22:40.022787 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.022743 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 18:22:40.023167 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.023153 2580 server.go:1268] "Started kubelet" Jul 07 18:22:40.023246 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.023220 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 18:22:40.024112 ip-10-0-141-187 systemd[1]: Started Kubernetes Kubelet. Jul 07 18:22:40.024648 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.024065 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 18:22:40.024648 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.024162 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 18:22:40.025233 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.025209 2580 server.go:310] "Adding debug handlers to kubelet server" Jul 07 18:22:40.025371 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.025355 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 18:22:40.029459 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.029427 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 18:22:40.030659 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.030643 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 18:22:40.030741 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.030647 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 18:22:40.030793 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.030774 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found" Jul 07 18:22:40.031375 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.031357 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 18:22:40.031375 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.031354 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 18:22:40.031511 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.031379 2580 factory.go:55] Registering systemd factory Jul 07 18:22:40.031511 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.031386 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 18:22:40.031511 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.031395 2580 factory.go:223] Registration of the systemd container factory successfully Jul 07 18:22:40.031511 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.031489 2580 reconstruct.go:97] "Volume reconstruction finished" Jul 07 18:22:40.031511 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.031500 2580 reconciler.go:29] "Reconciler: start to sync state" Jul 07 18:22:40.031910 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.031895 2580 factory.go:153] Registering CRI-O factory Jul 07 18:22:40.032008 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.031995 2580 factory.go:223] Registration of the crio container factory successfully Jul 07 18:22:40.032149 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.032136 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 18:22:40.032256 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.032238 2580 factory.go:103] Registering Raw factory Jul 07 18:22:40.032356 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.032267 2580 manager.go:1196] Started watching for new ooms in manager Jul 07 18:22:40.032981 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.032953 2580 manager.go:349] Starting recovery of all containers Jul 07 18:22:40.043096 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.043062 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 18:22:40.043202 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.043150 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-187.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 18:22:40.043334 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.043271 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-187.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 18:22:40.047322 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.047202 2580 manager.go:354] Recovery completed Jul 07 18:22:40.051610 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.042237 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-187.ec2.internal.18c01504275c3f9d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-187.ec2.internal,UID:ip-10-0-141-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-187.ec2.internal,},FirstTimestamp:2026-07-07 18:22:40.023125917 +0000 UTC m=+1.153777934,LastTimestamp:2026-07-07 18:22:40.023125917 +0000 UTC m=+1.153777934,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-187.ec2.internal,}" Jul 07 18:22:40.053399 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.053385 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 18:22:40.055318 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.055287 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientMemory" Jul 07 18:22:40.055395 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.055331 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 18:22:40.055395 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.055342 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientPID" Jul 07 18:22:40.055881 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.055866 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 18:22:40.055881 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.055881 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 18:22:40.055985 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.055898 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 07 18:22:40.056021 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.055870 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 18:22:40.056729 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.056714 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientMemory" Jul 07 18:22:40.056812 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.056739 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 18:22:40.056812 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.056749 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientPID" Jul 07 18:22:40.057108 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.057095 2580 policy_none.go:49] "None policy: Start" Jul 07 18:22:40.057174 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.057121 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 18:22:40.057174 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.057137 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 18:22:40.058184 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.058160 2580 policy_none.go:47] "Start" Jul 07 18:22:40.058281 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.058188 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-187.ec2.internal.18c015042947712d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-187.ec2.internal,UID:ip-10-0-141-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-187.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-187.ec2.internal,},FirstTimestamp:2026-07-07 18:22:40.055316781 +0000 UTC m=+1.185968800,LastTimestamp:2026-07-07 18:22:40.055316781 +0000 UTC m=+1.185968800,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-187.ec2.internal,}" Jul 07 18:22:40.070329 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.070236 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-187.ec2.internal.18c015042947bd1f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-187.ec2.internal,UID:ip-10-0-141-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-187.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-187.ec2.internal,},FirstTimestamp:2026-07-07 18:22:40.055336223 +0000 UTC m=+1.185988240,LastTimestamp:2026-07-07 18:22:40.055336223 +0000 UTC m=+1.185988240,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-187.ec2.internal,}" Jul 07 18:22:40.072401 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.072337 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-187.ec2.internal.18c015042947edc6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-187.ec2.internal,UID:ip-10-0-141-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-187.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-187.ec2.internal,},FirstTimestamp:2026-07-07 18:22:40.055348678 +0000 UTC m=+1.186000698,LastTimestamp:2026-07-07 18:22:40.055348678 +0000 UTC m=+1.186000698,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-187.ec2.internal,}" Jul 07 18:22:40.083142 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.083072 2580 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-187.ec2.internal.18c015042947712d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-187.ec2.internal.18c015042947712d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-187.ec2.internal,UID:ip-10-0-141-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-187.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-187.ec2.internal,},FirstTimestamp:2026-07-07 18:22:40.055316781 +0000 UTC m=+1.185968800,LastTimestamp:2026-07-07 18:22:40.056727689 +0000 UTC m=+1.187379706,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-187.ec2.internal,}" Jul 07 18:22:40.093145 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.093084 2580 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-187.ec2.internal.18c015042947bd1f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-187.ec2.internal.18c015042947bd1f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-187.ec2.internal,UID:ip-10-0-141-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-187.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-187.ec2.internal,},FirstTimestamp:2026-07-07 18:22:40.055336223 +0000 UTC m=+1.185988240,LastTimestamp:2026-07-07 18:22:40.056744524 +0000 UTC m=+1.187396541,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-187.ec2.internal,}" Jul 07 18:22:40.101151 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.101137 2580 manager.go:337] "Starting Device Plugin manager" Jul 07 18:22:40.101226 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.101176 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 18:22:40.101226 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.101195 2580 server.go:87] "Starting device plugin registration server" Jul 07 18:22:40.101547 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.101518 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 18:22:40.101616 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.101549 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 18:22:40.101663 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.101627 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 18:22:40.102265 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.101716 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 18:22:40.102265 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.101727 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 18:22:40.102265 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.101770 2580 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-141-187.ec2.internal.18c015042947edc6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-187.ec2.internal.18c015042947edc6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-187.ec2.internal,UID:ip-10-0-141-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-187.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-187.ec2.internal,},FirstTimestamp:2026-07-07 18:22:40.055348678 +0000 UTC m=+1.186000698,LastTimestamp:2026-07-07 18:22:40.056753642 +0000 UTC m=+1.187405659,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-187.ec2.internal,}" Jul 07 18:22:40.102938 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.102911 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 18:22:40.103007 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.102980 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-187.ec2.internal\" not found" Jul 07 18:22:40.108775 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.108756 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8m746" Jul 07 18:22:40.117358 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.117295 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-187.ec2.internal.18c015042c2a284e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-187.ec2.internal,UID:ip-10-0-141-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-141-187.ec2.internal,},FirstTimestamp:2026-07-07 18:22:40.10372923 +0000 UTC m=+1.234381233,LastTimestamp:2026-07-07 18:22:40.10372923 +0000 UTC m=+1.234381233,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-187.ec2.internal,}" Jul 07 18:22:40.118817 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.118800 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8m746" Jul 07 18:22:40.183439 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.183401 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 18:22:40.184696 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.184680 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 18:22:40.184751 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.184724 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 18:22:40.184751 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.184747 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 18:22:40.184832 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.184803 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 18:22:40.195826 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.195798 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 18:22:40.202445 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.202431 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 18:22:40.203271 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.203252 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientMemory" Jul 07 18:22:40.203351 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.203284 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 18:22:40.203351 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.203296 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientPID" Jul 07 18:22:40.203351 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.203327 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-187.ec2.internal" Jul 07 18:22:40.214361 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.214309 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-187.ec2.internal" Jul 07 18:22:40.214361 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.214336 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-187.ec2.internal\": node \"ip-10-0-141-187.ec2.internal\" not found" Jul 07 18:22:40.246758 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.246733 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found" Jul 07 18:22:40.286113 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.286083 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal"] Jul 07 18:22:40.286197 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.286156 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 18:22:40.287163 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.287149 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientMemory" Jul 07 18:22:40.287218 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.287176 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 18:22:40.287218 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.287186 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientPID" Jul 07 18:22:40.289013 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.289000 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 18:22:40.289132 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.289116 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal" Jul 07 18:22:40.289174 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.289148 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 18:22:40.290491 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.290462 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientMemory" Jul 07 18:22:40.290491 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.290489 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 18:22:40.290628 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.290499 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientPID" Jul 07 18:22:40.290986 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.290967 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientMemory" Jul 07 18:22:40.291071 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.290993 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 18:22:40.291071 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.291003 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientPID" Jul 07 18:22:40.291825 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.291807 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal" Jul 07 18:22:40.291896 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.291843 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 18:22:40.292630 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.292614 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientMemory" Jul 07 18:22:40.292729 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.292643 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 18:22:40.292729 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.292667 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientPID" Jul 07 18:22:40.307203 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.307181 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-187.ec2.internal\" not found" node="ip-10-0-141-187.ec2.internal" Jul 07 18:22:40.311336 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.311317 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-187.ec2.internal\" not found" node="ip-10-0-141-187.ec2.internal" Jul 07 18:22:40.332995 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.332962 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f384e1e579d8d76d06f816cd9f7c1c43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal\" (UID: \"f384e1e579d8d76d06f816cd9f7c1c43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal" Jul 07 18:22:40.332995 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.332997 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b469ca5e754e40f9721a7a95476e077f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-187.ec2.internal\" (UID: \"b469ca5e754e40f9721a7a95476e077f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal" Jul 07 18:22:40.333138 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.333016 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f384e1e579d8d76d06f816cd9f7c1c43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal\" (UID: \"f384e1e579d8d76d06f816cd9f7c1c43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal" Jul 07 18:22:40.347728 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.347708 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found" Jul 07 18:22:40.433239 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.433194 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f384e1e579d8d76d06f816cd9f7c1c43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal\" (UID: \"f384e1e579d8d76d06f816cd9f7c1c43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal" Jul 07 18:22:40.433239 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.433238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f384e1e579d8d76d06f816cd9f7c1c43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal\" (UID: \"f384e1e579d8d76d06f816cd9f7c1c43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal" Jul 07 18:22:40.433426 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.433258 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b469ca5e754e40f9721a7a95476e077f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-187.ec2.internal\" (UID: \"b469ca5e754e40f9721a7a95476e077f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal" Jul 07 18:22:40.433426 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.433284 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f384e1e579d8d76d06f816cd9f7c1c43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal\" (UID: \"f384e1e579d8d76d06f816cd9f7c1c43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal" Jul 07 18:22:40.433426 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.433294 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f384e1e579d8d76d06f816cd9f7c1c43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal\" (UID: \"f384e1e579d8d76d06f816cd9f7c1c43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal" Jul 07 18:22:40.433426 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.433343 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b469ca5e754e40f9721a7a95476e077f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-187.ec2.internal\" (UID: \"b469ca5e754e40f9721a7a95476e077f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal" Jul 07 18:22:40.448892 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.448864 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found" Jul 07 18:22:40.550203 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.550136 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found" Jul 07 18:22:40.616354 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.616328 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal" Jul 07 18:22:40.616354 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.616350 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal" Jul 07 18:22:40.651028 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.651002 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found" Jul 07 18:22:40.751725 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.751680 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found" Jul 07 18:22:40.852971 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.852869 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found" Jul 07 18:22:40.953322 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:40.953289 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found" Jul 07 18:22:40.973884 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.973859 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 18:22:40.974005 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:40.973990 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 18:22:41.053841 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:41.053816 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found" Jul 07 18:22:41.080644 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:41.080621 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 18:22:41.082546 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:41.082528 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientMemory" Jul 07 18:22:41.082616 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:41.082566 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 18:22:41.082616 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:41.082577 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientPID" Jul 07 18:22:41.125734 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:41.125665 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 18:17:40 +0000 UTC" deadline="2028-04-13 15:51:43.470472948 +0000 UTC" Jul 07 18:22:41.125734 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:41.125695 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15501h29m2.344781154s" Jul 07 18:22:41.154761 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:41.154733 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found" Jul 07 18:22:41.255685 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:41.255646 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found" Jul 07 18:22:41.297884 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:41.297848 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 18:22:41.355757 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:41.355725 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found" Jul 07 18:22:41.406163 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:41.406130 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb469ca5e754e40f9721a7a95476e077f.slice/crio-39c53138312fc480310766f7b128e685e03604226d70f7851bf054b5ca2b1d0c WatchSource:0}: Error finding container 39c53138312fc480310766f7b128e685e03604226d70f7851bf054b5ca2b1d0c: Status 404 returned error can't find the container with id 39c53138312fc480310766f7b128e685e03604226d70f7851bf054b5ca2b1d0c Jul 07 18:22:41.406567 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:41.406542 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf384e1e579d8d76d06f816cd9f7c1c43.slice/crio-1e942a08268fb052d4eea79ca91bcab2fcb4dc03d41c9cd639428b3e03eed378 WatchSource:0}: Error finding container 1e942a08268fb052d4eea79ca91bcab2fcb4dc03d41c9cd639428b3e03eed378: Status 404 returned error can't find the container with id 1e942a08268fb052d4eea79ca91bcab2fcb4dc03d41c9cd639428b3e03eed378 Jul 07 18:22:41.412199 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:41.412184 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 18:22:41.456379 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:41.456356 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found" Jul 07 18:22:41.553597 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:41.553575 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 18:22:41.590186 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:41.590162 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 18:22:41.633375 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:41.633349 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal" Jul 07 18:22:41.666558 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:41.666503 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 18:22:41.667499 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:41.667475 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal" Jul 07 18:22:41.680449 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:41.680433 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 18:22:42.013444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.013361 2580 apiserver.go:52] "Watching apiserver" Jul 07 18:22:42.022285 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.022250 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 18:22:42.023727 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.023700 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m","openshift-dns/node-resolver-lzcsf","openshift-image-registry/node-ca-rgkvn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal","openshift-multus/multus-bsrjr","openshift-ovn-kubernetes/ovnkube-node-skkmr","kube-system/konnectivity-agent-rxcml","kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal","openshift-cluster-node-tuning-operator/tuned-s9zt5","openshift-multus/multus-additional-cni-plugins-ftjp9","openshift-multus/network-metrics-daemon-k6w2r","openshift-network-diagnostics/network-check-target-lg59n","openshift-network-operator/iptables-alerter-4xrg4","kube-system/global-pull-secret-syncer-njfbx"] Jul 07 18:22:42.025234 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.025213 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.026477 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.026440 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:22:42.026585 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:42.026552 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lg59n" podUID="f481e445-5a2b-4d41-99c4-5ba2397e062a" Jul 07 18:22:42.027756 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.027733 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rgkvn" Jul 07 18:22:42.028602 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.028402 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 18:22:42.028602 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.028452 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 18:22:42.028602 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.028517 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qc96l\"" Jul 07 18:22:42.028980 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.028959 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.030328 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.030307 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.030554 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.030531 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 18:22:42.030657 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.030623 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 18:22:42.030903 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.030880 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 18:22:42.031050 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.031033 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 18:22:42.031139 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.031074 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vx5b6\"" Jul 07 18:22:42.031427 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.031403 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 18:22:42.031545 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.031403 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 18:22:42.031545 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.031534 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 18:22:42.031956 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.031787 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 18:22:42.032058 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.032041 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.032713 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.032311 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 18:22:42.032713 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.032554 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k4wpl\"" Jul 07 18:22:42.032856 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.032793 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 18:22:42.033149 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.033126 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-79t47\"" Jul 07 18:22:42.034523 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.034502 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" Jul 07 18:22:42.035980 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.035960 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rxcml" Jul 07 18:22:42.036208 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.036184 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 18:22:42.036288 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.036252 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 18:22:42.036751 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.036732 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-chfwp\"" Jul 07 18:22:42.037448 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.037430 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:22:42.037563 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:42.037508 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6w2r" podUID="68167320-ef20-4d1d-9b83-610ac96b5dce" Jul 07 18:22:42.037749 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.037732 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 18:22:42.037827 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.037788 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 18:22:42.037903 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.037825 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 18:22:42.037978 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.037931 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 18:22:42.038042 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.038008 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 18:22:42.039161 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.039144 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lzcsf" Jul 07 18:22:42.040332 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.040313 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 18:22:42.040427 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.040395 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 18:22:42.040507 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.040432 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 18:22:42.040797 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.040637 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9sk2k\"" Jul 07 18:22:42.040797 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.040655 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4xrg4" Jul 07 18:22:42.042071 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.042048 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:22:42.042164 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:42.042141 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njfbx" podUID="f090aaca-9b3a-449a-b2c4-2ccfbf5db417" Jul 07 18:22:42.043874 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.043844 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/51f0ab4e-9faa-4aa6-a6bf-5c7e3f69cd13-serviceca\") pod \"node-ca-rgkvn\" (UID: \"51f0ab4e-9faa-4aa6-a6bf-5c7e3f69cd13\") " pod="openshift-image-registry/node-ca-rgkvn" Jul 07 18:22:42.043963 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.043892 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-multus-cni-dir\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.043963 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.043925 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-hostroot\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.043963 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.043955 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-host-run-multus-certs\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.044123 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.043987 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-host-run-netns\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.044123 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.044060 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-log-socket\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.044123 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.044091 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-host-run-k8s-cni-cncf-io\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.044597 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.044121 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-host-run-ovn-kubernetes\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.044597 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.044484 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b7335728-d739-4c3d-877b-c1d860112c1a-env-overrides\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.044597 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.044540 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b7335728-d739-4c3d-877b-c1d860112c1a-ovn-node-metrics-cert\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.044597 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.044574 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b7335728-d739-4c3d-877b-c1d860112c1a-ovnkube-script-lib\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.044788 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.044603 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51f0ab4e-9faa-4aa6-a6bf-5c7e3f69cd13-host\") pod \"node-ca-rgkvn\" (UID: \"51f0ab4e-9faa-4aa6-a6bf-5c7e3f69cd13\") " pod="openshift-image-registry/node-ca-rgkvn" Jul 07 18:22:42.044788 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.044380 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-glmcp\"" Jul 07 18:22:42.044788 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.044675 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b72940a4-d68a-4aa5-83ee-375e8bae5918-cnibin\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.044788 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.044709 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-host-kubelet\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.044788 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.044757 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-var-lib-openvswitch\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.045000 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.044799 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-host-cni-netd\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.045000 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.044827 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-etc-modprobe-d\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.045000 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.044855 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-etc-sysconfig\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.045000 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.044885 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t5p6\" (UniqueName: \"kubernetes.io/projected/0d38827b-87ba-4545-9829-dcd0ca83adc6-kube-api-access-7t5p6\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.045000 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.044919 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-run-ovn\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.045245 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.045144 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 18:22:42.045245 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.045147 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 18:22:42.045245 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.045223 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 18:22:42.045401 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.045151 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 18:22:42.045401 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.045343 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bhns6\"" Jul 07 18:22:42.045497 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.045415 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-host-cni-bin\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.045497 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.045452 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-var-lib-kubelet\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.045497 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.045488 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-host\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.045682 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.045557 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-multus-socket-dir-parent\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.045682 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.045598 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-etc-kubernetes\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.045682 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.045632 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 18:22:42.045839 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.045635 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-run\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.045839 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.045644 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 18:22:42.045839 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.045730 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-64ktj\"" Jul 07 18:22:42.045839 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.045721 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b72940a4-d68a-4aa5-83ee-375e8bae5918-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.046089 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046069 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-host-var-lib-kubelet\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.046156 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046109 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-run-systemd\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.046156 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046131 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfqxc\" (UniqueName: \"kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc\") pod \"network-check-target-lg59n\" (UID: \"f481e445-5a2b-4d41-99c4-5ba2397e062a\") " pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:22:42.046156 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046153 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-os-release\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.046324 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046173 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/71984996-59a4-46f1-a8f3-a9bab1c925af-multus-daemon-config\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.046324 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046197 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwf8m\" (UniqueName: \"kubernetes.io/projected/71984996-59a4-46f1-a8f3-a9bab1c925af-kube-api-access-zwf8m\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.046324 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046222 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-etc-openvswitch\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.046324 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046239 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-node-log\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.046324 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046253 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-etc-sysctl-d\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.046324 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046288 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-sys\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.046324 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046311 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b72940a4-d68a-4aa5-83ee-375e8bae5918-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.046701 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046330 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94pvc\" (UniqueName: \"kubernetes.io/projected/b72940a4-d68a-4aa5-83ee-375e8bae5918-kube-api-access-94pvc\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.046701 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046352 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-host-var-lib-cni-bin\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.046701 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046374 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b7335728-d739-4c3d-877b-c1d860112c1a-ovnkube-config\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.046701 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046397 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d38827b-87ba-4545-9829-dcd0ca83adc6-tmp\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.046701 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046422 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-host-var-lib-cni-multus\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.046701 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046442 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-etc-systemd\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.046701 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046458 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42d9j\" (UniqueName: \"kubernetes.io/projected/51f0ab4e-9faa-4aa6-a6bf-5c7e3f69cd13-kube-api-access-42d9j\") pod \"node-ca-rgkvn\" (UID: \"51f0ab4e-9faa-4aa6-a6bf-5c7e3f69cd13\") " pod="openshift-image-registry/node-ca-rgkvn" Jul 07 18:22:42.046701 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046498 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b72940a4-d68a-4aa5-83ee-375e8bae5918-system-cni-dir\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.046701 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046523 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.046701 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046548 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bnbj\" (UniqueName: \"kubernetes.io/projected/b7335728-d739-4c3d-877b-c1d860112c1a-kube-api-access-7bnbj\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.046701 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046571 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0d38827b-87ba-4545-9829-dcd0ca83adc6-etc-tuned\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.046701 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046610 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b72940a4-d68a-4aa5-83ee-375e8bae5918-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.046701 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046635 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-host-run-netns\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.046701 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046657 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-cnibin\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.046701 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046675 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-multus-conf-dir\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.046701 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046698 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-lib-modules\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.047601 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046715 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b72940a4-d68a-4aa5-83ee-375e8bae5918-os-release\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.047601 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046731 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b72940a4-d68a-4aa5-83ee-375e8bae5918-cni-binary-copy\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.047601 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046750 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-system-cni-dir\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.047601 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046782 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-systemd-units\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.047601 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046804 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-etc-kubernetes\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.047601 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046820 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71984996-59a4-46f1-a8f3-a9bab1c925af-cni-binary-copy\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.047601 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046850 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-host-slash\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.047601 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046875 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-run-openvswitch\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.047601 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.046894 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-etc-sysctl-conf\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.057001 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.056990 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 18:22:42.084777 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.084757 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-62j6d" Jul 07 18:22:42.095836 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.095816 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-62j6d" Jul 07 18:22:42.132808 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.132784 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 18:22:42.147034 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147006 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d38827b-87ba-4545-9829-dcd0ca83adc6-tmp\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.147178 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147049 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-host-var-lib-cni-multus\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.147178 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147081 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t292m\" (UID: \"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" Jul 07 18:22:42.147178 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147105 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f95b113a-076d-4c7d-ac0b-24de4955b5c2-hosts-file\") pod \"node-resolver-lzcsf\" (UID: \"f95b113a-076d-4c7d-ac0b-24de4955b5c2\") " pod="openshift-dns/node-resolver-lzcsf" Jul 07 18:22:42.147178 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147129 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs\") pod \"network-metrics-daemon-k6w2r\" (UID: \"68167320-ef20-4d1d-9b83-610ac96b5dce\") " pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:22:42.147178 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147139 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-host-var-lib-cni-multus\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.147178 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147156 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-etc-systemd\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.147521 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147204 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42d9j\" (UniqueName: \"kubernetes.io/projected/51f0ab4e-9faa-4aa6-a6bf-5c7e3f69cd13-kube-api-access-42d9j\") pod \"node-ca-rgkvn\" (UID: \"51f0ab4e-9faa-4aa6-a6bf-5c7e3f69cd13\") " pod="openshift-image-registry/node-ca-rgkvn" Jul 07 18:22:42.147521 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147209 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-etc-systemd\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.147521 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147232 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b72940a4-d68a-4aa5-83ee-375e8bae5918-system-cni-dir\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.147521 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147261 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.147521 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147311 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bnbj\" (UniqueName: \"kubernetes.io/projected/b7335728-d739-4c3d-877b-c1d860112c1a-kube-api-access-7bnbj\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.147521 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147305 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b72940a4-d68a-4aa5-83ee-375e8bae5918-system-cni-dir\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.147521 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147334 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0d38827b-87ba-4545-9829-dcd0ca83adc6-etc-tuned\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.147521 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147392 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b72940a4-d68a-4aa5-83ee-375e8bae5918-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.147521 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147424 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp4w7\" (UniqueName: \"kubernetes.io/projected/0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0-kube-api-access-xp4w7\") pod \"aws-ebs-csi-driver-node-t292m\" (UID: \"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" Jul 07 18:22:42.147521 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147412 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 18:22:42.147521 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147435 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.147521 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147457 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-host-run-netns\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.147521 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147500 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0-registration-dir\") pod \"aws-ebs-csi-driver-node-t292m\" (UID: \"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" Jul 07 18:22:42.147521 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147522 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0-device-dir\") pod \"aws-ebs-csi-driver-node-t292m\" (UID: \"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" Jul 07 18:22:42.148160 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147543 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flbhj\" (UniqueName: \"kubernetes.io/projected/f95b113a-076d-4c7d-ac0b-24de4955b5c2-kube-api-access-flbhj\") pod \"node-resolver-lzcsf\" (UID: \"f95b113a-076d-4c7d-ac0b-24de4955b5c2\") " pod="openshift-dns/node-resolver-lzcsf" Jul 07 18:22:42.148160 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147567 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-cnibin\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.148160 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147591 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-multus-conf-dir\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.148160 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147577 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-host-run-netns\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.148160 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147618 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-dbus\") pod \"global-pull-secret-syncer-njfbx\" (UID: \"f090aaca-9b3a-449a-b2c4-2ccfbf5db417\") " pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:22:42.148160 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147643 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/829d17b8-8a45-4d04-af61-95b53794b8a1-agent-certs\") pod \"konnectivity-agent-rxcml\" (UID: \"829d17b8-8a45-4d04-af61-95b53794b8a1\") " pod="kube-system/konnectivity-agent-rxcml" Jul 07 18:22:42.148160 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147669 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-lib-modules\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.148160 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147681 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-cnibin\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.148160 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147697 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b72940a4-d68a-4aa5-83ee-375e8bae5918-os-release\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.148160 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147716 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b72940a4-d68a-4aa5-83ee-375e8bae5918-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.148160 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147725 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b72940a4-d68a-4aa5-83ee-375e8bae5918-cni-binary-copy\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.148160 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147718 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-multus-conf-dir\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.148160 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147761 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-system-cni-dir\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.148160 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147788 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-systemd-units\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.148160 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147817 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lhww\" (UniqueName: \"kubernetes.io/projected/308fd74f-73af-48f2-ac49-d989c1093f21-kube-api-access-2lhww\") pod \"iptables-alerter-4xrg4\" (UID: \"308fd74f-73af-48f2-ac49-d989c1093f21\") " pod="openshift-network-operator/iptables-alerter-4xrg4" Jul 07 18:22:42.148160 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147843 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b72940a4-d68a-4aa5-83ee-375e8bae5918-os-release\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.148160 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147822 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-lib-modules\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.149090 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147866 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-systemd-units\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.149090 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147849 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zznkq\" (UniqueName: \"kubernetes.io/projected/68167320-ef20-4d1d-9b83-610ac96b5dce-kube-api-access-zznkq\") pod \"network-metrics-daemon-k6w2r\" (UID: \"68167320-ef20-4d1d-9b83-610ac96b5dce\") " pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:22:42.149090 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147927 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-etc-kubernetes\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.149090 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147953 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-system-cni-dir\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.149090 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.147961 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71984996-59a4-46f1-a8f3-a9bab1c925af-cni-binary-copy\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.149090 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148022 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-etc-kubernetes\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.149090 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148029 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-host-slash\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.149090 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148092 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-run-openvswitch\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.149090 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148111 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-host-slash\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.149090 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148140 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret\") pod \"global-pull-secret-syncer-njfbx\" (UID: \"f090aaca-9b3a-449a-b2c4-2ccfbf5db417\") " pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:22:42.149090 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148173 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-run-openvswitch\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.149090 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148176 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0-socket-dir\") pod \"aws-ebs-csi-driver-node-t292m\" (UID: \"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" Jul 07 18:22:42.149090 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148235 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0-etc-selinux\") pod \"aws-ebs-csi-driver-node-t292m\" (UID: \"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" Jul 07 18:22:42.149090 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148265 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0-sys-fs\") pod \"aws-ebs-csi-driver-node-t292m\" (UID: \"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" Jul 07 18:22:42.149090 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148310 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b72940a4-d68a-4aa5-83ee-375e8bae5918-cni-binary-copy\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.149090 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148326 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-etc-sysctl-conf\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.149090 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148366 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/51f0ab4e-9faa-4aa6-a6bf-5c7e3f69cd13-serviceca\") pod \"node-ca-rgkvn\" (UID: \"51f0ab4e-9faa-4aa6-a6bf-5c7e3f69cd13\") " pod="openshift-image-registry/node-ca-rgkvn" Jul 07 18:22:42.149961 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148389 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-multus-cni-dir\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.149961 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148409 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-hostroot\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.149961 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148432 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-host-run-multus-certs\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.149961 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148457 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-host-run-netns\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.149961 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148482 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-log-socket\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.149961 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148452 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-etc-sysctl-conf\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.149961 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148498 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71984996-59a4-46f1-a8f3-a9bab1c925af-cni-binary-copy\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.149961 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148508 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-host-run-k8s-cni-cncf-io\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.149961 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148547 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-host-run-ovn-kubernetes\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.149961 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148549 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-host-run-multus-certs\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.149961 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148552 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-multus-cni-dir\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.149961 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148569 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b7335728-d739-4c3d-877b-c1d860112c1a-env-overrides\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.149961 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148580 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-hostroot\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.149961 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148603 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-log-socket\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.149961 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148607 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-host-run-k8s-cni-cncf-io\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.149961 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148633 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-host-run-netns\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.149961 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148639 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b7335728-d739-4c3d-877b-c1d860112c1a-ovn-node-metrics-cert\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.149961 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148652 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-host-run-ovn-kubernetes\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.150853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148675 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b7335728-d739-4c3d-877b-c1d860112c1a-ovnkube-script-lib\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.150853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148706 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-kubelet-config\") pod \"global-pull-secret-syncer-njfbx\" (UID: \"f090aaca-9b3a-449a-b2c4-2ccfbf5db417\") " pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:22:42.150853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148732 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/829d17b8-8a45-4d04-af61-95b53794b8a1-konnectivity-ca\") pod \"konnectivity-agent-rxcml\" (UID: \"829d17b8-8a45-4d04-af61-95b53794b8a1\") " pod="kube-system/konnectivity-agent-rxcml" Jul 07 18:22:42.150853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148760 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51f0ab4e-9faa-4aa6-a6bf-5c7e3f69cd13-host\") pod \"node-ca-rgkvn\" (UID: \"51f0ab4e-9faa-4aa6-a6bf-5c7e3f69cd13\") " pod="openshift-image-registry/node-ca-rgkvn" Jul 07 18:22:42.150853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148784 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b72940a4-d68a-4aa5-83ee-375e8bae5918-cnibin\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.150853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148809 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-host-kubelet\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.150853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148817 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/51f0ab4e-9faa-4aa6-a6bf-5c7e3f69cd13-serviceca\") pod \"node-ca-rgkvn\" (UID: \"51f0ab4e-9faa-4aa6-a6bf-5c7e3f69cd13\") " pod="openshift-image-registry/node-ca-rgkvn" Jul 07 18:22:42.150853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148835 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-var-lib-openvswitch\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.150853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148864 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-host-cni-netd\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.150853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148869 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51f0ab4e-9faa-4aa6-a6bf-5c7e3f69cd13-host\") pod \"node-ca-rgkvn\" (UID: \"51f0ab4e-9faa-4aa6-a6bf-5c7e3f69cd13\") " pod="openshift-image-registry/node-ca-rgkvn" Jul 07 18:22:42.150853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148888 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-etc-modprobe-d\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.150853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148912 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-etc-sysconfig\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.150853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148922 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-host-kubelet\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.150853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148937 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t5p6\" (UniqueName: \"kubernetes.io/projected/0d38827b-87ba-4545-9829-dcd0ca83adc6-kube-api-access-7t5p6\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.150853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148961 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b72940a4-d68a-4aa5-83ee-375e8bae5918-cnibin\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.150853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148964 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-run-ovn\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.150853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.148999 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-host-cni-bin\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.151593 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149000 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-var-lib-openvswitch\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.151593 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149011 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b7335728-d739-4c3d-877b-c1d860112c1a-env-overrides\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.151593 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149063 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-host-cni-bin\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.151593 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149069 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-run-ovn\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.151593 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149071 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-etc-modprobe-d\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.151593 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149117 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-etc-sysconfig\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.151593 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149118 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-host-cni-netd\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.151593 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149151 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/308fd74f-73af-48f2-ac49-d989c1093f21-iptables-alerter-script\") pod \"iptables-alerter-4xrg4\" (UID: \"308fd74f-73af-48f2-ac49-d989c1093f21\") " pod="openshift-network-operator/iptables-alerter-4xrg4" Jul 07 18:22:42.151593 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149181 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-var-lib-kubelet\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.151593 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149224 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-host\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.151593 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149255 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-multus-socket-dir-parent\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.151593 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149262 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-host\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.151593 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149272 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b7335728-d739-4c3d-877b-c1d860112c1a-ovnkube-script-lib\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.151593 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149280 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-etc-kubernetes\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.151593 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149227 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-var-lib-kubelet\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.151593 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149309 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/308fd74f-73af-48f2-ac49-d989c1093f21-host-slash\") pod \"iptables-alerter-4xrg4\" (UID: \"308fd74f-73af-48f2-ac49-d989c1093f21\") " pod="openshift-network-operator/iptables-alerter-4xrg4" Jul 07 18:22:42.151593 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149315 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-multus-socket-dir-parent\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.151593 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149338 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-run\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.152186 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149365 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b72940a4-d68a-4aa5-83ee-375e8bae5918-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.152186 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149382 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-run\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.152186 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149338 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-etc-kubernetes\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.152186 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149392 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-host-var-lib-kubelet\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.152186 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149431 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-run-systemd\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.152186 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149460 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfqxc\" (UniqueName: \"kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc\") pod \"network-check-target-lg59n\" (UID: \"f481e445-5a2b-4d41-99c4-5ba2397e062a\") " pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:22:42.152186 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149484 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-os-release\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.152186 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149509 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/71984996-59a4-46f1-a8f3-a9bab1c925af-multus-daemon-config\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.152186 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149525 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-run-systemd\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.152186 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149549 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwf8m\" (UniqueName: \"kubernetes.io/projected/71984996-59a4-46f1-a8f3-a9bab1c925af-kube-api-access-zwf8m\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.152186 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149572 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-host-var-lib-kubelet\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.152186 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149574 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f95b113a-076d-4c7d-ac0b-24de4955b5c2-tmp-dir\") pod \"node-resolver-lzcsf\" (UID: \"f95b113a-076d-4c7d-ac0b-24de4955b5c2\") " pod="openshift-dns/node-resolver-lzcsf" Jul 07 18:22:42.152186 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149615 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-etc-openvswitch\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.152186 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149643 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-node-log\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.152186 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149669 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-etc-sysctl-d\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.152186 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149695 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-sys\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.152186 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149723 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b72940a4-d68a-4aa5-83ee-375e8bae5918-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.152904 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149750 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94pvc\" (UniqueName: \"kubernetes.io/projected/b72940a4-d68a-4aa5-83ee-375e8bae5918-kube-api-access-94pvc\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.152904 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149775 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-host-var-lib-cni-bin\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.152904 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149791 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-os-release\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.152904 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149800 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b7335728-d739-4c3d-877b-c1d860112c1a-ovnkube-config\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.152904 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149868 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b72940a4-d68a-4aa5-83ee-375e8bae5918-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.152904 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149939 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-sys\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.152904 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.149985 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-node-log\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.152904 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.150077 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0d38827b-87ba-4545-9829-dcd0ca83adc6-etc-sysctl-d\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.152904 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.150125 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71984996-59a4-46f1-a8f3-a9bab1c925af-host-var-lib-cni-bin\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.152904 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.150255 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/71984996-59a4-46f1-a8f3-a9bab1c925af-multus-daemon-config\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.152904 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.150315 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7335728-d739-4c3d-877b-c1d860112c1a-etc-openvswitch\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.152904 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.150317 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b7335728-d739-4c3d-877b-c1d860112c1a-ovnkube-config\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.152904 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.150670 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b72940a4-d68a-4aa5-83ee-375e8bae5918-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.152904 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.151661 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d38827b-87ba-4545-9829-dcd0ca83adc6-tmp\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.152904 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.151729 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0d38827b-87ba-4545-9829-dcd0ca83adc6-etc-tuned\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.152904 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.151789 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b7335728-d739-4c3d-877b-c1d860112c1a-ovn-node-metrics-cert\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.156357 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:42.156334 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 18:22:42.156357 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:42.156360 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 18:22:42.156568 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:42.156371 2580 projected.go:196] Error preparing data for projected volume kube-api-access-sfqxc for pod openshift-network-diagnostics/network-check-target-lg59n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:22:42.156568 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:42.156565 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc podName:f481e445-5a2b-4d41-99c4-5ba2397e062a nodeName:}" failed. No retries permitted until 2026-07-07 18:22:42.656452546 +0000 UTC m=+3.787104562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sfqxc" (UniqueName: "kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc") pod "network-check-target-lg59n" (UID: "f481e445-5a2b-4d41-99c4-5ba2397e062a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:22:42.159344 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.159315 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bnbj\" (UniqueName: \"kubernetes.io/projected/b7335728-d739-4c3d-877b-c1d860112c1a-kube-api-access-7bnbj\") pod \"ovnkube-node-skkmr\" (UID: \"b7335728-d739-4c3d-877b-c1d860112c1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.159659 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.159642 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t5p6\" (UniqueName: \"kubernetes.io/projected/0d38827b-87ba-4545-9829-dcd0ca83adc6-kube-api-access-7t5p6\") pod \"tuned-s9zt5\" (UID: \"0d38827b-87ba-4545-9829-dcd0ca83adc6\") " pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.159728 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.159707 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwf8m\" (UniqueName: \"kubernetes.io/projected/71984996-59a4-46f1-a8f3-a9bab1c925af-kube-api-access-zwf8m\") pod \"multus-bsrjr\" (UID: \"71984996-59a4-46f1-a8f3-a9bab1c925af\") " pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.159875 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.159853 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42d9j\" (UniqueName: \"kubernetes.io/projected/51f0ab4e-9faa-4aa6-a6bf-5c7e3f69cd13-kube-api-access-42d9j\") pod \"node-ca-rgkvn\" (UID: \"51f0ab4e-9faa-4aa6-a6bf-5c7e3f69cd13\") " pod="openshift-image-registry/node-ca-rgkvn" Jul 07 18:22:42.160801 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.160765 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94pvc\" (UniqueName: \"kubernetes.io/projected/b72940a4-d68a-4aa5-83ee-375e8bae5918-kube-api-access-94pvc\") pod \"multus-additional-cni-plugins-ftjp9\" (UID: \"b72940a4-d68a-4aa5-83ee-375e8bae5918\") " pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.191130 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.190992 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal" event={"ID":"f384e1e579d8d76d06f816cd9f7c1c43","Type":"ContainerStarted","Data":"1e942a08268fb052d4eea79ca91bcab2fcb4dc03d41c9cd639428b3e03eed378"} Jul 07 18:22:42.194753 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.194715 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal" event={"ID":"b469ca5e754e40f9721a7a95476e077f","Type":"ContainerStarted","Data":"39c53138312fc480310766f7b128e685e03604226d70f7851bf054b5ca2b1d0c"} Jul 07 18:22:42.246265 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.246240 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 18:22:42.250555 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.250536 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/308fd74f-73af-48f2-ac49-d989c1093f21-iptables-alerter-script\") pod \"iptables-alerter-4xrg4\" (UID: \"308fd74f-73af-48f2-ac49-d989c1093f21\") " pod="openshift-network-operator/iptables-alerter-4xrg4" Jul 07 18:22:42.250624 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.250566 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/308fd74f-73af-48f2-ac49-d989c1093f21-host-slash\") pod \"iptables-alerter-4xrg4\" (UID: \"308fd74f-73af-48f2-ac49-d989c1093f21\") " pod="openshift-network-operator/iptables-alerter-4xrg4" Jul 07 18:22:42.250624 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.250604 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f95b113a-076d-4c7d-ac0b-24de4955b5c2-tmp-dir\") pod \"node-resolver-lzcsf\" (UID: \"f95b113a-076d-4c7d-ac0b-24de4955b5c2\") " pod="openshift-dns/node-resolver-lzcsf" Jul 07 18:22:42.250693 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.250625 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t292m\" (UID: \"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" Jul 07 18:22:42.250693 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.250646 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f95b113a-076d-4c7d-ac0b-24de4955b5c2-hosts-file\") pod \"node-resolver-lzcsf\" (UID: \"f95b113a-076d-4c7d-ac0b-24de4955b5c2\") " pod="openshift-dns/node-resolver-lzcsf" Jul 07 18:22:42.250693 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.250670 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs\") pod \"network-metrics-daemon-k6w2r\" (UID: \"68167320-ef20-4d1d-9b83-610ac96b5dce\") " pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:22:42.250831 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.250698 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp4w7\" (UniqueName: \"kubernetes.io/projected/0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0-kube-api-access-xp4w7\") pod \"aws-ebs-csi-driver-node-t292m\" (UID: \"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" Jul 07 18:22:42.250831 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.250723 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0-registration-dir\") pod \"aws-ebs-csi-driver-node-t292m\" (UID: \"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" Jul 07 18:22:42.250831 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.250723 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/308fd74f-73af-48f2-ac49-d989c1093f21-host-slash\") pod \"iptables-alerter-4xrg4\" (UID: \"308fd74f-73af-48f2-ac49-d989c1093f21\") " pod="openshift-network-operator/iptables-alerter-4xrg4" Jul 07 18:22:42.250831 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.250746 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0-device-dir\") pod \"aws-ebs-csi-driver-node-t292m\" (UID: \"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" Jul 07 18:22:42.250831 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.250746 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t292m\" (UID: \"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" Jul 07 18:22:42.250831 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.250758 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f95b113a-076d-4c7d-ac0b-24de4955b5c2-hosts-file\") pod \"node-resolver-lzcsf\" (UID: \"f95b113a-076d-4c7d-ac0b-24de4955b5c2\") " pod="openshift-dns/node-resolver-lzcsf" Jul 07 18:22:42.250831 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.250815 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0-registration-dir\") pod \"aws-ebs-csi-driver-node-t292m\" (UID: \"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" Jul 07 18:22:42.250831 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.250817 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0-device-dir\") pod \"aws-ebs-csi-driver-node-t292m\" (UID: \"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" Jul 07 18:22:42.250831 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:42.250828 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:22:42.251277 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.250849 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flbhj\" (UniqueName: \"kubernetes.io/projected/f95b113a-076d-4c7d-ac0b-24de4955b5c2-kube-api-access-flbhj\") pod \"node-resolver-lzcsf\" (UID: \"f95b113a-076d-4c7d-ac0b-24de4955b5c2\") " pod="openshift-dns/node-resolver-lzcsf" Jul 07 18:22:42.251277 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.250877 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-dbus\") pod \"global-pull-secret-syncer-njfbx\" (UID: \"f090aaca-9b3a-449a-b2c4-2ccfbf5db417\") " pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:22:42.251277 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:42.250909 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs podName:68167320-ef20-4d1d-9b83-610ac96b5dce nodeName:}" failed. No retries permitted until 2026-07-07 18:22:42.750886723 +0000 UTC m=+3.881538742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs") pod "network-metrics-daemon-k6w2r" (UID: "68167320-ef20-4d1d-9b83-610ac96b5dce") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:22:42.251277 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.250935 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-dbus\") pod \"global-pull-secret-syncer-njfbx\" (UID: \"f090aaca-9b3a-449a-b2c4-2ccfbf5db417\") " pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:22:42.251277 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.250940 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/829d17b8-8a45-4d04-af61-95b53794b8a1-agent-certs\") pod \"konnectivity-agent-rxcml\" (UID: \"829d17b8-8a45-4d04-af61-95b53794b8a1\") " pod="kube-system/konnectivity-agent-rxcml" Jul 07 18:22:42.251277 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.250964 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f95b113a-076d-4c7d-ac0b-24de4955b5c2-tmp-dir\") pod \"node-resolver-lzcsf\" (UID: \"f95b113a-076d-4c7d-ac0b-24de4955b5c2\") " pod="openshift-dns/node-resolver-lzcsf" Jul 07 18:22:42.251277 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.250997 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lhww\" (UniqueName: \"kubernetes.io/projected/308fd74f-73af-48f2-ac49-d989c1093f21-kube-api-access-2lhww\") pod \"iptables-alerter-4xrg4\" (UID: \"308fd74f-73af-48f2-ac49-d989c1093f21\") " pod="openshift-network-operator/iptables-alerter-4xrg4" Jul 07 18:22:42.251277 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.251049 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zznkq\" (UniqueName: \"kubernetes.io/projected/68167320-ef20-4d1d-9b83-610ac96b5dce-kube-api-access-zznkq\") pod \"network-metrics-daemon-k6w2r\" (UID: \"68167320-ef20-4d1d-9b83-610ac96b5dce\") " pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:22:42.251277 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.251085 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret\") pod \"global-pull-secret-syncer-njfbx\" (UID: \"f090aaca-9b3a-449a-b2c4-2ccfbf5db417\") " pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:22:42.251277 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.251117 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/308fd74f-73af-48f2-ac49-d989c1093f21-iptables-alerter-script\") pod \"iptables-alerter-4xrg4\" (UID: \"308fd74f-73af-48f2-ac49-d989c1093f21\") " pod="openshift-network-operator/iptables-alerter-4xrg4" Jul 07 18:22:42.251277 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.251128 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0-socket-dir\") pod \"aws-ebs-csi-driver-node-t292m\" (UID: \"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" Jul 07 18:22:42.251277 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.251156 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0-etc-selinux\") pod \"aws-ebs-csi-driver-node-t292m\" (UID: \"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" Jul 07 18:22:42.251277 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:42.251198 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 18:22:42.251277 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.251199 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0-sys-fs\") pod \"aws-ebs-csi-driver-node-t292m\" (UID: \"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" Jul 07 18:22:42.251277 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:42.251260 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret podName:f090aaca-9b3a-449a-b2c4-2ccfbf5db417 nodeName:}" failed. No retries permitted until 2026-07-07 18:22:42.751242559 +0000 UTC m=+3.881894569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret") pod "global-pull-secret-syncer-njfbx" (UID: "f090aaca-9b3a-449a-b2c4-2ccfbf5db417") : object "kube-system"/"original-pull-secret" not registered Jul 07 18:22:42.251277 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.251260 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0-sys-fs\") pod \"aws-ebs-csi-driver-node-t292m\" (UID: \"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" Jul 07 18:22:42.251909 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.251287 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0-etc-selinux\") pod \"aws-ebs-csi-driver-node-t292m\" (UID: \"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" Jul 07 18:22:42.251909 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.251295 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0-socket-dir\") pod \"aws-ebs-csi-driver-node-t292m\" (UID: \"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" Jul 07 18:22:42.251909 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.251307 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-kubelet-config\") pod \"global-pull-secret-syncer-njfbx\" (UID: \"f090aaca-9b3a-449a-b2c4-2ccfbf5db417\") " pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:22:42.251909 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.251343 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/829d17b8-8a45-4d04-af61-95b53794b8a1-konnectivity-ca\") pod \"konnectivity-agent-rxcml\" (UID: \"829d17b8-8a45-4d04-af61-95b53794b8a1\") " pod="kube-system/konnectivity-agent-rxcml" Jul 07 18:22:42.251909 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.251353 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-kubelet-config\") pod \"global-pull-secret-syncer-njfbx\" (UID: \"f090aaca-9b3a-449a-b2c4-2ccfbf5db417\") " pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:22:42.252063 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.251926 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/829d17b8-8a45-4d04-af61-95b53794b8a1-konnectivity-ca\") pod \"konnectivity-agent-rxcml\" (UID: \"829d17b8-8a45-4d04-af61-95b53794b8a1\") " pod="kube-system/konnectivity-agent-rxcml" Jul 07 18:22:42.253345 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.253328 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/829d17b8-8a45-4d04-af61-95b53794b8a1-agent-certs\") pod \"konnectivity-agent-rxcml\" (UID: \"829d17b8-8a45-4d04-af61-95b53794b8a1\") " pod="kube-system/konnectivity-agent-rxcml" Jul 07 18:22:42.259738 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.259707 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp4w7\" (UniqueName: \"kubernetes.io/projected/0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0-kube-api-access-xp4w7\") pod \"aws-ebs-csi-driver-node-t292m\" (UID: \"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" Jul 07 18:22:42.260421 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.260397 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lhww\" (UniqueName: \"kubernetes.io/projected/308fd74f-73af-48f2-ac49-d989c1093f21-kube-api-access-2lhww\") pod \"iptables-alerter-4xrg4\" (UID: \"308fd74f-73af-48f2-ac49-d989c1093f21\") " pod="openshift-network-operator/iptables-alerter-4xrg4" Jul 07 18:22:42.260643 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.260627 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flbhj\" (UniqueName: \"kubernetes.io/projected/f95b113a-076d-4c7d-ac0b-24de4955b5c2-kube-api-access-flbhj\") pod \"node-resolver-lzcsf\" (UID: \"f95b113a-076d-4c7d-ac0b-24de4955b5c2\") " pod="openshift-dns/node-resolver-lzcsf" Jul 07 18:22:42.260809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.260792 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zznkq\" (UniqueName: \"kubernetes.io/projected/68167320-ef20-4d1d-9b83-610ac96b5dce-kube-api-access-zznkq\") pod \"network-metrics-daemon-k6w2r\" (UID: \"68167320-ef20-4d1d-9b83-610ac96b5dce\") " pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:22:42.338016 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.337930 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" Jul 07 18:22:42.347294 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.347267 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rgkvn" Jul 07 18:22:42.348264 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:42.348226 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d38827b_87ba_4545_9829_dcd0ca83adc6.slice/crio-f3cd79be3f21a2746a33add2999e76df1e20a6ddb6279ba42274fc94fbabac7c WatchSource:0}: Error finding container f3cd79be3f21a2746a33add2999e76df1e20a6ddb6279ba42274fc94fbabac7c: Status 404 returned error can't find the container with id f3cd79be3f21a2746a33add2999e76df1e20a6ddb6279ba42274fc94fbabac7c Jul 07 18:22:42.354566 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.354482 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ftjp9" Jul 07 18:22:42.360479 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.360456 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bsrjr" Jul 07 18:22:42.362505 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:42.362454 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51f0ab4e_9faa_4aa6_a6bf_5c7e3f69cd13.slice/crio-b616b8472f8b94296d45599fa1fb54144e10770831fd1356301d5757b7e7c2d3 WatchSource:0}: Error finding container b616b8472f8b94296d45599fa1fb54144e10770831fd1356301d5757b7e7c2d3: Status 404 returned error can't find the container with id b616b8472f8b94296d45599fa1fb54144e10770831fd1356301d5757b7e7c2d3 Jul 07 18:22:42.366141 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.365977 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:22:42.366907 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:42.366868 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb72940a4_d68a_4aa5_83ee_375e8bae5918.slice/crio-47fbf20823f8235e1b14c38688a28f518895e6ad15d72ffe56be6cf6bfbb8eca WatchSource:0}: Error finding container 47fbf20823f8235e1b14c38688a28f518895e6ad15d72ffe56be6cf6bfbb8eca: Status 404 returned error can't find the container with id 47fbf20823f8235e1b14c38688a28f518895e6ad15d72ffe56be6cf6bfbb8eca Jul 07 18:22:42.371361 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.371344 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" Jul 07 18:22:42.373108 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:42.373083 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71984996_59a4_46f1_a8f3_a9bab1c925af.slice/crio-0ead92c477633100f6ceb2a878b3199e9c5d7a002d66980dd3acd6a1cd702e14 WatchSource:0}: Error finding container 0ead92c477633100f6ceb2a878b3199e9c5d7a002d66980dd3acd6a1cd702e14: Status 404 returned error can't find the container with id 0ead92c477633100f6ceb2a878b3199e9c5d7a002d66980dd3acd6a1cd702e14 Jul 07 18:22:42.376905 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:42.376879 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7335728_d739_4c3d_877b_c1d860112c1a.slice/crio-71ddfd4d6dbc77a3cbaf129f7f379686aebab89ad3fec52a21fb79693a4c88ef WatchSource:0}: Error finding container 71ddfd4d6dbc77a3cbaf129f7f379686aebab89ad3fec52a21fb79693a4c88ef: Status 404 returned error can't find the container with id 71ddfd4d6dbc77a3cbaf129f7f379686aebab89ad3fec52a21fb79693a4c88ef Jul 07 18:22:42.377205 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.377072 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rxcml" Jul 07 18:22:42.384186 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.383356 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lzcsf" Jul 07 18:22:42.388025 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.388005 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4xrg4" Jul 07 18:22:42.396764 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:42.396734 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf95b113a_076d_4c7d_ac0b_24de4955b5c2.slice/crio-a7fb603dbda9c9f5f94a70ae1640865f6ecfaa3ce056c9a5cd0069e05069351a WatchSource:0}: Error finding container a7fb603dbda9c9f5f94a70ae1640865f6ecfaa3ce056c9a5cd0069e05069351a: Status 404 returned error can't find the container with id a7fb603dbda9c9f5f94a70ae1640865f6ecfaa3ce056c9a5cd0069e05069351a Jul 07 18:22:42.404112 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:22:42.404089 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod308fd74f_73af_48f2_ac49_d989c1093f21.slice/crio-ae6b376504a858aff519778442b481c88763b79105b9556483bca9731f745732 WatchSource:0}: Error finding container ae6b376504a858aff519778442b481c88763b79105b9556483bca9731f745732: Status 404 returned error can't find the container with id ae6b376504a858aff519778442b481c88763b79105b9556483bca9731f745732 Jul 07 18:22:42.755243 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.755141 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret\") pod \"global-pull-secret-syncer-njfbx\" (UID: \"f090aaca-9b3a-449a-b2c4-2ccfbf5db417\") " pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:22:42.755243 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.755219 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfqxc\" (UniqueName: \"kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc\") pod \"network-check-target-lg59n\" (UID: \"f481e445-5a2b-4d41-99c4-5ba2397e062a\") " pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:22:42.755503 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:42.755261 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs\") pod \"network-metrics-daemon-k6w2r\" (UID: \"68167320-ef20-4d1d-9b83-610ac96b5dce\") " pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:22:42.755503 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:42.755328 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 18:22:42.755503 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:42.755355 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:22:42.755503 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:42.755366 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 18:22:42.755503 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:42.755396 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 18:22:42.755503 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:42.755410 2580 projected.go:196] Error preparing data for projected volume kube-api-access-sfqxc for pod openshift-network-diagnostics/network-check-target-lg59n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:22:42.755503 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:42.755411 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret podName:f090aaca-9b3a-449a-b2c4-2ccfbf5db417 nodeName:}" failed. No retries permitted until 2026-07-07 18:22:43.755388972 +0000 UTC m=+4.886041001 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret") pod "global-pull-secret-syncer-njfbx" (UID: "f090aaca-9b3a-449a-b2c4-2ccfbf5db417") : object "kube-system"/"original-pull-secret" not registered Jul 07 18:22:42.755503 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:42.755436 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs podName:68167320-ef20-4d1d-9b83-610ac96b5dce nodeName:}" failed. No retries permitted until 2026-07-07 18:22:43.755424023 +0000 UTC m=+4.886076031 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs") pod "network-metrics-daemon-k6w2r" (UID: "68167320-ef20-4d1d-9b83-610ac96b5dce") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:22:42.755503 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:42.755453 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc podName:f481e445-5a2b-4d41-99c4-5ba2397e062a nodeName:}" failed. No retries permitted until 2026-07-07 18:22:43.755441435 +0000 UTC m=+4.886093443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sfqxc" (UniqueName: "kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc") pod "network-check-target-lg59n" (UID: "f481e445-5a2b-4d41-99c4-5ba2397e062a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:22:43.097915 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:43.097765 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 18:17:42 +0000 UTC" deadline="2028-03-30 09:38:17.074216846 +0000 UTC" Jul 07 18:22:43.097915 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:43.097809 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15159h15m33.976412988s" Jul 07 18:22:43.185908 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:43.185870 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:22:43.186104 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:43.186007 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lg59n" podUID="f481e445-5a2b-4d41-99c4-5ba2397e062a" Jul 07 18:22:43.201556 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:43.200318 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4xrg4" event={"ID":"308fd74f-73af-48f2-ac49-d989c1093f21","Type":"ContainerStarted","Data":"ae6b376504a858aff519778442b481c88763b79105b9556483bca9731f745732"} Jul 07 18:22:43.210239 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:43.210189 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lzcsf" event={"ID":"f95b113a-076d-4c7d-ac0b-24de4955b5c2","Type":"ContainerStarted","Data":"a7fb603dbda9c9f5f94a70ae1640865f6ecfaa3ce056c9a5cd0069e05069351a"} Jul 07 18:22:43.212577 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:43.212548 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rxcml" event={"ID":"829d17b8-8a45-4d04-af61-95b53794b8a1","Type":"ContainerStarted","Data":"bb85fc20cab05f491c4c6e31aea2c031b7477b84d46befc14af30ab2dc336e3d"} Jul 07 18:22:43.214110 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:43.214085 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" event={"ID":"b7335728-d739-4c3d-877b-c1d860112c1a","Type":"ContainerStarted","Data":"71ddfd4d6dbc77a3cbaf129f7f379686aebab89ad3fec52a21fb79693a4c88ef"} Jul 07 18:22:43.216266 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:43.216238 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bsrjr" event={"ID":"71984996-59a4-46f1-a8f3-a9bab1c925af","Type":"ContainerStarted","Data":"0ead92c477633100f6ceb2a878b3199e9c5d7a002d66980dd3acd6a1cd702e14"} Jul 07 18:22:43.219772 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:43.219715 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rgkvn" event={"ID":"51f0ab4e-9faa-4aa6-a6bf-5c7e3f69cd13","Type":"ContainerStarted","Data":"b616b8472f8b94296d45599fa1fb54144e10770831fd1356301d5757b7e7c2d3"} Jul 07 18:22:43.224087 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:43.224054 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" event={"ID":"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0","Type":"ContainerStarted","Data":"68e7a943ac3aeed0630379e4ae36e9d68896786bf01b1b54c1c294116c09497b"} Jul 07 18:22:43.225790 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:43.225765 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftjp9" event={"ID":"b72940a4-d68a-4aa5-83ee-375e8bae5918","Type":"ContainerStarted","Data":"47fbf20823f8235e1b14c38688a28f518895e6ad15d72ffe56be6cf6bfbb8eca"} Jul 07 18:22:43.228927 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:43.228904 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" event={"ID":"0d38827b-87ba-4545-9829-dcd0ca83adc6","Type":"ContainerStarted","Data":"f3cd79be3f21a2746a33add2999e76df1e20a6ddb6279ba42274fc94fbabac7c"} Jul 07 18:22:43.763763 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:43.762731 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret\") pod \"global-pull-secret-syncer-njfbx\" (UID: \"f090aaca-9b3a-449a-b2c4-2ccfbf5db417\") " pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:22:43.763763 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:43.762807 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfqxc\" (UniqueName: \"kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc\") pod \"network-check-target-lg59n\" (UID: \"f481e445-5a2b-4d41-99c4-5ba2397e062a\") " pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:22:43.763763 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:43.762849 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs\") pod \"network-metrics-daemon-k6w2r\" (UID: \"68167320-ef20-4d1d-9b83-610ac96b5dce\") " pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:22:43.763763 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:43.762977 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:22:43.763763 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:43.763038 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs podName:68167320-ef20-4d1d-9b83-610ac96b5dce nodeName:}" failed. No retries permitted until 2026-07-07 18:22:45.763020102 +0000 UTC m=+6.893672111 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs") pod "network-metrics-daemon-k6w2r" (UID: "68167320-ef20-4d1d-9b83-610ac96b5dce") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:22:43.763763 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:43.763472 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 18:22:43.763763 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:43.763525 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret podName:f090aaca-9b3a-449a-b2c4-2ccfbf5db417 nodeName:}" failed. No retries permitted until 2026-07-07 18:22:45.76350825 +0000 UTC m=+6.894160258 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret") pod "global-pull-secret-syncer-njfbx" (UID: "f090aaca-9b3a-449a-b2c4-2ccfbf5db417") : object "kube-system"/"original-pull-secret" not registered Jul 07 18:22:43.763763 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:43.763651 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 18:22:43.763763 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:43.763669 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 18:22:43.763763 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:43.763682 2580 projected.go:196] Error preparing data for projected volume kube-api-access-sfqxc for pod openshift-network-diagnostics/network-check-target-lg59n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:22:43.763763 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:43.763722 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc podName:f481e445-5a2b-4d41-99c4-5ba2397e062a nodeName:}" failed. No retries permitted until 2026-07-07 18:22:45.763709664 +0000 UTC m=+6.894361671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sfqxc" (UniqueName: "kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc") pod "network-check-target-lg59n" (UID: "f481e445-5a2b-4d41-99c4-5ba2397e062a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:22:44.098941 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:44.098698 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 18:17:42 +0000 UTC" deadline="2028-02-16 20:34:08.741298337 +0000 UTC" Jul 07 18:22:44.098941 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:44.098765 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14138h11m24.642538656s" Jul 07 18:22:44.188471 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:44.187755 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:22:44.188471 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:44.187904 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6w2r" podUID="68167320-ef20-4d1d-9b83-610ac96b5dce" Jul 07 18:22:44.188471 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:44.188310 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:22:44.188471 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:44.188414 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njfbx" podUID="f090aaca-9b3a-449a-b2c4-2ccfbf5db417" Jul 07 18:22:45.185241 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:45.185198 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:22:45.185795 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:45.185321 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lg59n" podUID="f481e445-5a2b-4d41-99c4-5ba2397e062a" Jul 07 18:22:45.783115 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:45.782135 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfqxc\" (UniqueName: \"kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc\") pod \"network-check-target-lg59n\" (UID: \"f481e445-5a2b-4d41-99c4-5ba2397e062a\") " pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:22:45.783115 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:45.782199 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs\") pod \"network-metrics-daemon-k6w2r\" (UID: \"68167320-ef20-4d1d-9b83-610ac96b5dce\") " pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:22:45.783115 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:45.782248 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret\") pod \"global-pull-secret-syncer-njfbx\" (UID: \"f090aaca-9b3a-449a-b2c4-2ccfbf5db417\") " pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:22:45.783115 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:45.782387 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 18:22:45.783115 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:45.782456 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret podName:f090aaca-9b3a-449a-b2c4-2ccfbf5db417 nodeName:}" failed. No retries permitted until 2026-07-07 18:22:49.782436491 +0000 UTC m=+10.913088497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret") pod "global-pull-secret-syncer-njfbx" (UID: "f090aaca-9b3a-449a-b2c4-2ccfbf5db417") : object "kube-system"/"original-pull-secret" not registered Jul 07 18:22:45.783115 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:45.782907 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 18:22:45.783115 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:45.782930 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 18:22:45.783115 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:45.782945 2580 projected.go:196] Error preparing data for projected volume kube-api-access-sfqxc for pod openshift-network-diagnostics/network-check-target-lg59n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:22:45.783115 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:45.782990 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc podName:f481e445-5a2b-4d41-99c4-5ba2397e062a nodeName:}" failed. No retries permitted until 2026-07-07 18:22:49.782974645 +0000 UTC m=+10.913626650 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sfqxc" (UniqueName: "kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc") pod "network-check-target-lg59n" (UID: "f481e445-5a2b-4d41-99c4-5ba2397e062a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:22:45.783115 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:45.783054 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:22:45.783115 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:45.783090 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs podName:68167320-ef20-4d1d-9b83-610ac96b5dce nodeName:}" failed. No retries permitted until 2026-07-07 18:22:49.783077372 +0000 UTC m=+10.913729384 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs") pod "network-metrics-daemon-k6w2r" (UID: "68167320-ef20-4d1d-9b83-610ac96b5dce") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:22:46.185770 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:46.185326 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:22:46.185770 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:46.185509 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6w2r" podUID="68167320-ef20-4d1d-9b83-610ac96b5dce" Jul 07 18:22:46.185770 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:46.185326 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:22:46.185770 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:46.185759 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njfbx" podUID="f090aaca-9b3a-449a-b2c4-2ccfbf5db417" Jul 07 18:22:47.185156 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:47.185081 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:22:47.185296 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:47.185208 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lg59n" podUID="f481e445-5a2b-4d41-99c4-5ba2397e062a" Jul 07 18:22:48.185479 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:48.185406 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:22:48.185479 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:48.185445 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:22:48.185996 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:48.185566 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6w2r" podUID="68167320-ef20-4d1d-9b83-610ac96b5dce" Jul 07 18:22:48.185996 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:48.185691 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njfbx" podUID="f090aaca-9b3a-449a-b2c4-2ccfbf5db417" Jul 07 18:22:49.185352 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:49.185321 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:22:49.185554 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:49.185444 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lg59n" podUID="f481e445-5a2b-4d41-99c4-5ba2397e062a" Jul 07 18:22:49.818088 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:49.818043 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs\") pod \"network-metrics-daemon-k6w2r\" (UID: \"68167320-ef20-4d1d-9b83-610ac96b5dce\") " pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:22:49.818287 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:49.818115 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret\") pod \"global-pull-secret-syncer-njfbx\" (UID: \"f090aaca-9b3a-449a-b2c4-2ccfbf5db417\") " pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:22:49.818287 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:49.818171 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfqxc\" (UniqueName: \"kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc\") pod \"network-check-target-lg59n\" (UID: \"f481e445-5a2b-4d41-99c4-5ba2397e062a\") " pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:22:49.818287 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:49.818218 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:22:49.818446 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:49.818295 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs podName:68167320-ef20-4d1d-9b83-610ac96b5dce nodeName:}" failed. No retries permitted until 2026-07-07 18:22:57.818272694 +0000 UTC m=+18.948924719 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs") pod "network-metrics-daemon-k6w2r" (UID: "68167320-ef20-4d1d-9b83-610ac96b5dce") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:22:49.818446 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:49.818296 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 18:22:49.818446 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:49.818325 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 18:22:49.818446 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:49.818338 2580 projected.go:196] Error preparing data for projected volume kube-api-access-sfqxc for pod openshift-network-diagnostics/network-check-target-lg59n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:22:49.818446 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:49.818350 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 18:22:49.818446 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:49.818375 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc podName:f481e445-5a2b-4d41-99c4-5ba2397e062a nodeName:}" failed. No retries permitted until 2026-07-07 18:22:57.818365164 +0000 UTC m=+18.949017167 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sfqxc" (UniqueName: "kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc") pod "network-check-target-lg59n" (UID: "f481e445-5a2b-4d41-99c4-5ba2397e062a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:22:49.818446 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:49.818398 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret podName:f090aaca-9b3a-449a-b2c4-2ccfbf5db417 nodeName:}" failed. No retries permitted until 2026-07-07 18:22:57.818383024 +0000 UTC m=+18.949035030 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret") pod "global-pull-secret-syncer-njfbx" (UID: "f090aaca-9b3a-449a-b2c4-2ccfbf5db417") : object "kube-system"/"original-pull-secret" not registered Jul 07 18:22:50.186184 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:50.186147 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:22:50.186622 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:50.186268 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6w2r" podUID="68167320-ef20-4d1d-9b83-610ac96b5dce" Jul 07 18:22:50.186703 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:50.186624 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:22:50.186755 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:50.186696 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njfbx" podUID="f090aaca-9b3a-449a-b2c4-2ccfbf5db417" Jul 07 18:22:51.185983 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:51.185945 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:22:51.186146 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:51.186072 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lg59n" podUID="f481e445-5a2b-4d41-99c4-5ba2397e062a" Jul 07 18:22:52.185337 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:52.185308 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:22:52.185723 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:52.185414 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6w2r" podUID="68167320-ef20-4d1d-9b83-610ac96b5dce" Jul 07 18:22:52.185723 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:52.185476 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:22:52.185723 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:52.185570 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njfbx" podUID="f090aaca-9b3a-449a-b2c4-2ccfbf5db417" Jul 07 18:22:53.184959 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:53.184928 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:22:53.185104 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:53.185039 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lg59n" podUID="f481e445-5a2b-4d41-99c4-5ba2397e062a" Jul 07 18:22:54.185257 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:54.184985 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:22:54.185782 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:54.184992 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:22:54.185782 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:54.185390 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6w2r" podUID="68167320-ef20-4d1d-9b83-610ac96b5dce" Jul 07 18:22:54.185782 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:54.185513 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njfbx" podUID="f090aaca-9b3a-449a-b2c4-2ccfbf5db417" Jul 07 18:22:54.262152 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:54.262119 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal" event={"ID":"b469ca5e754e40f9721a7a95476e077f","Type":"ContainerStarted","Data":"ad0796acf7e324cc88b3ab75066dd39016c565558d43c340d7ff13a93c228e02"} Jul 07 18:22:54.266090 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:54.266062 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" event={"ID":"0d38827b-87ba-4545-9829-dcd0ca83adc6","Type":"ContainerStarted","Data":"b98ea4ad0fb77fc03685cf655957e059c981f05cb000bea8dd6f4c77d7460a5a"} Jul 07 18:22:54.299519 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:54.299445 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal" podStartSLOduration=12.299427623 podStartE2EDuration="12.299427623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:22:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:22:54.279756885 +0000 UTC m=+15.410408908" watchObservedRunningTime="2026-07-07 18:22:54.299427623 +0000 UTC m=+15.430079648" Jul 07 18:22:55.185466 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:55.185205 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:22:55.185931 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:55.185534 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lg59n" podUID="f481e445-5a2b-4d41-99c4-5ba2397e062a" Jul 07 18:22:55.271423 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:55.271393 2580 generic.go:356] "Generic (PLEG): container finished" podID="f384e1e579d8d76d06f816cd9f7c1c43" containerID="158ef9ca3f1081dcbc8f138efb8e337d17486f44a4bdf5c91aa24f4e2e97d6f8" exitCode=0 Jul 07 18:22:55.271606 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:55.271477 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal" event={"ID":"f384e1e579d8d76d06f816cd9f7c1c43","Type":"ContainerDied","Data":"158ef9ca3f1081dcbc8f138efb8e337d17486f44a4bdf5c91aa24f4e2e97d6f8"} Jul 07 18:22:55.273208 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:55.273182 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" event={"ID":"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0","Type":"ContainerStarted","Data":"a0fd3a760adfd234ccb7d050a50b5af68fabea245645055bed89fab5aff656f8"} Jul 07 18:22:55.275256 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:55.275231 2580 generic.go:356] "Generic (PLEG): container finished" podID="b72940a4-d68a-4aa5-83ee-375e8bae5918" containerID="34711b688969864b400b48a75c9392c05d1a78379b33c230f9fa25a212704e53" exitCode=0 Jul 07 18:22:55.275387 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:55.275329 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftjp9" event={"ID":"b72940a4-d68a-4aa5-83ee-375e8bae5918","Type":"ContainerDied","Data":"34711b688969864b400b48a75c9392c05d1a78379b33c230f9fa25a212704e53"} Jul 07 18:22:55.277024 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:55.276964 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4xrg4" event={"ID":"308fd74f-73af-48f2-ac49-d989c1093f21","Type":"ContainerStarted","Data":"98f3626c73a33d92f97fcefc7c0fc4035a4776490579749171bdc2a52136ecca"} Jul 07 18:22:55.278574 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:55.278552 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lzcsf" event={"ID":"f95b113a-076d-4c7d-ac0b-24de4955b5c2","Type":"ContainerStarted","Data":"2efd9763b6a96958a634fb4098ea1bf6cb314e5a779ce6383fbc960ec7ed4ecc"} Jul 07 18:22:55.280248 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:55.280228 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rxcml" event={"ID":"829d17b8-8a45-4d04-af61-95b53794b8a1","Type":"ContainerStarted","Data":"2b45904c1789045f569507ff1e2cb6a334131786267cc32f19fa72493cd5e543"} Jul 07 18:22:55.281750 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:55.281708 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rgkvn" event={"ID":"51f0ab4e-9faa-4aa6-a6bf-5c7e3f69cd13","Type":"ContainerStarted","Data":"9094d7437052f8643fa63c3857ff8d93cf5f43779c1f8ed03b7f005ae6d1e2ec"} Jul 07 18:22:55.288773 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:55.288728 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s9zt5" podStartSLOduration=4.21536338 podStartE2EDuration="15.288709753s" totalImagesPullingTime="11.073346373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:22:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:22:54.299650972 +0000 UTC m=+15.430302996" watchObservedRunningTime="2026-07-07 18:22:55.288709753 +0000 UTC m=+16.419361826" Jul 07 18:22:55.307644 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:55.307603 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lzcsf" podStartSLOduration=3.283644707 podStartE2EDuration="14.30758808s" totalImagesPullingTime="11.023943373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:22:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:22:55.302741998 +0000 UTC m=+16.433394043" watchObservedRunningTime="2026-07-07 18:22:55.30758808 +0000 UTC m=+16.438240105" Jul 07 18:22:55.318770 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:55.318737 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rgkvn" podStartSLOduration=4.292561873 podStartE2EDuration="15.318727527s" totalImagesPullingTime="11.026165654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:22:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:22:55.318690027 +0000 UTC m=+16.449342051" watchObservedRunningTime="2026-07-07 18:22:55.318727527 +0000 UTC m=+16.449379550" Jul 07 18:22:55.335328 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:55.335293 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rxcml" podStartSLOduration=3.39176216 podStartE2EDuration="14.335281217s" totalImagesPullingTime="10.943519057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:22:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:22:55.334955355 +0000 UTC m=+16.465607379" watchObservedRunningTime="2026-07-07 18:22:55.335281217 +0000 UTC m=+16.465933240" Jul 07 18:22:55.350293 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:55.350234 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4xrg4" podStartSLOduration=3.767198576 podStartE2EDuration="14.350214308s" totalImagesPullingTime="10.583015732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:22:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:22:55.349621106 +0000 UTC m=+16.480273129" watchObservedRunningTime="2026-07-07 18:22:55.350214308 +0000 UTC m=+16.480866336" Jul 07 18:22:56.131775 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:56.131743 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rxcml" Jul 07 18:22:56.132371 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:56.132342 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rxcml" Jul 07 18:22:56.185014 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:56.184973 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:22:56.185168 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:56.185129 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6w2r" podUID="68167320-ef20-4d1d-9b83-610ac96b5dce" Jul 07 18:22:56.185245 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:56.185176 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:22:56.185315 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:56.185287 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njfbx" podUID="f090aaca-9b3a-449a-b2c4-2ccfbf5db417" Jul 07 18:22:56.286681 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:56.286641 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal" event={"ID":"f384e1e579d8d76d06f816cd9f7c1c43","Type":"ContainerStarted","Data":"75f0b77a49e31bd5f0460e91a3cbce7e3cc4e0fafe9be3c47a0badb825228590"} Jul 07 18:22:56.309941 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:56.309886 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal" podStartSLOduration=14.309865432 podStartE2EDuration="14.309865432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:22:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:22:56.309474233 +0000 UTC m=+17.440126248" watchObservedRunningTime="2026-07-07 18:22:56.309865432 +0000 UTC m=+17.440517458" Jul 07 18:22:57.185423 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:57.185380 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:22:57.185651 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:57.185526 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lg59n" podUID="f481e445-5a2b-4d41-99c4-5ba2397e062a" Jul 07 18:22:57.288507 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:57.288479 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 18:22:57.879978 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:57.879948 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret\") pod \"global-pull-secret-syncer-njfbx\" (UID: \"f090aaca-9b3a-449a-b2c4-2ccfbf5db417\") " pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:22:57.880218 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:57.879997 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfqxc\" (UniqueName: \"kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc\") pod \"network-check-target-lg59n\" (UID: \"f481e445-5a2b-4d41-99c4-5ba2397e062a\") " pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:22:57.880218 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:57.880027 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs\") pod \"network-metrics-daemon-k6w2r\" (UID: \"68167320-ef20-4d1d-9b83-610ac96b5dce\") " pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:22:57.880218 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:57.880105 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 18:22:57.880218 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:57.880130 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 18:22:57.880218 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:57.880149 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 18:22:57.880218 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:57.880161 2580 projected.go:196] Error preparing data for projected volume kube-api-access-sfqxc for pod openshift-network-diagnostics/network-check-target-lg59n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:22:57.880218 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:57.880175 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret podName:f090aaca-9b3a-449a-b2c4-2ccfbf5db417 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:13.880155189 +0000 UTC m=+35.010807209 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret") pod "global-pull-secret-syncer-njfbx" (UID: "f090aaca-9b3a-449a-b2c4-2ccfbf5db417") : object "kube-system"/"original-pull-secret" not registered Jul 07 18:22:57.880218 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:57.880200 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc podName:f481e445-5a2b-4d41-99c4-5ba2397e062a nodeName:}" failed. No retries permitted until 2026-07-07 18:23:13.880189279 +0000 UTC m=+35.010841280 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sfqxc" (UniqueName: "kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc") pod "network-check-target-lg59n" (UID: "f481e445-5a2b-4d41-99c4-5ba2397e062a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:22:57.880218 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:57.880216 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:22:57.880604 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:57.880262 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs podName:68167320-ef20-4d1d-9b83-610ac96b5dce nodeName:}" failed. No retries permitted until 2026-07-07 18:23:13.880250503 +0000 UTC m=+35.010902519 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs") pod "network-metrics-daemon-k6w2r" (UID: "68167320-ef20-4d1d-9b83-610ac96b5dce") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:22:58.185776 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:58.185705 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:22:58.185946 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:58.185844 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njfbx" podUID="f090aaca-9b3a-449a-b2c4-2ccfbf5db417" Jul 07 18:22:58.186199 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:58.185706 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:22:58.186341 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:58.186293 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6w2r" podUID="68167320-ef20-4d1d-9b83-610ac96b5dce" Jul 07 18:22:59.034495 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:59.034443 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rxcml" Jul 07 18:22:59.035188 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:59.034636 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 18:22:59.035188 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:59.035052 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rxcml" Jul 07 18:22:59.185502 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:22:59.185474 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:22:59.185664 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:22:59.185593 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lg59n" podUID="f481e445-5a2b-4d41-99c4-5ba2397e062a" Jul 07 18:23:00.186019 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:00.185983 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:23:00.186533 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:00.186100 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6w2r" podUID="68167320-ef20-4d1d-9b83-610ac96b5dce" Jul 07 18:23:00.186533 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:00.186120 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:23:00.186533 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:00.186206 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njfbx" podUID="f090aaca-9b3a-449a-b2c4-2ccfbf5db417" Jul 07 18:23:01.185271 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:01.185235 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:23:01.185486 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:01.185369 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lg59n" podUID="f481e445-5a2b-4d41-99c4-5ba2397e062a" Jul 07 18:23:02.186110 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:02.186057 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:23:02.186110 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:02.186105 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:23:02.186826 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:02.186196 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njfbx" podUID="f090aaca-9b3a-449a-b2c4-2ccfbf5db417" Jul 07 18:23:02.186826 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:02.186330 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6w2r" podUID="68167320-ef20-4d1d-9b83-610ac96b5dce" Jul 07 18:23:03.185178 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:03.185132 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:23:03.185347 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:03.185251 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lg59n" podUID="f481e445-5a2b-4d41-99c4-5ba2397e062a" Jul 07 18:23:04.185637 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:04.185604 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:23:04.186087 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:04.185746 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6w2r" podUID="68167320-ef20-4d1d-9b83-610ac96b5dce" Jul 07 18:23:04.186087 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:04.185801 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:23:04.186087 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:04.185927 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njfbx" podUID="f090aaca-9b3a-449a-b2c4-2ccfbf5db417" Jul 07 18:23:05.185346 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:05.185268 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:23:05.185498 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:05.185379 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lg59n" podUID="f481e445-5a2b-4d41-99c4-5ba2397e062a" Jul 07 18:23:06.185922 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:06.185730 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:23:06.186371 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:06.185764 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:23:06.186371 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:06.186010 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6w2r" podUID="68167320-ef20-4d1d-9b83-610ac96b5dce" Jul 07 18:23:06.186371 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:06.186119 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njfbx" podUID="f090aaca-9b3a-449a-b2c4-2ccfbf5db417" Jul 07 18:23:07.000131 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:07.000098 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 18:23:07.117771 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:07.117672 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T18:23:07.000124784Z","UUID":"bc7f6150-76cd-4064-9267-b906fe4737ca","Handler":null,"Name":"","Endpoint":""} Jul 07 18:23:07.119177 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:07.119158 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 18:23:07.119275 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:07.119199 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 18:23:07.185902 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:07.185883 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:23:07.185994 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:07.185972 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lg59n" podUID="f481e445-5a2b-4d41-99c4-5ba2397e062a" Jul 07 18:23:07.309295 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:07.309114 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-skkmr_b7335728-d739-4c3d-877b-c1d860112c1a/ovn-acl-logging/0.log" Jul 07 18:23:07.310142 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:07.309866 2580 generic.go:356] "Generic (PLEG): container finished" podID="b7335728-d739-4c3d-877b-c1d860112c1a" containerID="d5d5fa38185b991c560f683e6552e5b890cd1abecef5245b18b01b18d2f7484c" exitCode=1 Jul 07 18:23:07.310142 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:07.309943 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" event={"ID":"b7335728-d739-4c3d-877b-c1d860112c1a","Type":"ContainerStarted","Data":"780d8982ae1777fdf7054db570d1625362cd1965cd50c1b6c2b2dba638f3042a"} Jul 07 18:23:07.310142 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:07.310027 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" event={"ID":"b7335728-d739-4c3d-877b-c1d860112c1a","Type":"ContainerDied","Data":"d5d5fa38185b991c560f683e6552e5b890cd1abecef5245b18b01b18d2f7484c"} Jul 07 18:23:07.310142 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:07.310078 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" event={"ID":"b7335728-d739-4c3d-877b-c1d860112c1a","Type":"ContainerStarted","Data":"c5dca57b2dfaf21c3ec91790b703970c21db498e6c4749ffa9ae3b36b8690242"} Jul 07 18:23:07.312937 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:07.312722 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bsrjr" event={"ID":"71984996-59a4-46f1-a8f3-a9bab1c925af","Type":"ContainerStarted","Data":"b7aef060ddd69fdf541bdda5329577e35a6f80857f114b0e33d2e80ba50a5f1b"} Jul 07 18:23:07.314603 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:07.314571 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" event={"ID":"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0","Type":"ContainerStarted","Data":"ce86f5cb25dc148b6da66d0cd5d47d94d5532a9b6d270c93fc494c30343cc307"} Jul 07 18:23:07.316427 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:07.316404 2580 generic.go:356] "Generic (PLEG): container finished" podID="b72940a4-d68a-4aa5-83ee-375e8bae5918" containerID="f6f4ce215b7d6bc9c025236255b3e71111b5441d2260a9100d14faefdf7c18ed" exitCode=0 Jul 07 18:23:07.316546 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:07.316447 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftjp9" event={"ID":"b72940a4-d68a-4aa5-83ee-375e8bae5918","Type":"ContainerDied","Data":"f6f4ce215b7d6bc9c025236255b3e71111b5441d2260a9100d14faefdf7c18ed"} Jul 07 18:23:07.331257 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:07.331223 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bsrjr" podStartSLOduration=2.899275684 podStartE2EDuration="27.331211391s" totalImagesPullingTime="24.431935707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:22:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:23:07.33107823 +0000 UTC m=+28.461730254" watchObservedRunningTime="2026-07-07 18:23:07.331211391 +0000 UTC m=+28.461863413" Jul 07 18:23:08.185834 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:08.185759 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:23:08.186015 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:08.185906 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6w2r" podUID="68167320-ef20-4d1d-9b83-610ac96b5dce" Jul 07 18:23:08.186015 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:08.185945 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:23:08.186727 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:08.186024 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njfbx" podUID="f090aaca-9b3a-449a-b2c4-2ccfbf5db417" Jul 07 18:23:08.323853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:08.323828 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-skkmr_b7335728-d739-4c3d-877b-c1d860112c1a/ovn-acl-logging/0.log" Jul 07 18:23:08.324177 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:08.324155 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" event={"ID":"b7335728-d739-4c3d-877b-c1d860112c1a","Type":"ContainerStarted","Data":"fb956b6837e9a16cb23c6e1b32ea39f246a1a9bdbdd0b06e10c4cb57206e0648"} Jul 07 18:23:08.324231 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:08.324221 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" event={"ID":"b7335728-d739-4c3d-877b-c1d860112c1a","Type":"ContainerStarted","Data":"33392b38952d6c4f5ded916882efab8e401513ea70d66bbc7444656e03aa4eae"} Jul 07 18:23:08.324267 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:08.324251 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" event={"ID":"b7335728-d739-4c3d-877b-c1d860112c1a","Type":"ContainerStarted","Data":"a98ceee2a56d74a8861e92c166eceb1b7b5cdff192d4c0882d60bb79e0015605"} Jul 07 18:23:09.185677 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:09.185617 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:23:09.185829 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:09.185706 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lg59n" podUID="f481e445-5a2b-4d41-99c4-5ba2397e062a" Jul 07 18:23:09.328927 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:09.328894 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" event={"ID":"0c92e9a8-fd2c-44f2-a587-6fbcc29e1fa0","Type":"ContainerStarted","Data":"b8aee396dcc4dad8ce8ec02728f240bb233fc0ab776de7fcf2ff62bae2511d8e"} Jul 07 18:23:09.330846 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:09.330821 2580 generic.go:356] "Generic (PLEG): container finished" podID="b72940a4-d68a-4aa5-83ee-375e8bae5918" containerID="d76e556e36646e5d43ac634bd8eb1fb0e6df7af341c629899c31b65dc1cc9081" exitCode=0 Jul 07 18:23:09.330961 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:09.330854 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftjp9" event={"ID":"b72940a4-d68a-4aa5-83ee-375e8bae5918","Type":"ContainerDied","Data":"d76e556e36646e5d43ac634bd8eb1fb0e6df7af341c629899c31b65dc1cc9081"} Jul 07 18:23:09.351143 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:09.351107 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t292m" podStartSLOduration=4.291984053 podStartE2EDuration="29.351094309s" totalImagesPullingTime="25.059110256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:22:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:23:09.350604849 +0000 UTC m=+30.481256893" watchObservedRunningTime="2026-07-07 18:23:09.351094309 +0000 UTC m=+30.481746332" Jul 07 18:23:10.186340 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:10.186309 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:23:10.186538 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:10.186451 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6w2r" podUID="68167320-ef20-4d1d-9b83-610ac96b5dce" Jul 07 18:23:10.186538 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:10.186504 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:23:10.186618 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:10.186590 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njfbx" podUID="f090aaca-9b3a-449a-b2c4-2ccfbf5db417" Jul 07 18:23:10.337813 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:10.337786 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-skkmr_b7335728-d739-4c3d-877b-c1d860112c1a/ovn-acl-logging/0.log" Jul 07 18:23:10.338260 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:10.338184 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" event={"ID":"b7335728-d739-4c3d-877b-c1d860112c1a","Type":"ContainerStarted","Data":"e0597762545317c220ec65027474e5f3e2c9618420fcfe0b46fac38dc39478cc"} Jul 07 18:23:11.185700 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:11.185670 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:23:11.185862 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:11.185762 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lg59n" podUID="f481e445-5a2b-4d41-99c4-5ba2397e062a" Jul 07 18:23:11.342873 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:11.342843 2580 generic.go:356] "Generic (PLEG): container finished" podID="b72940a4-d68a-4aa5-83ee-375e8bae5918" containerID="4cc2035791e3b260d0386f975c5275f343def085f5f71d5302ee218fb0e0efba" exitCode=0 Jul 07 18:23:11.343330 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:11.342894 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftjp9" event={"ID":"b72940a4-d68a-4aa5-83ee-375e8bae5918","Type":"ContainerDied","Data":"4cc2035791e3b260d0386f975c5275f343def085f5f71d5302ee218fb0e0efba"} Jul 07 18:23:12.185355 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:12.185254 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:23:12.185355 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:12.185254 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:23:12.185603 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:12.185378 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6w2r" podUID="68167320-ef20-4d1d-9b83-610ac96b5dce" Jul 07 18:23:12.185603 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:12.185443 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njfbx" podUID="f090aaca-9b3a-449a-b2c4-2ccfbf5db417" Jul 07 18:23:12.349785 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:12.349744 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-skkmr_b7335728-d739-4c3d-877b-c1d860112c1a/ovn-acl-logging/0.log" Jul 07 18:23:12.350216 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:12.350097 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" event={"ID":"b7335728-d739-4c3d-877b-c1d860112c1a","Type":"ContainerStarted","Data":"af33d299b4733adc969bd7fb82b0e8cda641eee8b78322c6a09b7fbecc7c1f4e"} Jul 07 18:23:12.350363 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:12.350345 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:23:12.350506 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:12.350414 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:23:12.350506 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:12.350477 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:23:12.350615 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:12.350599 2580 scope.go:117] "RemoveContainer" containerID="d5d5fa38185b991c560f683e6552e5b890cd1abecef5245b18b01b18d2f7484c" Jul 07 18:23:12.368045 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:12.368024 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:23:12.368207 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:12.368190 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:23:13.185913 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:13.185875 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:23:13.186111 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:13.186083 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lg59n" podUID="f481e445-5a2b-4d41-99c4-5ba2397e062a" Jul 07 18:23:13.357409 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:13.357381 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-skkmr_b7335728-d739-4c3d-877b-c1d860112c1a/ovn-acl-logging/0.log" Jul 07 18:23:13.357830 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:13.357776 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" event={"ID":"b7335728-d739-4c3d-877b-c1d860112c1a","Type":"ContainerStarted","Data":"a3171df5f1f5307231b9df822662eb390222e086815f46fbb57ca7987d7cbb77"} Jul 07 18:23:13.404448 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:13.404403 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" podStartSLOduration=8.95646062 podStartE2EDuration="33.404390113s" totalImagesPullingTime="24.447929493s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:22:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:23:13.403269936 +0000 UTC m=+34.533921959" watchObservedRunningTime="2026-07-07 18:23:13.404390113 +0000 UTC m=+34.535042136" Jul 07 18:23:13.902588 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:13.902541 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfqxc\" (UniqueName: \"kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc\") pod \"network-check-target-lg59n\" (UID: \"f481e445-5a2b-4d41-99c4-5ba2397e062a\") " pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:23:13.902771 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:13.902612 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs\") pod \"network-metrics-daemon-k6w2r\" (UID: \"68167320-ef20-4d1d-9b83-610ac96b5dce\") " pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:23:13.902771 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:13.902654 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret\") pod \"global-pull-secret-syncer-njfbx\" (UID: \"f090aaca-9b3a-449a-b2c4-2ccfbf5db417\") " pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:23:13.902771 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:13.902675 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 18:23:13.902771 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:13.902697 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 18:23:13.902771 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:13.902709 2580 projected.go:196] Error preparing data for projected volume kube-api-access-sfqxc for pod openshift-network-diagnostics/network-check-target-lg59n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:23:13.902771 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:13.902754 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 18:23:13.902771 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:13.902760 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:23:13.902771 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:13.902769 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc podName:f481e445-5a2b-4d41-99c4-5ba2397e062a nodeName:}" failed. No retries permitted until 2026-07-07 18:23:45.902753397 +0000 UTC m=+67.033405417 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sfqxc" (UniqueName: "kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc") pod "network-check-target-lg59n" (UID: "f481e445-5a2b-4d41-99c4-5ba2397e062a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 18:23:13.903146 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:13.902805 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret podName:f090aaca-9b3a-449a-b2c4-2ccfbf5db417 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:45.902791408 +0000 UTC m=+67.033443409 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret") pod "global-pull-secret-syncer-njfbx" (UID: "f090aaca-9b3a-449a-b2c4-2ccfbf5db417") : object "kube-system"/"original-pull-secret" not registered Jul 07 18:23:13.903146 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:13.902824 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs podName:68167320-ef20-4d1d-9b83-610ac96b5dce nodeName:}" failed. No retries permitted until 2026-07-07 18:23:45.902815171 +0000 UTC m=+67.033467176 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs") pod "network-metrics-daemon-k6w2r" (UID: "68167320-ef20-4d1d-9b83-610ac96b5dce") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 18:23:13.960729 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:13.960700 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-njfbx"] Jul 07 18:23:13.960870 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:13.960809 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:23:13.960917 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:13.960891 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njfbx" podUID="f090aaca-9b3a-449a-b2c4-2ccfbf5db417" Jul 07 18:23:13.963677 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:13.963655 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lg59n"] Jul 07 18:23:13.963784 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:13.963727 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:23:13.963833 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:13.963799 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lg59n" podUID="f481e445-5a2b-4d41-99c4-5ba2397e062a" Jul 07 18:23:13.977742 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:13.977723 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k6w2r"] Jul 07 18:23:13.977847 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:13.977828 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:23:13.977945 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:13.977926 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6w2r" podUID="68167320-ef20-4d1d-9b83-610ac96b5dce" Jul 07 18:23:16.185565 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:16.185485 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:23:16.185994 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:16.185485 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:23:16.185994 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:16.185600 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6w2r" podUID="68167320-ef20-4d1d-9b83-610ac96b5dce" Jul 07 18:23:16.185994 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:16.185620 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:23:16.185994 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:16.185737 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lg59n" podUID="f481e445-5a2b-4d41-99c4-5ba2397e062a" Jul 07 18:23:16.185994 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:16.185846 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njfbx" podUID="f090aaca-9b3a-449a-b2c4-2ccfbf5db417" Jul 07 18:23:18.185111 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:18.185078 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:23:18.185576 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:18.185078 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:23:18.185576 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:18.185194 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lg59n" podUID="f481e445-5a2b-4d41-99c4-5ba2397e062a" Jul 07 18:23:18.185576 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:18.185203 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:23:18.185576 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:18.185269 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6w2r" podUID="68167320-ef20-4d1d-9b83-610ac96b5dce" Jul 07 18:23:18.185576 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:18.185340 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njfbx" podUID="f090aaca-9b3a-449a-b2c4-2ccfbf5db417" Jul 07 18:23:18.372179 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:18.372050 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftjp9" event={"ID":"b72940a4-d68a-4aa5-83ee-375e8bae5918","Type":"ContainerStarted","Data":"395ad73f3a241c138e1df468f51e07e1f7e47fc15f3fe200fc7e41448f10f6bf"} Jul 07 18:23:19.377054 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:19.377012 2580 generic.go:356] "Generic (PLEG): container finished" podID="b72940a4-d68a-4aa5-83ee-375e8bae5918" containerID="395ad73f3a241c138e1df468f51e07e1f7e47fc15f3fe200fc7e41448f10f6bf" exitCode=0 Jul 07 18:23:19.377421 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:19.377065 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftjp9" event={"ID":"b72940a4-d68a-4aa5-83ee-375e8bae5918","Type":"ContainerDied","Data":"395ad73f3a241c138e1df468f51e07e1f7e47fc15f3fe200fc7e41448f10f6bf"} Jul 07 18:23:20.185990 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.185958 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:23:20.186155 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:20.186037 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lg59n" podUID="f481e445-5a2b-4d41-99c4-5ba2397e062a" Jul 07 18:23:20.186205 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.186153 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:23:20.186302 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:20.186280 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k6w2r" podUID="68167320-ef20-4d1d-9b83-610ac96b5dce" Jul 07 18:23:20.186344 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.186326 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:23:20.186390 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:20.186378 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njfbx" podUID="f090aaca-9b3a-449a-b2c4-2ccfbf5db417" Jul 07 18:23:20.381913 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.381878 2580 generic.go:356] "Generic (PLEG): container finished" podID="b72940a4-d68a-4aa5-83ee-375e8bae5918" containerID="11838dff7a36302eff1a123a9412c87b0f712dc98bd50f56e031403265ac1c13" exitCode=0 Jul 07 18:23:20.381913 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.381914 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftjp9" event={"ID":"b72940a4-d68a-4aa5-83ee-375e8bae5918","Type":"ContainerDied","Data":"11838dff7a36302eff1a123a9412c87b0f712dc98bd50f56e031403265ac1c13"} Jul 07 18:23:20.401835 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.401815 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeReady" Jul 07 18:23:20.401934 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.401924 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 18:23:20.457051 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.457021 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4trkp"] Jul 07 18:23:20.479678 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.478670 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bbc47"] Jul 07 18:23:20.479678 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.479590 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4trkp" Jul 07 18:23:20.490371 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.490310 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 07 18:23:20.490371 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.490320 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 07 18:23:20.490371 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.490321 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 07 18:23:20.490606 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.490313 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 07 18:23:20.490606 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.490441 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-qlmfj\"" Jul 07 18:23:20.494234 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.494216 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vtgpm"] Jul 07 18:23:20.494385 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.494324 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bbc47" Jul 07 18:23:20.497334 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.497317 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 07 18:23:20.498585 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.498564 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 18:23:20.498678 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.498610 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 07 18:23:20.498678 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.498614 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bhccg\"" Jul 07 18:23:20.498678 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.498666 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 18:23:20.514381 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.514359 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zcjct"] Jul 07 18:23:20.514524 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.514503 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vtgpm" Jul 07 18:23:20.518814 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.518792 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 07 18:23:20.518924 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.518808 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 07 18:23:20.519185 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.519149 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 07 18:23:20.519291 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.519194 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 07 18:23:20.519356 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.519309 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-sxhtn\"" Jul 07 18:23:20.536338 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.536320 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jf97s"] Jul 07 18:23:20.536441 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.536428 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zcjct" Jul 07 18:23:20.540605 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.540585 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 07 18:23:20.540605 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.540598 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-cbzz4\"" Jul 07 18:23:20.545633 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.545615 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 07 18:23:20.546444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.546424 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-c8qbd"] Jul 07 18:23:20.546563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.546527 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jf97s" Jul 07 18:23:20.549557 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.549538 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 07 18:23:20.550047 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.550028 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 07 18:23:20.550583 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.550564 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pwrfw\"" Jul 07 18:23:20.555967 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.555952 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 07 18:23:20.560634 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.560613 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-g9hm4"] Jul 07 18:23:20.560806 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.560790 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" Jul 07 18:23:20.564123 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.564102 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 07 18:23:20.564781 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.564759 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-lb5qm\"" Jul 07 18:23:20.564872 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.564804 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 07 18:23:20.564927 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.564905 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 07 18:23:20.565925 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.564766 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 07 18:23:20.576862 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.576846 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 07 18:23:20.580183 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.580168 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-67c8dfcf49-w9wrf"] Jul 07 18:23:20.580295 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.580281 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" Jul 07 18:23:20.585313 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.585294 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 07 18:23:20.585649 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.585581 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 07 18:23:20.585649 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.585585 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 18:23:20.585649 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.585640 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-95nqr\"" Jul 07 18:23:20.586193 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.586177 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 18:23:20.592561 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.592541 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 07 18:23:20.594305 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.594291 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f77fd79ff-zf7d7"] Jul 07 18:23:20.594414 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.594399 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:20.599664 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.599636 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 07 18:23:20.599825 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.599742 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 07 18:23:20.599825 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.599799 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 07 18:23:20.600129 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.600113 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 07 18:23:20.600203 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.600150 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4w8v8\"" Jul 07 18:23:20.600415 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.600395 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 18:23:20.601415 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.601397 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 18:23:20.608153 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.608138 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4trkp"] Jul 07 18:23:20.608233 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.608163 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bbc47"] Jul 07 18:23:20.608233 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.608177 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-fhgs8"] Jul 07 18:23:20.608337 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.608243 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.610559 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.610542 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 18:23:20.610636 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.610605 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 18:23:20.611407 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.611392 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-944sl\"" Jul 07 18:23:20.611539 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.611525 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 18:23:20.622618 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.622603 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 18:23:20.627135 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.627120 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-vwhkg"] Jul 07 18:23:20.627243 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.627231 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fhgs8" Jul 07 18:23:20.629359 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.629340 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 07 18:23:20.629359 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.629353 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-q5st5\"" Jul 07 18:23:20.629504 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.629376 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 07 18:23:20.637280 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.637265 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-g9hm4"] Jul 07 18:23:20.637353 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.637290 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vtgpm"] Jul 07 18:23:20.637353 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.637304 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zcjct"] Jul 07 18:23:20.637353 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.637316 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-c8qbd"] Jul 07 18:23:20.637353 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.637331 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-grchh"] Jul 07 18:23:20.637495 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.637361 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vwhkg" Jul 07 18:23:20.640177 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.640161 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-cvcsm\"" Jul 07 18:23:20.640638 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.640621 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 18:23:20.640780 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.640769 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 18:23:20.645510 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.645496 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-42kxz"] Jul 07 18:23:20.645624 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.645608 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-grchh" Jul 07 18:23:20.649365 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.648662 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 18:23:20.649365 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.648927 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 18:23:20.649365 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.648935 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 18:23:20.652505 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.652208 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xk8xw\"" Jul 07 18:23:20.653658 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.653637 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nf2z\" (UniqueName: \"kubernetes.io/projected/f5c769ba-6ad9-4cf7-94e5-4a7dbab806cc-kube-api-access-4nf2z\") pod \"service-ca-operator-5d46d9ffd4-4trkp\" (UID: \"f5c769ba-6ad9-4cf7-94e5-4a7dbab806cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4trkp" Jul 07 18:23:20.653737 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.653665 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd6m5\" (UniqueName: \"kubernetes.io/projected/e19ae2f0-2899-434d-bc06-dd4a3dabd4fc-kube-api-access-rd6m5\") pod \"volume-data-source-validator-5d456fdbcd-zcjct\" (UID: \"e19ae2f0-2899-434d-bc06-dd4a3dabd4fc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zcjct" Jul 07 18:23:20.653737 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.653689 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f5c769ba-6ad9-4cf7-94e5-4a7dbab806cc-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-4trkp\" (UID: \"f5c769ba-6ad9-4cf7-94e5-4a7dbab806cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4trkp" Jul 07 18:23:20.653737 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.653714 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b8491d42-ab30-44db-a098-d51bb210dbeb-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-vtgpm\" (UID: \"b8491d42-ab30-44db-a098-d51bb210dbeb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vtgpm" Jul 07 18:23:20.653838 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.653758 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78rmx\" (UniqueName: \"kubernetes.io/projected/b8491d42-ab30-44db-a098-d51bb210dbeb-kube-api-access-78rmx\") pod \"kube-storage-version-migrator-operator-846bf668f7-vtgpm\" (UID: \"b8491d42-ab30-44db-a098-d51bb210dbeb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vtgpm" Jul 07 18:23:20.653838 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.653783 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7-serving-cert\") pod \"console-operator-68b757fb67-c8qbd\" (UID: \"f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7\") " pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" Jul 07 18:23:20.653838 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.653827 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/965e4f40-8930-40a0-9ba0-b075c40d5a0d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bbc47\" (UID: \"965e4f40-8930-40a0-9ba0-b075c40d5a0d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bbc47" Jul 07 18:23:20.653944 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.653848 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gv76\" (UniqueName: \"kubernetes.io/projected/965e4f40-8930-40a0-9ba0-b075c40d5a0d-kube-api-access-2gv76\") pod \"cluster-monitoring-operator-64786d9cbb-bbc47\" (UID: \"965e4f40-8930-40a0-9ba0-b075c40d5a0d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bbc47" Jul 07 18:23:20.653944 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.653862 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7-config\") pod \"console-operator-68b757fb67-c8qbd\" (UID: \"f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7\") " pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" Jul 07 18:23:20.653944 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.653879 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f5c769ba-6ad9-4cf7-94e5-4a7dbab806cc-config\") pod \"service-ca-operator-5d46d9ffd4-4trkp\" (UID: \"f5c769ba-6ad9-4cf7-94e5-4a7dbab806cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4trkp" Jul 07 18:23:20.653944 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.653899 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfsb2\" (UniqueName: \"kubernetes.io/projected/8c2b4679-fdf3-4fdc-862d-89b27f73a954-kube-api-access-xfsb2\") pod \"cluster-samples-operator-56fcf86bf-jf97s\" (UID: \"8c2b4679-fdf3-4fdc-862d-89b27f73a954\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jf97s" Jul 07 18:23:20.654066 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.653953 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8491d42-ab30-44db-a098-d51bb210dbeb-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-vtgpm\" (UID: \"b8491d42-ab30-44db-a098-d51bb210dbeb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vtgpm" Jul 07 18:23:20.654066 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.653975 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7-trusted-ca\") pod \"console-operator-68b757fb67-c8qbd\" (UID: \"f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7\") " pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" Jul 07 18:23:20.654066 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.654011 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/965e4f40-8930-40a0-9ba0-b075c40d5a0d-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-bbc47\" (UID: \"965e4f40-8930-40a0-9ba0-b075c40d5a0d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bbc47" Jul 07 18:23:20.654066 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.654031 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q82h9\" (UniqueName: \"kubernetes.io/projected/f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7-kube-api-access-q82h9\") pod \"console-operator-68b757fb67-c8qbd\" (UID: \"f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7\") " pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" Jul 07 18:23:20.654066 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.654058 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c2b4679-fdf3-4fdc-862d-89b27f73a954-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-jf97s\" (UID: \"8c2b4679-fdf3-4fdc-862d-89b27f73a954\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jf97s" Jul 07 18:23:20.655226 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.655208 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67c8dfcf49-w9wrf"] Jul 07 18:23:20.655308 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.655235 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jf97s"] Jul 07 18:23:20.655308 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.655260 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f77fd79ff-zf7d7"] Jul 07 18:23:20.655308 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.655279 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-42kxz"] Jul 07 18:23:20.655308 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.655303 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-fhgs8"] Jul 07 18:23:20.655308 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.655304 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-42kxz" Jul 07 18:23:20.655572 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.655320 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-grchh"] Jul 07 18:23:20.655572 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.655342 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-vwhkg"] Jul 07 18:23:20.658995 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.658951 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9fz64\"" Jul 07 18:23:20.659074 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.659061 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 18:23:20.659119 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.659074 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 18:23:20.754769 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.754744 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd6m5\" (UniqueName: \"kubernetes.io/projected/e19ae2f0-2899-434d-bc06-dd4a3dabd4fc-kube-api-access-rd6m5\") pod \"volume-data-source-validator-5d456fdbcd-zcjct\" (UID: \"e19ae2f0-2899-434d-bc06-dd4a3dabd4fc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zcjct" Jul 07 18:23:20.754901 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.754774 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-metrics-certs\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:20.754901 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.754792 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qczxq\" (UniqueName: \"kubernetes.io/projected/09cbde25-7282-43a6-ae4a-95186fb6d720-kube-api-access-qczxq\") pod \"network-check-source-989f8b8dc-vwhkg\" (UID: \"09cbde25-7282-43a6-ae4a-95186fb6d720\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vwhkg" Jul 07 18:23:20.754901 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.754813 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f5c769ba-6ad9-4cf7-94e5-4a7dbab806cc-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-4trkp\" (UID: \"f5c769ba-6ad9-4cf7-94e5-4a7dbab806cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4trkp" Jul 07 18:23:20.754901 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.754829 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b8491d42-ab30-44db-a098-d51bb210dbeb-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-vtgpm\" (UID: \"b8491d42-ab30-44db-a098-d51bb210dbeb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vtgpm" Jul 07 18:23:20.754901 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.754849 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-bound-sa-token\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.754901 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.754878 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7-serving-cert\") pod \"console-operator-68b757fb67-c8qbd\" (UID: \"f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7\") " pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" Jul 07 18:23:20.754901 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.754902 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zzb6\" (UniqueName: \"kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-kube-api-access-5zzb6\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.755189 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.754929 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/965e4f40-8930-40a0-9ba0-b075c40d5a0d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bbc47\" (UID: \"965e4f40-8930-40a0-9ba0-b075c40d5a0d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bbc47" Jul 07 18:23:20.755189 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.754974 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94120e3a-209a-4ca3-8807-6e0e759f4c48-trusted-ca\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.755189 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:20.754994 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 18:23:20.755189 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.754997 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c6efb43-250b-4db1-bd62-e87d1ee11077-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-g9hm4\" (UID: \"3c6efb43-250b-4db1-bd62-e87d1ee11077\") " pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" Jul 07 18:23:20.755189 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:20.755067 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/965e4f40-8930-40a0-9ba0-b075c40d5a0d-cluster-monitoring-operator-tls podName:965e4f40-8930-40a0-9ba0-b075c40d5a0d nodeName:}" failed. No retries permitted until 2026-07-07 18:23:21.255047598 +0000 UTC m=+42.385699617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/965e4f40-8930-40a0-9ba0-b075c40d5a0d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-bbc47" (UID: "965e4f40-8930-40a0-9ba0-b075c40d5a0d") : secret "cluster-monitoring-operator-tls" not found Jul 07 18:23:20.755189 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755103 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q82h9\" (UniqueName: \"kubernetes.io/projected/f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7-kube-api-access-q82h9\") pod \"console-operator-68b757fb67-c8qbd\" (UID: \"f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7\") " pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" Jul 07 18:23:20.755189 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755133 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gv76\" (UniqueName: \"kubernetes.io/projected/965e4f40-8930-40a0-9ba0-b075c40d5a0d-kube-api-access-2gv76\") pod \"cluster-monitoring-operator-64786d9cbb-bbc47\" (UID: \"965e4f40-8930-40a0-9ba0-b075c40d5a0d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bbc47" Jul 07 18:23:20.755189 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755156 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c6efb43-250b-4db1-bd62-e87d1ee11077-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-g9hm4\" (UID: \"3c6efb43-250b-4db1-bd62-e87d1ee11077\") " pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" Jul 07 18:23:20.755189 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755179 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f5c769ba-6ad9-4cf7-94e5-4a7dbab806cc-config\") pod \"service-ca-operator-5d46d9ffd4-4trkp\" (UID: \"f5c769ba-6ad9-4cf7-94e5-4a7dbab806cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4trkp" Jul 07 18:23:20.755698 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755204 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8491d42-ab30-44db-a098-d51bb210dbeb-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-vtgpm\" (UID: \"b8491d42-ab30-44db-a098-d51bb210dbeb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vtgpm" Jul 07 18:23:20.755698 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755225 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-fhgs8\" (UID: \"5cd963e2-7b23-4a61-a73d-cbf757e7ea02\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fhgs8" Jul 07 18:23:20.755698 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755246 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fhgs8\" (UID: \"5cd963e2-7b23-4a61-a73d-cbf757e7ea02\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fhgs8" Jul 07 18:23:20.755698 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755273 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d442645e-7222-46af-9914-bb615255b0d5-service-ca-bundle\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:20.755698 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755306 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/965e4f40-8930-40a0-9ba0-b075c40d5a0d-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-bbc47\" (UID: \"965e4f40-8930-40a0-9ba0-b075c40d5a0d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bbc47" Jul 07 18:23:20.755698 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755326 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-config-volume\") pod \"dns-default-42kxz\" (UID: \"a2602fe9-e2fe-47bb-88b7-cab17f6659f3\") " pod="openshift-dns/dns-default-42kxz" Jul 07 18:23:20.755698 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755346 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.755698 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755374 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgtm5\" (UniqueName: \"kubernetes.io/projected/3c6efb43-250b-4db1-bd62-e87d1ee11077-kube-api-access-vgtm5\") pod \"insights-operator-5c847dcfc4-g9hm4\" (UID: \"3c6efb43-250b-4db1-bd62-e87d1ee11077\") " pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" Jul 07 18:23:20.755698 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755395 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-stats-auth\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:20.755698 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755426 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/94120e3a-209a-4ca3-8807-6e0e759f4c48-ca-trust-extracted\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.755698 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755451 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3c6efb43-250b-4db1-bd62-e87d1ee11077-snapshots\") pod \"insights-operator-5c847dcfc4-g9hm4\" (UID: \"3c6efb43-250b-4db1-bd62-e87d1ee11077\") " pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" Jul 07 18:23:20.755698 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755497 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-default-certificate\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:20.755698 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755444 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b8491d42-ab30-44db-a098-d51bb210dbeb-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-vtgpm\" (UID: \"b8491d42-ab30-44db-a098-d51bb210dbeb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vtgpm" Jul 07 18:23:20.755698 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755520 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-certificates\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.755698 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755567 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78rmx\" (UniqueName: \"kubernetes.io/projected/b8491d42-ab30-44db-a098-d51bb210dbeb-kube-api-access-78rmx\") pod \"kube-storage-version-migrator-operator-846bf668f7-vtgpm\" (UID: \"b8491d42-ab30-44db-a098-d51bb210dbeb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vtgpm" Jul 07 18:23:20.756365 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755605 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c6efb43-250b-4db1-bd62-e87d1ee11077-tmp\") pod \"insights-operator-5c847dcfc4-g9hm4\" (UID: \"3c6efb43-250b-4db1-bd62-e87d1ee11077\") " pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" Jul 07 18:23:20.756365 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755664 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-tmp-dir\") pod \"dns-default-42kxz\" (UID: \"a2602fe9-e2fe-47bb-88b7-cab17f6659f3\") " pod="openshift-dns/dns-default-42kxz" Jul 07 18:23:20.756365 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755727 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfsb2\" (UniqueName: \"kubernetes.io/projected/8c2b4679-fdf3-4fdc-862d-89b27f73a954-kube-api-access-xfsb2\") pod \"cluster-samples-operator-56fcf86bf-jf97s\" (UID: \"8c2b4679-fdf3-4fdc-862d-89b27f73a954\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jf97s" Jul 07 18:23:20.756365 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755754 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f5c769ba-6ad9-4cf7-94e5-4a7dbab806cc-config\") pod \"service-ca-operator-5d46d9ffd4-4trkp\" (UID: \"f5c769ba-6ad9-4cf7-94e5-4a7dbab806cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4trkp" Jul 07 18:23:20.756365 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755754 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctb9t\" (UniqueName: \"kubernetes.io/projected/d442645e-7222-46af-9914-bb615255b0d5-kube-api-access-ctb9t\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:20.756365 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755802 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c6efb43-250b-4db1-bd62-e87d1ee11077-serving-cert\") pod \"insights-operator-5c847dcfc4-g9hm4\" (UID: \"3c6efb43-250b-4db1-bd62-e87d1ee11077\") " pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" Jul 07 18:23:20.756365 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755840 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7-config\") pod \"console-operator-68b757fb67-c8qbd\" (UID: \"f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7\") " pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" Jul 07 18:23:20.756365 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755875 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cdd04634-6641-4959-b079-f96dc848fbda-cert\") pod \"ingress-canary-grchh\" (UID: \"cdd04634-6641-4959-b079-f96dc848fbda\") " pod="openshift-ingress-canary/ingress-canary-grchh" Jul 07 18:23:20.756365 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755934 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/94120e3a-209a-4ca3-8807-6e0e759f4c48-image-registry-private-configuration\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.756365 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.755992 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7-trusted-ca\") pod \"console-operator-68b757fb67-c8qbd\" (UID: \"f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7\") " pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" Jul 07 18:23:20.756365 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.756042 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/94120e3a-209a-4ca3-8807-6e0e759f4c48-installation-pull-secrets\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.756365 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.756159 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/965e4f40-8930-40a0-9ba0-b075c40d5a0d-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-bbc47\" (UID: \"965e4f40-8930-40a0-9ba0-b075c40d5a0d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bbc47" Jul 07 18:23:20.756365 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.756174 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bj5l\" (UniqueName: \"kubernetes.io/projected/cdd04634-6641-4959-b079-f96dc848fbda-kube-api-access-4bj5l\") pod \"ingress-canary-grchh\" (UID: \"cdd04634-6641-4959-b079-f96dc848fbda\") " pod="openshift-ingress-canary/ingress-canary-grchh" Jul 07 18:23:20.756365 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.756205 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c2b4679-fdf3-4fdc-862d-89b27f73a954-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-jf97s\" (UID: \"8c2b4679-fdf3-4fdc-862d-89b27f73a954\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jf97s" Jul 07 18:23:20.756365 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.756228 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-metrics-tls\") pod \"dns-default-42kxz\" (UID: \"a2602fe9-e2fe-47bb-88b7-cab17f6659f3\") " pod="openshift-dns/dns-default-42kxz" Jul 07 18:23:20.756365 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.756251 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbjgx\" (UniqueName: \"kubernetes.io/projected/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-kube-api-access-nbjgx\") pod \"dns-default-42kxz\" (UID: \"a2602fe9-e2fe-47bb-88b7-cab17f6659f3\") " pod="openshift-dns/dns-default-42kxz" Jul 07 18:23:20.757102 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.756285 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nf2z\" (UniqueName: \"kubernetes.io/projected/f5c769ba-6ad9-4cf7-94e5-4a7dbab806cc-kube-api-access-4nf2z\") pod \"service-ca-operator-5d46d9ffd4-4trkp\" (UID: \"f5c769ba-6ad9-4cf7-94e5-4a7dbab806cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4trkp" Jul 07 18:23:20.757102 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:20.756329 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 18:23:20.757102 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:20.756395 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2b4679-fdf3-4fdc-862d-89b27f73a954-samples-operator-tls podName:8c2b4679-fdf3-4fdc-862d-89b27f73a954 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:21.256368816 +0000 UTC m=+42.387020835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8c2b4679-fdf3-4fdc-862d-89b27f73a954-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-jf97s" (UID: "8c2b4679-fdf3-4fdc-862d-89b27f73a954") : secret "samples-operator-tls" not found Jul 07 18:23:20.757102 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.756522 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7-config\") pod \"console-operator-68b757fb67-c8qbd\" (UID: \"f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7\") " pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" Jul 07 18:23:20.757102 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.756956 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7-trusted-ca\") pod \"console-operator-68b757fb67-c8qbd\" (UID: \"f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7\") " pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" Jul 07 18:23:20.759035 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.759009 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f5c769ba-6ad9-4cf7-94e5-4a7dbab806cc-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-4trkp\" (UID: \"f5c769ba-6ad9-4cf7-94e5-4a7dbab806cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4trkp" Jul 07 18:23:20.759127 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.759010 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8491d42-ab30-44db-a098-d51bb210dbeb-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-vtgpm\" (UID: \"b8491d42-ab30-44db-a098-d51bb210dbeb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vtgpm" Jul 07 18:23:20.759127 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.759035 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7-serving-cert\") pod \"console-operator-68b757fb67-c8qbd\" (UID: \"f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7\") " pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" Jul 07 18:23:20.768156 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.768121 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gv76\" (UniqueName: \"kubernetes.io/projected/965e4f40-8930-40a0-9ba0-b075c40d5a0d-kube-api-access-2gv76\") pod \"cluster-monitoring-operator-64786d9cbb-bbc47\" (UID: \"965e4f40-8930-40a0-9ba0-b075c40d5a0d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bbc47" Jul 07 18:23:20.768571 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.768548 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78rmx\" (UniqueName: \"kubernetes.io/projected/b8491d42-ab30-44db-a098-d51bb210dbeb-kube-api-access-78rmx\") pod \"kube-storage-version-migrator-operator-846bf668f7-vtgpm\" (UID: \"b8491d42-ab30-44db-a098-d51bb210dbeb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vtgpm" Jul 07 18:23:20.769101 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.769071 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd6m5\" (UniqueName: \"kubernetes.io/projected/e19ae2f0-2899-434d-bc06-dd4a3dabd4fc-kube-api-access-rd6m5\") pod \"volume-data-source-validator-5d456fdbcd-zcjct\" (UID: \"e19ae2f0-2899-434d-bc06-dd4a3dabd4fc\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zcjct" Jul 07 18:23:20.769167 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.769097 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nf2z\" (UniqueName: \"kubernetes.io/projected/f5c769ba-6ad9-4cf7-94e5-4a7dbab806cc-kube-api-access-4nf2z\") pod \"service-ca-operator-5d46d9ffd4-4trkp\" (UID: \"f5c769ba-6ad9-4cf7-94e5-4a7dbab806cc\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4trkp" Jul 07 18:23:20.769220 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.769202 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfsb2\" (UniqueName: \"kubernetes.io/projected/8c2b4679-fdf3-4fdc-862d-89b27f73a954-kube-api-access-xfsb2\") pod \"cluster-samples-operator-56fcf86bf-jf97s\" (UID: \"8c2b4679-fdf3-4fdc-862d-89b27f73a954\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jf97s" Jul 07 18:23:20.769667 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.769651 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q82h9\" (UniqueName: \"kubernetes.io/projected/f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7-kube-api-access-q82h9\") pod \"console-operator-68b757fb67-c8qbd\" (UID: \"f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7\") " pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" Jul 07 18:23:20.789490 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.789450 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4trkp" Jul 07 18:23:20.823531 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.823508 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vtgpm" Jul 07 18:23:20.843553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.843531 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zcjct" Jul 07 18:23:20.857297 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.857279 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-config-volume\") pod \"dns-default-42kxz\" (UID: \"a2602fe9-e2fe-47bb-88b7-cab17f6659f3\") " pod="openshift-dns/dns-default-42kxz" Jul 07 18:23:20.857361 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.857305 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.857361 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.857326 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgtm5\" (UniqueName: \"kubernetes.io/projected/3c6efb43-250b-4db1-bd62-e87d1ee11077-kube-api-access-vgtm5\") pod \"insights-operator-5c847dcfc4-g9hm4\" (UID: \"3c6efb43-250b-4db1-bd62-e87d1ee11077\") " pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" Jul 07 18:23:20.857361 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.857343 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-stats-auth\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:20.857361 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.857361 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/94120e3a-209a-4ca3-8807-6e0e759f4c48-ca-trust-extracted\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.857595 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.857377 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3c6efb43-250b-4db1-bd62-e87d1ee11077-snapshots\") pod \"insights-operator-5c847dcfc4-g9hm4\" (UID: \"3c6efb43-250b-4db1-bd62-e87d1ee11077\") " pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" Jul 07 18:23:20.857595 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:20.857441 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 18:23:20.857595 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:20.857481 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f77fd79ff-zf7d7: secret "image-registry-tls" not found Jul 07 18:23:20.857595 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:20.857543 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls podName:94120e3a-209a-4ca3-8807-6e0e759f4c48 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:21.357524743 +0000 UTC m=+42.488176747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls") pod "image-registry-f77fd79ff-zf7d7" (UID: "94120e3a-209a-4ca3-8807-6e0e759f4c48") : secret "image-registry-tls" not found Jul 07 18:23:20.857811 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.857682 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-default-certificate\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:20.857811 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.857722 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-certificates\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.857811 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.857756 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c6efb43-250b-4db1-bd62-e87d1ee11077-tmp\") pod \"insights-operator-5c847dcfc4-g9hm4\" (UID: \"3c6efb43-250b-4db1-bd62-e87d1ee11077\") " pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" Jul 07 18:23:20.857811 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.857775 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/94120e3a-209a-4ca3-8807-6e0e759f4c48-ca-trust-extracted\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.857811 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.857784 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-tmp-dir\") pod \"dns-default-42kxz\" (UID: \"a2602fe9-e2fe-47bb-88b7-cab17f6659f3\") " pod="openshift-dns/dns-default-42kxz" Jul 07 18:23:20.858049 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.857837 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctb9t\" (UniqueName: \"kubernetes.io/projected/d442645e-7222-46af-9914-bb615255b0d5-kube-api-access-ctb9t\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:20.858049 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.857863 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c6efb43-250b-4db1-bd62-e87d1ee11077-serving-cert\") pod \"insights-operator-5c847dcfc4-g9hm4\" (UID: \"3c6efb43-250b-4db1-bd62-e87d1ee11077\") " pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" Jul 07 18:23:20.858049 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.857889 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cdd04634-6641-4959-b079-f96dc848fbda-cert\") pod \"ingress-canary-grchh\" (UID: \"cdd04634-6641-4959-b079-f96dc848fbda\") " pod="openshift-ingress-canary/ingress-canary-grchh" Jul 07 18:23:20.858049 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.857921 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/94120e3a-209a-4ca3-8807-6e0e759f4c48-image-registry-private-configuration\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.858049 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.857950 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/94120e3a-209a-4ca3-8807-6e0e759f4c48-installation-pull-secrets\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.858049 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.857995 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bj5l\" (UniqueName: \"kubernetes.io/projected/cdd04634-6641-4959-b079-f96dc848fbda-kube-api-access-4bj5l\") pod \"ingress-canary-grchh\" (UID: \"cdd04634-6641-4959-b079-f96dc848fbda\") " pod="openshift-ingress-canary/ingress-canary-grchh" Jul 07 18:23:20.858049 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.858030 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-tmp-dir\") pod \"dns-default-42kxz\" (UID: \"a2602fe9-e2fe-47bb-88b7-cab17f6659f3\") " pod="openshift-dns/dns-default-42kxz" Jul 07 18:23:20.858501 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.858035 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-metrics-tls\") pod \"dns-default-42kxz\" (UID: \"a2602fe9-e2fe-47bb-88b7-cab17f6659f3\") " pod="openshift-dns/dns-default-42kxz" Jul 07 18:23:20.858501 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.858067 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-config-volume\") pod \"dns-default-42kxz\" (UID: \"a2602fe9-e2fe-47bb-88b7-cab17f6659f3\") " pod="openshift-dns/dns-default-42kxz" Jul 07 18:23:20.858501 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.858089 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbjgx\" (UniqueName: \"kubernetes.io/projected/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-kube-api-access-nbjgx\") pod \"dns-default-42kxz\" (UID: \"a2602fe9-e2fe-47bb-88b7-cab17f6659f3\") " pod="openshift-dns/dns-default-42kxz" Jul 07 18:23:20.858501 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:20.858093 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 18:23:20.858501 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:20.858169 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-metrics-tls podName:a2602fe9-e2fe-47bb-88b7-cab17f6659f3 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:21.358153045 +0000 UTC m=+42.488805060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-metrics-tls") pod "dns-default-42kxz" (UID: "a2602fe9-e2fe-47bb-88b7-cab17f6659f3") : secret "dns-default-metrics-tls" not found Jul 07 18:23:20.858501 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.857923 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3c6efb43-250b-4db1-bd62-e87d1ee11077-snapshots\") pod \"insights-operator-5c847dcfc4-g9hm4\" (UID: \"3c6efb43-250b-4db1-bd62-e87d1ee11077\") " pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" Jul 07 18:23:20.858808 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.858613 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-certificates\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.858866 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.858829 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-metrics-certs\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:20.858921 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.858865 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qczxq\" (UniqueName: \"kubernetes.io/projected/09cbde25-7282-43a6-ae4a-95186fb6d720-kube-api-access-qczxq\") pod \"network-check-source-989f8b8dc-vwhkg\" (UID: \"09cbde25-7282-43a6-ae4a-95186fb6d720\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vwhkg" Jul 07 18:23:20.858921 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.858897 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-bound-sa-token\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.859013 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.858928 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zzb6\" (UniqueName: \"kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-kube-api-access-5zzb6\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.859013 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.858934 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c6efb43-250b-4db1-bd62-e87d1ee11077-tmp\") pod \"insights-operator-5c847dcfc4-g9hm4\" (UID: \"3c6efb43-250b-4db1-bd62-e87d1ee11077\") " pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" Jul 07 18:23:20.859013 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:20.858974 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 18:23:20.859013 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.859005 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94120e3a-209a-4ca3-8807-6e0e759f4c48-trusted-ca\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.859209 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:20.859039 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-metrics-certs podName:d442645e-7222-46af-9914-bb615255b0d5 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:21.359024023 +0000 UTC m=+42.489676036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-metrics-certs") pod "router-default-67c8dfcf49-w9wrf" (UID: "d442645e-7222-46af-9914-bb615255b0d5") : secret "router-metrics-certs-default" not found Jul 07 18:23:20.859209 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.859063 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c6efb43-250b-4db1-bd62-e87d1ee11077-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-g9hm4\" (UID: \"3c6efb43-250b-4db1-bd62-e87d1ee11077\") " pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" Jul 07 18:23:20.859209 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.859106 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c6efb43-250b-4db1-bd62-e87d1ee11077-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-g9hm4\" (UID: \"3c6efb43-250b-4db1-bd62-e87d1ee11077\") " pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" Jul 07 18:23:20.859209 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.859139 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-fhgs8\" (UID: \"5cd963e2-7b23-4a61-a73d-cbf757e7ea02\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fhgs8" Jul 07 18:23:20.859209 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.859165 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fhgs8\" (UID: \"5cd963e2-7b23-4a61-a73d-cbf757e7ea02\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fhgs8" Jul 07 18:23:20.859209 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.859192 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d442645e-7222-46af-9914-bb615255b0d5-service-ca-bundle\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:20.859519 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:20.859319 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d442645e-7222-46af-9914-bb615255b0d5-service-ca-bundle podName:d442645e-7222-46af-9914-bb615255b0d5 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:21.359303939 +0000 UTC m=+42.489955945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d442645e-7222-46af-9914-bb615255b0d5-service-ca-bundle") pod "router-default-67c8dfcf49-w9wrf" (UID: "d442645e-7222-46af-9914-bb615255b0d5") : configmap references non-existent config key: service-ca.crt Jul 07 18:23:20.859959 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.859869 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94120e3a-209a-4ca3-8807-6e0e759f4c48-trusted-ca\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.860207 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.860159 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-fhgs8\" (UID: \"5cd963e2-7b23-4a61-a73d-cbf757e7ea02\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fhgs8" Jul 07 18:23:20.860290 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.860211 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c6efb43-250b-4db1-bd62-e87d1ee11077-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-g9hm4\" (UID: \"3c6efb43-250b-4db1-bd62-e87d1ee11077\") " pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" Jul 07 18:23:20.860290 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:20.860268 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 18:23:20.860406 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:20.860316 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-networking-console-plugin-cert podName:5cd963e2-7b23-4a61-a73d-cbf757e7ea02 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:21.360299631 +0000 UTC m=+42.490951636 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fhgs8" (UID: "5cd963e2-7b23-4a61-a73d-cbf757e7ea02") : secret "networking-console-plugin-cert" not found Jul 07 18:23:20.860494 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.860422 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c6efb43-250b-4db1-bd62-e87d1ee11077-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-g9hm4\" (UID: \"3c6efb43-250b-4db1-bd62-e87d1ee11077\") " pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" Jul 07 18:23:20.860681 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.860662 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-default-certificate\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:20.861069 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.861045 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cdd04634-6641-4959-b079-f96dc848fbda-cert\") pod \"ingress-canary-grchh\" (UID: \"cdd04634-6641-4959-b079-f96dc848fbda\") " pod="openshift-ingress-canary/ingress-canary-grchh" Jul 07 18:23:20.861141 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.861121 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/94120e3a-209a-4ca3-8807-6e0e759f4c48-image-registry-private-configuration\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.861207 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.861189 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c6efb43-250b-4db1-bd62-e87d1ee11077-serving-cert\") pod \"insights-operator-5c847dcfc4-g9hm4\" (UID: \"3c6efb43-250b-4db1-bd62-e87d1ee11077\") " pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" Jul 07 18:23:20.861851 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.861830 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-stats-auth\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:20.862428 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.862406 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/94120e3a-209a-4ca3-8807-6e0e759f4c48-installation-pull-secrets\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.866385 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.866367 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgtm5\" (UniqueName: \"kubernetes.io/projected/3c6efb43-250b-4db1-bd62-e87d1ee11077-kube-api-access-vgtm5\") pod \"insights-operator-5c847dcfc4-g9hm4\" (UID: \"3c6efb43-250b-4db1-bd62-e87d1ee11077\") " pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" Jul 07 18:23:20.867366 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.867352 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbjgx\" (UniqueName: \"kubernetes.io/projected/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-kube-api-access-nbjgx\") pod \"dns-default-42kxz\" (UID: \"a2602fe9-e2fe-47bb-88b7-cab17f6659f3\") " pod="openshift-dns/dns-default-42kxz" Jul 07 18:23:20.869579 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.869557 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zzb6\" (UniqueName: \"kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-kube-api-access-5zzb6\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.870022 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.869999 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qczxq\" (UniqueName: \"kubernetes.io/projected/09cbde25-7282-43a6-ae4a-95186fb6d720-kube-api-access-qczxq\") pod \"network-check-source-989f8b8dc-vwhkg\" (UID: \"09cbde25-7282-43a6-ae4a-95186fb6d720\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vwhkg" Jul 07 18:23:20.871156 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.871131 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctb9t\" (UniqueName: \"kubernetes.io/projected/d442645e-7222-46af-9914-bb615255b0d5-kube-api-access-ctb9t\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:20.871473 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.871402 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" Jul 07 18:23:20.871771 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.871753 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bj5l\" (UniqueName: \"kubernetes.io/projected/cdd04634-6641-4959-b079-f96dc848fbda-kube-api-access-4bj5l\") pod \"ingress-canary-grchh\" (UID: \"cdd04634-6641-4959-b079-f96dc848fbda\") " pod="openshift-ingress-canary/ingress-canary-grchh" Jul 07 18:23:20.872325 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.872306 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-bound-sa-token\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:20.888472 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.888395 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" Jul 07 18:23:20.945854 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.945416 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vwhkg" Jul 07 18:23:20.956037 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:20.955853 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-grchh" Jul 07 18:23:21.010353 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:21.009555 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4trkp"] Jul 07 18:23:21.015250 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:21.012075 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vtgpm"] Jul 07 18:23:21.015520 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:23:21.015476 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c769ba_6ad9_4cf7_94e5_4a7dbab806cc.slice/crio-72ae65caec05eb6123d4a31b9fa69dc47eec3e73aaa1e2cd6c6e82b3753f087e WatchSource:0}: Error finding container 72ae65caec05eb6123d4a31b9fa69dc47eec3e73aaa1e2cd6c6e82b3753f087e: Status 404 returned error can't find the container with id 72ae65caec05eb6123d4a31b9fa69dc47eec3e73aaa1e2cd6c6e82b3753f087e Jul 07 18:23:21.081624 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:21.081550 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zcjct"] Jul 07 18:23:21.088422 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:23:21.088372 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode19ae2f0_2899_434d_bc06_dd4a3dabd4fc.slice/crio-d2047811b21b77c25f8f2c9a7f40b4abd41cbcc5adb6b0cf4c9e5a9dcb7f6345 WatchSource:0}: Error finding container d2047811b21b77c25f8f2c9a7f40b4abd41cbcc5adb6b0cf4c9e5a9dcb7f6345: Status 404 returned error can't find the container with id d2047811b21b77c25f8f2c9a7f40b4abd41cbcc5adb6b0cf4c9e5a9dcb7f6345 Jul 07 18:23:21.113074 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:21.113048 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-c8qbd"] Jul 07 18:23:21.115838 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:23:21.115795 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4b3e4d6_d81a_4a6b_8e38_4aeb71fa4bc7.slice/crio-5745792fb2ec0958fb6d65aa6a71f6b8fb08b88a67ce0c9d87ee269b740b5b35 WatchSource:0}: Error finding container 5745792fb2ec0958fb6d65aa6a71f6b8fb08b88a67ce0c9d87ee269b740b5b35: Status 404 returned error can't find the container with id 5745792fb2ec0958fb6d65aa6a71f6b8fb08b88a67ce0c9d87ee269b740b5b35 Jul 07 18:23:21.137059 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:21.137024 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-g9hm4"] Jul 07 18:23:21.139841 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:23:21.139816 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c6efb43_250b_4db1_bd62_e87d1ee11077.slice/crio-d15a08d7251f11907ac62e7869e2f6b6f84451db87c4f4c858a23a8cc396963b WatchSource:0}: Error finding container d15a08d7251f11907ac62e7869e2f6b6f84451db87c4f4c858a23a8cc396963b: Status 404 returned error can't find the container with id d15a08d7251f11907ac62e7869e2f6b6f84451db87c4f4c858a23a8cc396963b Jul 07 18:23:21.154828 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:21.154806 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-vwhkg"] Jul 07 18:23:21.157532 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:23:21.157508 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09cbde25_7282_43a6_ae4a_95186fb6d720.slice/crio-5cc2c8f7104f926eecf576d1f785d71f9a07c35d2fdeb0c5c055de0766e2f143 WatchSource:0}: Error finding container 5cc2c8f7104f926eecf576d1f785d71f9a07c35d2fdeb0c5c055de0766e2f143: Status 404 returned error can't find the container with id 5cc2c8f7104f926eecf576d1f785d71f9a07c35d2fdeb0c5c055de0766e2f143 Jul 07 18:23:21.171069 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:21.171040 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-grchh"] Jul 07 18:23:21.175999 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:23:21.175976 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdd04634_6641_4959_b079_f96dc848fbda.slice/crio-5cd42d5d8505f58d68bd6a633174e4b9dbc3566065360259f3e1b4aadedcd100 WatchSource:0}: Error finding container 5cd42d5d8505f58d68bd6a633174e4b9dbc3566065360259f3e1b4aadedcd100: Status 404 returned error can't find the container with id 5cd42d5d8505f58d68bd6a633174e4b9dbc3566065360259f3e1b4aadedcd100 Jul 07 18:23:21.264122 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:21.264055 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c2b4679-fdf3-4fdc-862d-89b27f73a954-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-jf97s\" (UID: \"8c2b4679-fdf3-4fdc-862d-89b27f73a954\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jf97s" Jul 07 18:23:21.264122 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:21.264114 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/965e4f40-8930-40a0-9ba0-b075c40d5a0d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bbc47\" (UID: \"965e4f40-8930-40a0-9ba0-b075c40d5a0d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bbc47" Jul 07 18:23:21.264265 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:21.264198 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 18:23:21.264265 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:21.264240 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 18:23:21.264265 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:21.264255 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2b4679-fdf3-4fdc-862d-89b27f73a954-samples-operator-tls podName:8c2b4679-fdf3-4fdc-862d-89b27f73a954 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:22.264242532 +0000 UTC m=+43.394894533 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8c2b4679-fdf3-4fdc-862d-89b27f73a954-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-jf97s" (UID: "8c2b4679-fdf3-4fdc-862d-89b27f73a954") : secret "samples-operator-tls" not found Jul 07 18:23:21.264356 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:21.264280 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/965e4f40-8930-40a0-9ba0-b075c40d5a0d-cluster-monitoring-operator-tls podName:965e4f40-8930-40a0-9ba0-b075c40d5a0d nodeName:}" failed. No retries permitted until 2026-07-07 18:23:22.264269095 +0000 UTC m=+43.394921095 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/965e4f40-8930-40a0-9ba0-b075c40d5a0d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-bbc47" (UID: "965e4f40-8930-40a0-9ba0-b075c40d5a0d") : secret "cluster-monitoring-operator-tls" not found Jul 07 18:23:21.364963 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:21.364929 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-metrics-tls\") pod \"dns-default-42kxz\" (UID: \"a2602fe9-e2fe-47bb-88b7-cab17f6659f3\") " pod="openshift-dns/dns-default-42kxz" Jul 07 18:23:21.365124 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:21.364970 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-metrics-certs\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:21.365124 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:21.365072 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 18:23:21.365124 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:21.365078 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 18:23:21.365124 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:21.365120 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-metrics-certs podName:d442645e-7222-46af-9914-bb615255b0d5 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:22.365107115 +0000 UTC m=+43.495759116 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-metrics-certs") pod "router-default-67c8dfcf49-w9wrf" (UID: "d442645e-7222-46af-9914-bb615255b0d5") : secret "router-metrics-certs-default" not found Jul 07 18:23:21.365266 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:21.365194 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-metrics-tls podName:a2602fe9-e2fe-47bb-88b7-cab17f6659f3 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:22.365174302 +0000 UTC m=+43.495826304 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-metrics-tls") pod "dns-default-42kxz" (UID: "a2602fe9-e2fe-47bb-88b7-cab17f6659f3") : secret "dns-default-metrics-tls" not found Jul 07 18:23:21.365266 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:21.365237 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fhgs8\" (UID: \"5cd963e2-7b23-4a61-a73d-cbf757e7ea02\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fhgs8" Jul 07 18:23:21.365266 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:21.365261 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d442645e-7222-46af-9914-bb615255b0d5-service-ca-bundle\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:21.365373 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:21.365289 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:21.365373 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:21.365353 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 18:23:21.365438 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:21.365386 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d442645e-7222-46af-9914-bb615255b0d5-service-ca-bundle podName:d442645e-7222-46af-9914-bb615255b0d5 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:22.365371984 +0000 UTC m=+43.496024000 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d442645e-7222-46af-9914-bb615255b0d5-service-ca-bundle") pod "router-default-67c8dfcf49-w9wrf" (UID: "d442645e-7222-46af-9914-bb615255b0d5") : configmap references non-existent config key: service-ca.crt Jul 07 18:23:21.365438 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:21.365402 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-networking-console-plugin-cert podName:5cd963e2-7b23-4a61-a73d-cbf757e7ea02 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:22.365395851 +0000 UTC m=+43.496047852 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fhgs8" (UID: "5cd963e2-7b23-4a61-a73d-cbf757e7ea02") : secret "networking-console-plugin-cert" not found Jul 07 18:23:21.365438 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:21.365404 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 18:23:21.365438 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:21.365416 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f77fd79ff-zf7d7: secret "image-registry-tls" not found Jul 07 18:23:21.365596 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:21.365443 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls podName:94120e3a-209a-4ca3-8807-6e0e759f4c48 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:22.365435845 +0000 UTC m=+43.496087846 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls") pod "image-registry-f77fd79ff-zf7d7" (UID: "94120e3a-209a-4ca3-8807-6e0e759f4c48") : secret "image-registry-tls" not found Jul 07 18:23:21.385113 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:21.385087 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-grchh" event={"ID":"cdd04634-6641-4959-b079-f96dc848fbda","Type":"ContainerStarted","Data":"5cd42d5d8505f58d68bd6a633174e4b9dbc3566065360259f3e1b4aadedcd100"} Jul 07 18:23:21.386179 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:21.386158 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" event={"ID":"f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7","Type":"ContainerStarted","Data":"5745792fb2ec0958fb6d65aa6a71f6b8fb08b88a67ce0c9d87ee269b740b5b35"} Jul 07 18:23:21.389070 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:21.389046 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ftjp9" event={"ID":"b72940a4-d68a-4aa5-83ee-375e8bae5918","Type":"ContainerStarted","Data":"e57c8aae8cf8a2b3bdf9b3691a14cb6ca3eeb4d4752360b5ba76b77488bb5692"} Jul 07 18:23:21.390100 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:21.390081 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vwhkg" event={"ID":"09cbde25-7282-43a6-ae4a-95186fb6d720","Type":"ContainerStarted","Data":"5cc2c8f7104f926eecf576d1f785d71f9a07c35d2fdeb0c5c055de0766e2f143"} Jul 07 18:23:21.391088 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:21.391068 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" event={"ID":"3c6efb43-250b-4db1-bd62-e87d1ee11077","Type":"ContainerStarted","Data":"d15a08d7251f11907ac62e7869e2f6b6f84451db87c4f4c858a23a8cc396963b"} Jul 07 18:23:21.392130 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:21.392096 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zcjct" event={"ID":"e19ae2f0-2899-434d-bc06-dd4a3dabd4fc","Type":"ContainerStarted","Data":"d2047811b21b77c25f8f2c9a7f40b4abd41cbcc5adb6b0cf4c9e5a9dcb7f6345"} Jul 07 18:23:21.393232 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:21.393204 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vtgpm" event={"ID":"b8491d42-ab30-44db-a098-d51bb210dbeb","Type":"ContainerStarted","Data":"b9fea7f643c04a2583c9a72a76ed9bf85905caa65a8815b35206e952cccb9438"} Jul 07 18:23:21.394188 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:21.394171 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4trkp" event={"ID":"f5c769ba-6ad9-4cf7-94e5-4a7dbab806cc","Type":"ContainerStarted","Data":"72ae65caec05eb6123d4a31b9fa69dc47eec3e73aaa1e2cd6c6e82b3753f087e"} Jul 07 18:23:21.411949 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:21.411910 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ftjp9" podStartSLOduration=9.110076877 podStartE2EDuration="41.411896344s" totalImagesPullingTime="32.301819467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:22:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:23:21.410691412 +0000 UTC m=+42.541343436" watchObservedRunningTime="2026-07-07 18:23:21.411896344 +0000 UTC m=+42.542548367" Jul 07 18:23:22.185627 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:22.185590 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:23:22.185819 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:22.185590 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:23:22.185819 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:22.185771 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:23:22.192219 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:22.192192 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 18:23:22.192527 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:22.192508 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dxsjk\"" Jul 07 18:23:22.192600 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:22.192567 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 18:23:22.192678 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:22.192613 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wxf5l\"" Jul 07 18:23:22.275391 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:22.275353 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c2b4679-fdf3-4fdc-862d-89b27f73a954-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-jf97s\" (UID: \"8c2b4679-fdf3-4fdc-862d-89b27f73a954\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jf97s" Jul 07 18:23:22.275641 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:22.275468 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/965e4f40-8930-40a0-9ba0-b075c40d5a0d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bbc47\" (UID: \"965e4f40-8930-40a0-9ba0-b075c40d5a0d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bbc47" Jul 07 18:23:22.275711 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:22.275656 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 18:23:22.275764 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:22.275717 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/965e4f40-8930-40a0-9ba0-b075c40d5a0d-cluster-monitoring-operator-tls podName:965e4f40-8930-40a0-9ba0-b075c40d5a0d nodeName:}" failed. No retries permitted until 2026-07-07 18:23:24.275698834 +0000 UTC m=+45.406350849 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/965e4f40-8930-40a0-9ba0-b075c40d5a0d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-bbc47" (UID: "965e4f40-8930-40a0-9ba0-b075c40d5a0d") : secret "cluster-monitoring-operator-tls" not found Jul 07 18:23:22.276209 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:22.276125 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 18:23:22.276209 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:22.276176 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2b4679-fdf3-4fdc-862d-89b27f73a954-samples-operator-tls podName:8c2b4679-fdf3-4fdc-862d-89b27f73a954 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:24.276161426 +0000 UTC m=+45.406813430 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8c2b4679-fdf3-4fdc-862d-89b27f73a954-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-jf97s" (UID: "8c2b4679-fdf3-4fdc-862d-89b27f73a954") : secret "samples-operator-tls" not found Jul 07 18:23:22.376012 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:22.375981 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fhgs8\" (UID: \"5cd963e2-7b23-4a61-a73d-cbf757e7ea02\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fhgs8" Jul 07 18:23:22.376175 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:22.376020 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d442645e-7222-46af-9914-bb615255b0d5-service-ca-bundle\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:22.376175 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:22.376055 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:22.376175 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:22.376131 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-metrics-tls\") pod \"dns-default-42kxz\" (UID: \"a2602fe9-e2fe-47bb-88b7-cab17f6659f3\") " pod="openshift-dns/dns-default-42kxz" Jul 07 18:23:22.376175 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:22.376170 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-metrics-certs\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:22.376384 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:22.376170 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 18:23:22.376384 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:22.376224 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d442645e-7222-46af-9914-bb615255b0d5-service-ca-bundle podName:d442645e-7222-46af-9914-bb615255b0d5 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:24.376203751 +0000 UTC m=+45.506855772 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d442645e-7222-46af-9914-bb615255b0d5-service-ca-bundle") pod "router-default-67c8dfcf49-w9wrf" (UID: "d442645e-7222-46af-9914-bb615255b0d5") : configmap references non-existent config key: service-ca.crt Jul 07 18:23:22.376384 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:22.376249 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-networking-console-plugin-cert podName:5cd963e2-7b23-4a61-a73d-cbf757e7ea02 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:24.376239377 +0000 UTC m=+45.506891388 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fhgs8" (UID: "5cd963e2-7b23-4a61-a73d-cbf757e7ea02") : secret "networking-console-plugin-cert" not found Jul 07 18:23:22.376384 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:22.376284 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 18:23:22.376384 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:22.376306 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 18:23:22.376384 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:22.376327 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-metrics-certs podName:d442645e-7222-46af-9914-bb615255b0d5 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:24.376312084 +0000 UTC m=+45.506964094 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-metrics-certs") pod "router-default-67c8dfcf49-w9wrf" (UID: "d442645e-7222-46af-9914-bb615255b0d5") : secret "router-metrics-certs-default" not found Jul 07 18:23:22.376384 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:22.376230 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 18:23:22.376384 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:22.376344 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f77fd79ff-zf7d7: secret "image-registry-tls" not found Jul 07 18:23:22.376384 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:22.376381 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls podName:94120e3a-209a-4ca3-8807-6e0e759f4c48 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:24.376365989 +0000 UTC m=+45.507017995 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls") pod "image-registry-f77fd79ff-zf7d7" (UID: "94120e3a-209a-4ca3-8807-6e0e759f4c48") : secret "image-registry-tls" not found Jul 07 18:23:22.376856 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:22.376409 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-metrics-tls podName:a2602fe9-e2fe-47bb-88b7-cab17f6659f3 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:24.376399315 +0000 UTC m=+45.507051318 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-metrics-tls") pod "dns-default-42kxz" (UID: "a2602fe9-e2fe-47bb-88b7-cab17f6659f3") : secret "dns-default-metrics-tls" not found Jul 07 18:23:24.297892 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:24.297698 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c2b4679-fdf3-4fdc-862d-89b27f73a954-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-jf97s\" (UID: \"8c2b4679-fdf3-4fdc-862d-89b27f73a954\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jf97s" Jul 07 18:23:24.298322 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:24.297943 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/965e4f40-8930-40a0-9ba0-b075c40d5a0d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bbc47\" (UID: \"965e4f40-8930-40a0-9ba0-b075c40d5a0d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bbc47" Jul 07 18:23:24.298322 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:24.297852 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 18:23:24.298322 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:24.298012 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2b4679-fdf3-4fdc-862d-89b27f73a954-samples-operator-tls podName:8c2b4679-fdf3-4fdc-862d-89b27f73a954 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:28.297996227 +0000 UTC m=+49.428648233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8c2b4679-fdf3-4fdc-862d-89b27f73a954-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-jf97s" (UID: "8c2b4679-fdf3-4fdc-862d-89b27f73a954") : secret "samples-operator-tls" not found Jul 07 18:23:24.298322 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:24.298079 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 18:23:24.298322 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:24.298136 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/965e4f40-8930-40a0-9ba0-b075c40d5a0d-cluster-monitoring-operator-tls podName:965e4f40-8930-40a0-9ba0-b075c40d5a0d nodeName:}" failed. No retries permitted until 2026-07-07 18:23:28.298119937 +0000 UTC m=+49.428771954 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/965e4f40-8930-40a0-9ba0-b075c40d5a0d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-bbc47" (UID: "965e4f40-8930-40a0-9ba0-b075c40d5a0d") : secret "cluster-monitoring-operator-tls" not found Jul 07 18:23:24.399206 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:24.399170 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-metrics-certs\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:24.399376 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:24.399257 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fhgs8\" (UID: \"5cd963e2-7b23-4a61-a73d-cbf757e7ea02\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fhgs8" Jul 07 18:23:24.399376 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:24.399280 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d442645e-7222-46af-9914-bb615255b0d5-service-ca-bundle\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:24.399376 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:24.399310 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:24.399557 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:24.399391 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-metrics-tls\") pod \"dns-default-42kxz\" (UID: \"a2602fe9-e2fe-47bb-88b7-cab17f6659f3\") " pod="openshift-dns/dns-default-42kxz" Jul 07 18:23:24.399557 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:24.399550 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 18:23:24.399662 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:24.399616 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-metrics-tls podName:a2602fe9-e2fe-47bb-88b7-cab17f6659f3 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:28.399598304 +0000 UTC m=+49.530250308 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-metrics-tls") pod "dns-default-42kxz" (UID: "a2602fe9-e2fe-47bb-88b7-cab17f6659f3") : secret "dns-default-metrics-tls" not found Jul 07 18:23:24.399831 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:24.399807 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 18:23:24.399937 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:24.399836 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 18:23:24.399937 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:24.399844 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d442645e-7222-46af-9914-bb615255b0d5-service-ca-bundle podName:d442645e-7222-46af-9914-bb615255b0d5 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:28.399826293 +0000 UTC m=+49.530478307 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d442645e-7222-46af-9914-bb615255b0d5-service-ca-bundle") pod "router-default-67c8dfcf49-w9wrf" (UID: "d442645e-7222-46af-9914-bb615255b0d5") : configmap references non-existent config key: service-ca.crt Jul 07 18:23:24.399937 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:24.399900 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 18:23:24.399937 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:24.399917 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f77fd79ff-zf7d7: secret "image-registry-tls" not found Jul 07 18:23:24.399937 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:24.399924 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-metrics-certs podName:d442645e-7222-46af-9914-bb615255b0d5 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:28.399908046 +0000 UTC m=+49.530560054 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-metrics-certs") pod "router-default-67c8dfcf49-w9wrf" (UID: "d442645e-7222-46af-9914-bb615255b0d5") : secret "router-metrics-certs-default" not found Jul 07 18:23:24.400369 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:24.399941 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-networking-console-plugin-cert podName:5cd963e2-7b23-4a61-a73d-cbf757e7ea02 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:28.399930103 +0000 UTC m=+49.530582110 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fhgs8" (UID: "5cd963e2-7b23-4a61-a73d-cbf757e7ea02") : secret "networking-console-plugin-cert" not found Jul 07 18:23:24.400369 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:24.399961 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls podName:94120e3a-209a-4ca3-8807-6e0e759f4c48 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:28.399953589 +0000 UTC m=+49.530605591 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls") pod "image-registry-f77fd79ff-zf7d7" (UID: "94120e3a-209a-4ca3-8807-6e0e759f4c48") : secret "image-registry-tls" not found Jul 07 18:23:24.409250 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:24.409194 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zcjct" event={"ID":"e19ae2f0-2899-434d-bc06-dd4a3dabd4fc","Type":"ContainerStarted","Data":"e91146beccd0a54d37278379cafd72e97cb8f2b53f7b344a5a67bd95990f967d"} Jul 07 18:23:24.430028 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:24.429984 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zcjct" podStartSLOduration=21.06355188 podStartE2EDuration="23.429969242s" totalImagesPullingTime="2.366417362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:23:24.428953018 +0000 UTC m=+45.559605041" watchObservedRunningTime="2026-07-07 18:23:24.429969242 +0000 UTC m=+45.560621242" Jul 07 18:23:28.332548 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:28.332507 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c2b4679-fdf3-4fdc-862d-89b27f73a954-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-jf97s\" (UID: \"8c2b4679-fdf3-4fdc-862d-89b27f73a954\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jf97s" Jul 07 18:23:28.333215 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:28.332603 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/965e4f40-8930-40a0-9ba0-b075c40d5a0d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bbc47\" (UID: \"965e4f40-8930-40a0-9ba0-b075c40d5a0d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bbc47" Jul 07 18:23:28.333215 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:28.332679 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 18:23:28.333215 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:28.332774 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2b4679-fdf3-4fdc-862d-89b27f73a954-samples-operator-tls podName:8c2b4679-fdf3-4fdc-862d-89b27f73a954 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:36.332751191 +0000 UTC m=+57.463403192 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8c2b4679-fdf3-4fdc-862d-89b27f73a954-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-jf97s" (UID: "8c2b4679-fdf3-4fdc-862d-89b27f73a954") : secret "samples-operator-tls" not found Jul 07 18:23:28.333215 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:28.332812 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 18:23:28.333215 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:28.332881 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/965e4f40-8930-40a0-9ba0-b075c40d5a0d-cluster-monitoring-operator-tls podName:965e4f40-8930-40a0-9ba0-b075c40d5a0d nodeName:}" failed. No retries permitted until 2026-07-07 18:23:36.332864635 +0000 UTC m=+57.463516662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/965e4f40-8930-40a0-9ba0-b075c40d5a0d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-bbc47" (UID: "965e4f40-8930-40a0-9ba0-b075c40d5a0d") : secret "cluster-monitoring-operator-tls" not found Jul 07 18:23:28.433080 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:28.433050 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-metrics-tls\") pod \"dns-default-42kxz\" (UID: \"a2602fe9-e2fe-47bb-88b7-cab17f6659f3\") " pod="openshift-dns/dns-default-42kxz" Jul 07 18:23:28.433229 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:28.433099 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-metrics-certs\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:28.433229 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:28.433169 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fhgs8\" (UID: \"5cd963e2-7b23-4a61-a73d-cbf757e7ea02\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fhgs8" Jul 07 18:23:28.433229 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:28.433185 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 18:23:28.433229 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:28.433194 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d442645e-7222-46af-9914-bb615255b0d5-service-ca-bundle\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:28.433417 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:28.433239 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-metrics-tls podName:a2602fe9-e2fe-47bb-88b7-cab17f6659f3 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:36.433222091 +0000 UTC m=+57.563874094 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-metrics-tls") pod "dns-default-42kxz" (UID: "a2602fe9-e2fe-47bb-88b7-cab17f6659f3") : secret "dns-default-metrics-tls" not found Jul 07 18:23:28.433417 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:28.433258 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:28.433417 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:28.433272 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 18:23:28.433417 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:28.433305 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d442645e-7222-46af-9914-bb615255b0d5-service-ca-bundle podName:d442645e-7222-46af-9914-bb615255b0d5 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:36.433290448 +0000 UTC m=+57.563942449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d442645e-7222-46af-9914-bb615255b0d5-service-ca-bundle") pod "router-default-67c8dfcf49-w9wrf" (UID: "d442645e-7222-46af-9914-bb615255b0d5") : configmap references non-existent config key: service-ca.crt Jul 07 18:23:28.433417 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:28.433270 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 18:23:28.433417 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:28.433329 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-networking-console-plugin-cert podName:5cd963e2-7b23-4a61-a73d-cbf757e7ea02 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:36.433318742 +0000 UTC m=+57.563970756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fhgs8" (UID: "5cd963e2-7b23-4a61-a73d-cbf757e7ea02") : secret "networking-console-plugin-cert" not found Jul 07 18:23:28.433417 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:28.433338 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 18:23:28.433417 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:28.433346 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f77fd79ff-zf7d7: secret "image-registry-tls" not found Jul 07 18:23:28.433417 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:28.433356 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-metrics-certs podName:d442645e-7222-46af-9914-bb615255b0d5 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:36.433340613 +0000 UTC m=+57.563992628 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-metrics-certs") pod "router-default-67c8dfcf49-w9wrf" (UID: "d442645e-7222-46af-9914-bb615255b0d5") : secret "router-metrics-certs-default" not found Jul 07 18:23:28.433417 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:28.433378 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls podName:94120e3a-209a-4ca3-8807-6e0e759f4c48 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:36.433367653 +0000 UTC m=+57.564019660 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls") pod "image-registry-f77fd79ff-zf7d7" (UID: "94120e3a-209a-4ca3-8807-6e0e759f4c48") : secret "image-registry-tls" not found Jul 07 18:23:29.425711 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:29.425672 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vtgpm" event={"ID":"b8491d42-ab30-44db-a098-d51bb210dbeb","Type":"ContainerStarted","Data":"a75ea1ee3c3a2bf06aafa846e2a952a46f02fecfedeb8597a3ad94c91388b260"} Jul 07 18:23:29.427208 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:29.427181 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4trkp" event={"ID":"f5c769ba-6ad9-4cf7-94e5-4a7dbab806cc","Type":"ContainerStarted","Data":"a7450c293ce8339d71ddcfab159d6351b66f82722abce0b0f088f6af4ad65c0c"} Jul 07 18:23:29.428828 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:29.428804 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-grchh" event={"ID":"cdd04634-6641-4959-b079-f96dc848fbda","Type":"ContainerStarted","Data":"654eaaf9e6be0e3b9836b83ca335ca79c8a0408bcb5302fea80d1c1126794efb"} Jul 07 18:23:29.430551 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:29.430531 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/0.log" Jul 07 18:23:29.430657 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:29.430569 2580 generic.go:356] "Generic (PLEG): container finished" podID="f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7" containerID="93f021adb3088254c207db4db5f20b249ea0b7f07252efdf06f2a4dcb9d694eb" exitCode=255 Jul 07 18:23:29.430722 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:29.430655 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" event={"ID":"f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7","Type":"ContainerDied","Data":"93f021adb3088254c207db4db5f20b249ea0b7f07252efdf06f2a4dcb9d694eb"} Jul 07 18:23:29.430809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:29.430795 2580 scope.go:117] "RemoveContainer" containerID="93f021adb3088254c207db4db5f20b249ea0b7f07252efdf06f2a4dcb9d694eb" Jul 07 18:23:29.432360 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:29.432310 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vwhkg" event={"ID":"09cbde25-7282-43a6-ae4a-95186fb6d720","Type":"ContainerStarted","Data":"61e18bcf79015aad5c03149aecba460d802a139e858f90b3aededbb9191456cf"} Jul 07 18:23:29.434225 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:29.434202 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" event={"ID":"3c6efb43-250b-4db1-bd62-e87d1ee11077","Type":"ContainerStarted","Data":"460894f91ff17eb9c71a2f459199c25602645d1f26d1999896dbedbddf9e0914"} Jul 07 18:23:29.447397 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:29.447360 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vtgpm" podStartSLOduration=20.955151359 podStartE2EDuration="28.44734867s" totalImagesPullingTime="7.492197311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:23:29.44663545 +0000 UTC m=+50.577287472" watchObservedRunningTime="2026-07-07 18:23:29.44734867 +0000 UTC m=+50.578000689" Jul 07 18:23:29.495698 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:29.495058 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4trkp" podStartSLOduration=20.990017169 podStartE2EDuration="28.495037775s" totalImagesPullingTime="7.505020606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:23:29.4646632 +0000 UTC m=+50.595315225" watchObservedRunningTime="2026-07-07 18:23:29.495037775 +0000 UTC m=+50.625689797" Jul 07 18:23:29.495837 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:29.495680 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" podStartSLOduration=21.108188033 podStartE2EDuration="28.49566749s" totalImagesPullingTime="7.387479457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:23:29.495310477 +0000 UTC m=+50.625962501" watchObservedRunningTime="2026-07-07 18:23:29.49566749 +0000 UTC m=+50.626319514" Jul 07 18:23:29.547293 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:29.547237 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-grchh" podStartSLOduration=2.189342673 podStartE2EDuration="9.547216337s" totalImagesPullingTime="7.357873664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:23:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:23:29.546472712 +0000 UTC m=+50.677124729" watchObservedRunningTime="2026-07-07 18:23:29.547216337 +0000 UTC m=+50.677868340" Jul 07 18:23:29.569599 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:29.569549 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vwhkg" podStartSLOduration=19.935635489 podStartE2EDuration="27.569535748s" totalImagesPullingTime="7.633900259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:23:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:23:29.566814113 +0000 UTC m=+50.697466149" watchObservedRunningTime="2026-07-07 18:23:29.569535748 +0000 UTC m=+50.700187817" Jul 07 18:23:29.995250 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:29.995218 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nlrr4"] Jul 07 18:23:30.014948 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.014915 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nlrr4"] Jul 07 18:23:30.015114 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.015062 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:30.018480 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.018444 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 18:23:30.018587 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.018505 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-62q56\"" Jul 07 18:23:30.019181 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.019166 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 18:23:30.052490 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.052450 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4wzj\" (UniqueName: \"kubernetes.io/projected/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-kube-api-access-d4wzj\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:30.052634 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.052513 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-crio-socket\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:30.052634 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.052555 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:30.052634 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.052587 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-data-volume\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:30.052796 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.052728 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:30.153669 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.153637 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:30.153844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.153701 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4wzj\" (UniqueName: \"kubernetes.io/projected/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-kube-api-access-d4wzj\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:30.153844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.153726 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-crio-socket\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:30.153844 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:30.153768 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 18:23:30.153844 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:30.153831 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-kube-rbac-proxy-cm podName:71a0ffb2-a8fc-4bd3-abc3-b56cd594349f nodeName:}" failed. No retries permitted until 2026-07-07 18:23:30.653812203 +0000 UTC m=+51.784464207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nlrr4" (UID: "71a0ffb2-a8fc-4bd3-abc3-b56cd594349f") : configmap "kube-rbac-proxy" not found Jul 07 18:23:30.154039 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.153898 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:30.154039 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.153939 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-crio-socket\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:30.154039 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.153958 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-data-volume\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:30.154039 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:30.154030 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 18:23:30.154175 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:30.154086 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-insights-runtime-extractor-tls podName:71a0ffb2-a8fc-4bd3-abc3-b56cd594349f nodeName:}" failed. No retries permitted until 2026-07-07 18:23:30.654069637 +0000 UTC m=+51.784721651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nlrr4" (UID: "71a0ffb2-a8fc-4bd3-abc3-b56cd594349f") : secret "insights-runtime-extractor-tls" not found Jul 07 18:23:30.154312 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.154295 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-data-volume\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:30.165106 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.165084 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4wzj\" (UniqueName: \"kubernetes.io/projected/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-kube-api-access-d4wzj\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:30.438625 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.438554 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/1.log" Jul 07 18:23:30.439170 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.438991 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/0.log" Jul 07 18:23:30.439170 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.439034 2580 generic.go:356] "Generic (PLEG): container finished" podID="f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7" containerID="c96451fe30a753511fa9b417e8fa9a9fe031b5ff1bf9a59d34ef308591a3a324" exitCode=255 Jul 07 18:23:30.439170 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.439135 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" event={"ID":"f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7","Type":"ContainerDied","Data":"c96451fe30a753511fa9b417e8fa9a9fe031b5ff1bf9a59d34ef308591a3a324"} Jul 07 18:23:30.439343 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.439186 2580 scope.go:117] "RemoveContainer" containerID="93f021adb3088254c207db4db5f20b249ea0b7f07252efdf06f2a4dcb9d694eb" Jul 07 18:23:30.439496 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.439472 2580 scope.go:117] "RemoveContainer" containerID="c96451fe30a753511fa9b417e8fa9a9fe031b5ff1bf9a59d34ef308591a3a324" Jul 07 18:23:30.439716 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:30.439687 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-c8qbd_openshift-console-operator(f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7)\"" pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" podUID="f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7" Jul 07 18:23:30.658940 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.658909 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:30.659099 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.658974 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:30.659099 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:30.659030 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 18:23:30.659099 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:30.659068 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 18:23:30.659099 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:30.659089 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-kube-rbac-proxy-cm podName:71a0ffb2-a8fc-4bd3-abc3-b56cd594349f nodeName:}" failed. No retries permitted until 2026-07-07 18:23:31.659075423 +0000 UTC m=+52.789727423 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nlrr4" (UID: "71a0ffb2-a8fc-4bd3-abc3-b56cd594349f") : configmap "kube-rbac-proxy" not found Jul 07 18:23:30.659244 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:30.659118 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-insights-runtime-extractor-tls podName:71a0ffb2-a8fc-4bd3-abc3-b56cd594349f nodeName:}" failed. No retries permitted until 2026-07-07 18:23:31.65910276 +0000 UTC m=+52.789754766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nlrr4" (UID: "71a0ffb2-a8fc-4bd3-abc3-b56cd594349f") : secret "insights-runtime-extractor-tls" not found Jul 07 18:23:30.872495 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.872446 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" Jul 07 18:23:30.872677 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:30.872509 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" Jul 07 18:23:31.444134 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:31.444106 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/1.log" Jul 07 18:23:31.444595 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:31.444429 2580 scope.go:117] "RemoveContainer" containerID="c96451fe30a753511fa9b417e8fa9a9fe031b5ff1bf9a59d34ef308591a3a324" Jul 07 18:23:31.444641 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:31.444604 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-c8qbd_openshift-console-operator(f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7)\"" pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" podUID="f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7" Jul 07 18:23:31.564400 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:31.564376 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lzcsf_f95b113a-076d-4c7d-ac0b-24de4955b5c2/dns-node-resolver/0.log" Jul 07 18:23:31.667784 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:31.667752 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:31.667949 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:31.667812 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:31.667949 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:31.667873 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 18:23:31.667949 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:31.667909 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 18:23:31.667949 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:31.667936 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-kube-rbac-proxy-cm podName:71a0ffb2-a8fc-4bd3-abc3-b56cd594349f nodeName:}" failed. No retries permitted until 2026-07-07 18:23:33.66792148 +0000 UTC m=+54.798573484 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nlrr4" (UID: "71a0ffb2-a8fc-4bd3-abc3-b56cd594349f") : configmap "kube-rbac-proxy" not found Jul 07 18:23:31.668111 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:31.667954 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-insights-runtime-extractor-tls podName:71a0ffb2-a8fc-4bd3-abc3-b56cd594349f nodeName:}" failed. No retries permitted until 2026-07-07 18:23:33.66794316 +0000 UTC m=+54.798595161 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nlrr4" (UID: "71a0ffb2-a8fc-4bd3-abc3-b56cd594349f") : secret "insights-runtime-extractor-tls" not found Jul 07 18:23:32.362752 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:32.362721 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rgkvn_51f0ab4e-9faa-4aa6-a6bf-5c7e3f69cd13/node-ca/0.log" Jul 07 18:23:32.447853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:32.447825 2580 scope.go:117] "RemoveContainer" containerID="c96451fe30a753511fa9b417e8fa9a9fe031b5ff1bf9a59d34ef308591a3a324" Jul 07 18:23:32.448217 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:32.447969 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-c8qbd_openshift-console-operator(f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7)\"" pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" podUID="f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7" Jul 07 18:23:33.153184 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:33.153149 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-grchh_cdd04634-6641-4959-b079-f96dc848fbda/serve-healthcheck-canary/0.log" Jul 07 18:23:33.685294 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:33.685255 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:33.685754 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:33.685403 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 18:23:33.685754 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:33.685423 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:33.685754 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:33.685486 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-insights-runtime-extractor-tls podName:71a0ffb2-a8fc-4bd3-abc3-b56cd594349f nodeName:}" failed. No retries permitted until 2026-07-07 18:23:37.685446706 +0000 UTC m=+58.816098707 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nlrr4" (UID: "71a0ffb2-a8fc-4bd3-abc3-b56cd594349f") : secret "insights-runtime-extractor-tls" not found Jul 07 18:23:33.685754 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:33.685523 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 18:23:33.685754 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:33.685577 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-kube-rbac-proxy-cm podName:71a0ffb2-a8fc-4bd3-abc3-b56cd594349f nodeName:}" failed. No retries permitted until 2026-07-07 18:23:37.685561928 +0000 UTC m=+58.816213930 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nlrr4" (UID: "71a0ffb2-a8fc-4bd3-abc3-b56cd594349f") : configmap "kube-rbac-proxy" not found Jul 07 18:23:36.411079 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:36.411040 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/965e4f40-8930-40a0-9ba0-b075c40d5a0d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bbc47\" (UID: \"965e4f40-8930-40a0-9ba0-b075c40d5a0d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bbc47" Jul 07 18:23:36.411540 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:36.411188 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 18:23:36.411540 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:36.411222 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c2b4679-fdf3-4fdc-862d-89b27f73a954-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-jf97s\" (UID: \"8c2b4679-fdf3-4fdc-862d-89b27f73a954\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jf97s" Jul 07 18:23:36.411540 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:36.411256 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/965e4f40-8930-40a0-9ba0-b075c40d5a0d-cluster-monitoring-operator-tls podName:965e4f40-8930-40a0-9ba0-b075c40d5a0d nodeName:}" failed. No retries permitted until 2026-07-07 18:23:52.411241319 +0000 UTC m=+73.541893320 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/965e4f40-8930-40a0-9ba0-b075c40d5a0d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-bbc47" (UID: "965e4f40-8930-40a0-9ba0-b075c40d5a0d") : secret "cluster-monitoring-operator-tls" not found Jul 07 18:23:36.411540 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:36.411320 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 18:23:36.411540 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:36.411382 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c2b4679-fdf3-4fdc-862d-89b27f73a954-samples-operator-tls podName:8c2b4679-fdf3-4fdc-862d-89b27f73a954 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:52.411364833 +0000 UTC m=+73.542016838 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8c2b4679-fdf3-4fdc-862d-89b27f73a954-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-jf97s" (UID: "8c2b4679-fdf3-4fdc-862d-89b27f73a954") : secret "samples-operator-tls" not found Jul 07 18:23:36.511961 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:36.511930 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-metrics-certs\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:36.512144 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:36.511994 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fhgs8\" (UID: \"5cd963e2-7b23-4a61-a73d-cbf757e7ea02\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fhgs8" Jul 07 18:23:36.512144 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:36.512021 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d442645e-7222-46af-9914-bb615255b0d5-service-ca-bundle\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:36.512144 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:36.512045 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:36.512144 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:36.512060 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 18:23:36.512144 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:36.512114 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-metrics-certs podName:d442645e-7222-46af-9914-bb615255b0d5 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:52.512100291 +0000 UTC m=+73.642752292 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-metrics-certs") pod "router-default-67c8dfcf49-w9wrf" (UID: "d442645e-7222-46af-9914-bb615255b0d5") : secret "router-metrics-certs-default" not found Jul 07 18:23:36.512144 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:36.512123 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 18:23:36.512144 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:36.512133 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f77fd79ff-zf7d7: secret "image-registry-tls" not found Jul 07 18:23:36.512523 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:36.512124 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 18:23:36.512523 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:36.512182 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d442645e-7222-46af-9914-bb615255b0d5-service-ca-bundle podName:d442645e-7222-46af-9914-bb615255b0d5 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:52.512165162 +0000 UTC m=+73.642817167 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d442645e-7222-46af-9914-bb615255b0d5-service-ca-bundle") pod "router-default-67c8dfcf49-w9wrf" (UID: "d442645e-7222-46af-9914-bb615255b0d5") : configmap references non-existent config key: service-ca.crt Jul 07 18:23:36.512523 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:36.512231 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls podName:94120e3a-209a-4ca3-8807-6e0e759f4c48 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:52.512220439 +0000 UTC m=+73.642872446 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls") pod "image-registry-f77fd79ff-zf7d7" (UID: "94120e3a-209a-4ca3-8807-6e0e759f4c48") : secret "image-registry-tls" not found Jul 07 18:23:36.512523 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:36.512247 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-networking-console-plugin-cert podName:5cd963e2-7b23-4a61-a73d-cbf757e7ea02 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:52.512237776 +0000 UTC m=+73.642889779 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fhgs8" (UID: "5cd963e2-7b23-4a61-a73d-cbf757e7ea02") : secret "networking-console-plugin-cert" not found Jul 07 18:23:36.512523 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:36.512290 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-metrics-tls\") pod \"dns-default-42kxz\" (UID: \"a2602fe9-e2fe-47bb-88b7-cab17f6659f3\") " pod="openshift-dns/dns-default-42kxz" Jul 07 18:23:36.512523 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:36.512391 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 18:23:36.512523 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:36.512432 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-metrics-tls podName:a2602fe9-e2fe-47bb-88b7-cab17f6659f3 nodeName:}" failed. No retries permitted until 2026-07-07 18:23:52.512420775 +0000 UTC m=+73.643072783 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-metrics-tls") pod "dns-default-42kxz" (UID: "a2602fe9-e2fe-47bb-88b7-cab17f6659f3") : secret "dns-default-metrics-tls" not found Jul 07 18:23:37.722411 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:37.722367 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:37.722871 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:37.722575 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:37.722871 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:37.722573 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 18:23:37.722871 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:37.722621 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 18:23:37.722871 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:37.722667 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-insights-runtime-extractor-tls podName:71a0ffb2-a8fc-4bd3-abc3-b56cd594349f nodeName:}" failed. No retries permitted until 2026-07-07 18:23:45.722652999 +0000 UTC m=+66.853305000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nlrr4" (UID: "71a0ffb2-a8fc-4bd3-abc3-b56cd594349f") : secret "insights-runtime-extractor-tls" not found Jul 07 18:23:37.722871 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:37.722680 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-kube-rbac-proxy-cm podName:71a0ffb2-a8fc-4bd3-abc3-b56cd594349f nodeName:}" failed. No retries permitted until 2026-07-07 18:23:45.722674408 +0000 UTC m=+66.853326409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nlrr4" (UID: "71a0ffb2-a8fc-4bd3-abc3-b56cd594349f") : configmap "kube-rbac-proxy" not found Jul 07 18:23:44.185567 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:44.185541 2580 scope.go:117] "RemoveContainer" containerID="c96451fe30a753511fa9b417e8fa9a9fe031b5ff1bf9a59d34ef308591a3a324" Jul 07 18:23:44.370931 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:44.370898 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-skkmr" Jul 07 18:23:44.489471 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:44.489439 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/2.log" Jul 07 18:23:44.489797 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:44.489783 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/1.log" Jul 07 18:23:44.489867 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:44.489814 2580 generic.go:356] "Generic (PLEG): container finished" podID="f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7" containerID="87cf4405d1f4be534e0c02aeada9a7e94bbeb94b2f8e0bbf4e1c5f7bc40a83b3" exitCode=255 Jul 07 18:23:44.489867 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:44.489860 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" event={"ID":"f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7","Type":"ContainerDied","Data":"87cf4405d1f4be534e0c02aeada9a7e94bbeb94b2f8e0bbf4e1c5f7bc40a83b3"} Jul 07 18:23:44.489960 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:44.489902 2580 scope.go:117] "RemoveContainer" containerID="c96451fe30a753511fa9b417e8fa9a9fe031b5ff1bf9a59d34ef308591a3a324" Jul 07 18:23:44.490218 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:44.490188 2580 scope.go:117] "RemoveContainer" containerID="87cf4405d1f4be534e0c02aeada9a7e94bbeb94b2f8e0bbf4e1c5f7bc40a83b3" Jul 07 18:23:44.490409 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:44.490379 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-c8qbd_openshift-console-operator(f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7)\"" pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" podUID="f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7" Jul 07 18:23:45.494267 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:45.494243 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/2.log" Jul 07 18:23:45.794154 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:45.794058 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:45.794154 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:45.794132 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:45.794393 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:45.794277 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 18:23:45.794393 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:45.794343 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-insights-runtime-extractor-tls podName:71a0ffb2-a8fc-4bd3-abc3-b56cd594349f nodeName:}" failed. No retries permitted until 2026-07-07 18:24:01.794327716 +0000 UTC m=+82.924979717 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nlrr4" (UID: "71a0ffb2-a8fc-4bd3-abc3-b56cd594349f") : secret "insights-runtime-extractor-tls" not found Jul 07 18:23:45.794714 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:45.794695 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:23:45.995739 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:45.995692 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs\") pod \"network-metrics-daemon-k6w2r\" (UID: \"68167320-ef20-4d1d-9b83-610ac96b5dce\") " pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:23:45.995911 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:45.995762 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret\") pod \"global-pull-secret-syncer-njfbx\" (UID: \"f090aaca-9b3a-449a-b2c4-2ccfbf5db417\") " pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:23:45.995911 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:45.995809 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfqxc\" (UniqueName: \"kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc\") pod \"network-check-target-lg59n\" (UID: \"f481e445-5a2b-4d41-99c4-5ba2397e062a\") " pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:23:45.998239 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:45.998218 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfqxc\" (UniqueName: \"kubernetes.io/projected/f481e445-5a2b-4d41-99c4-5ba2397e062a-kube-api-access-sfqxc\") pod \"network-check-target-lg59n\" (UID: \"f481e445-5a2b-4d41-99c4-5ba2397e062a\") " pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:23:45.998548 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:45.998530 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 18:23:45.999345 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:45.999330 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 18:23:46.008543 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:46.008522 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f090aaca-9b3a-449a-b2c4-2ccfbf5db417-original-pull-secret\") pod \"global-pull-secret-syncer-njfbx\" (UID: \"f090aaca-9b3a-449a-b2c4-2ccfbf5db417\") " pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:23:46.008622 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:46.008573 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68167320-ef20-4d1d-9b83-610ac96b5dce-metrics-certs\") pod \"network-metrics-daemon-k6w2r\" (UID: \"68167320-ef20-4d1d-9b83-610ac96b5dce\") " pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:23:46.205599 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:46.205527 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wxf5l\"" Jul 07 18:23:46.213383 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:46.213368 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k6w2r" Jul 07 18:23:46.215902 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:46.215881 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dxsjk\"" Jul 07 18:23:46.219865 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:46.219847 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njfbx" Jul 07 18:23:46.224075 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:46.224052 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:23:46.361826 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:46.361798 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k6w2r"] Jul 07 18:23:46.364775 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:23:46.364752 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68167320_ef20_4d1d_9b83_610ac96b5dce.slice/crio-f704a2cb4bd5f4ae7f520aed0f1b1bc71ad21489ee2c9ee644cac23dbe03306c WatchSource:0}: Error finding container f704a2cb4bd5f4ae7f520aed0f1b1bc71ad21489ee2c9ee644cac23dbe03306c: Status 404 returned error can't find the container with id f704a2cb4bd5f4ae7f520aed0f1b1bc71ad21489ee2c9ee644cac23dbe03306c Jul 07 18:23:46.498597 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:46.498567 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k6w2r" event={"ID":"68167320-ef20-4d1d-9b83-610ac96b5dce","Type":"ContainerStarted","Data":"f704a2cb4bd5f4ae7f520aed0f1b1bc71ad21489ee2c9ee644cac23dbe03306c"} Jul 07 18:23:46.579699 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:46.577543 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-njfbx"] Jul 07 18:23:46.584420 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:46.584399 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lg59n"] Jul 07 18:23:46.587789 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:23:46.587767 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf481e445_5a2b_4d41_99c4_5ba2397e062a.slice/crio-5c5ff85595e18decc90bee61a782983ff5640e6afb35e4beb05dd8d40712c42c WatchSource:0}: Error finding container 5c5ff85595e18decc90bee61a782983ff5640e6afb35e4beb05dd8d40712c42c: Status 404 returned error can't find the container with id 5c5ff85595e18decc90bee61a782983ff5640e6afb35e4beb05dd8d40712c42c Jul 07 18:23:47.504588 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:47.504547 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lg59n" event={"ID":"f481e445-5a2b-4d41-99c4-5ba2397e062a","Type":"ContainerStarted","Data":"ed792f66440437e57844ed0d65bba64e9824d993bfb9f9e824ac3a59520292d6"} Jul 07 18:23:47.505076 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:47.504613 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lg59n" event={"ID":"f481e445-5a2b-4d41-99c4-5ba2397e062a","Type":"ContainerStarted","Data":"5c5ff85595e18decc90bee61a782983ff5640e6afb35e4beb05dd8d40712c42c"} Jul 07 18:23:47.505076 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:47.504666 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:23:47.505782 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:47.505755 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-njfbx" event={"ID":"f090aaca-9b3a-449a-b2c4-2ccfbf5db417","Type":"ContainerStarted","Data":"47ce154c4ddad900c260454000e00466a97ba9ea07f267aefc7727781b8f6642"} Jul 07 18:23:47.523189 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:47.523133 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lg59n" podStartSLOduration=67.523114214 podStartE2EDuration="1m7.523114214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:22:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:23:47.522470465 +0000 UTC m=+68.653122479" watchObservedRunningTime="2026-07-07 18:23:47.523114214 +0000 UTC m=+68.653766236" Jul 07 18:23:48.512191 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:48.512081 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k6w2r" event={"ID":"68167320-ef20-4d1d-9b83-610ac96b5dce","Type":"ContainerStarted","Data":"5dca0f7831ee2f63a0e6488f75f6d6bbcad5813c2f50a19ff3b5a1471b0856e3"} Jul 07 18:23:48.512191 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:48.512149 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k6w2r" event={"ID":"68167320-ef20-4d1d-9b83-610ac96b5dce","Type":"ContainerStarted","Data":"fc100603086c747362afb50511c1dc726b9d0bd2083d40057814578b95963e8f"} Jul 07 18:23:48.532261 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:48.532215 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k6w2r" podStartSLOduration=66.260029323 podStartE2EDuration="1m7.532198872s" totalImagesPullingTime="1.272169549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:22:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:23:48.530982276 +0000 UTC m=+69.661634300" watchObservedRunningTime="2026-07-07 18:23:48.532198872 +0000 UTC m=+69.662850894" Jul 07 18:23:50.872174 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:50.872144 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" Jul 07 18:23:50.872657 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:50.872198 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" Jul 07 18:23:50.872657 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:50.872500 2580 scope.go:117] "RemoveContainer" containerID="87cf4405d1f4be534e0c02aeada9a7e94bbeb94b2f8e0bbf4e1c5f7bc40a83b3" Jul 07 18:23:50.872657 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:23:50.872640 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-c8qbd_openshift-console-operator(f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7)\"" pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" podUID="f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7" Jul 07 18:23:52.455558 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.455520 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c2b4679-fdf3-4fdc-862d-89b27f73a954-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-jf97s\" (UID: \"8c2b4679-fdf3-4fdc-862d-89b27f73a954\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jf97s" Jul 07 18:23:52.455938 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.455595 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/965e4f40-8930-40a0-9ba0-b075c40d5a0d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bbc47\" (UID: \"965e4f40-8930-40a0-9ba0-b075c40d5a0d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bbc47" Jul 07 18:23:52.457863 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.457838 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8c2b4679-fdf3-4fdc-862d-89b27f73a954-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-jf97s\" (UID: \"8c2b4679-fdf3-4fdc-862d-89b27f73a954\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jf97s" Jul 07 18:23:52.457863 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.457852 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/965e4f40-8930-40a0-9ba0-b075c40d5a0d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-bbc47\" (UID: \"965e4f40-8930-40a0-9ba0-b075c40d5a0d\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bbc47" Jul 07 18:23:52.526707 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.526676 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-njfbx" event={"ID":"f090aaca-9b3a-449a-b2c4-2ccfbf5db417","Type":"ContainerStarted","Data":"8109f8dbf291e62ec0344e14c4ab710215ae814f184115d0450a707b81685aeb"} Jul 07 18:23:52.548161 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.548095 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-njfbx" podStartSLOduration=65.793419095 podStartE2EDuration="1m11.548077144s" totalImagesPullingTime="5.754658049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:22:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:23:52.546544046 +0000 UTC m=+73.677196070" watchObservedRunningTime="2026-07-07 18:23:52.548077144 +0000 UTC m=+73.678729167" Jul 07 18:23:52.556190 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.556159 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-metrics-tls\") pod \"dns-default-42kxz\" (UID: \"a2602fe9-e2fe-47bb-88b7-cab17f6659f3\") " pod="openshift-dns/dns-default-42kxz" Jul 07 18:23:52.556402 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.556196 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-metrics-certs\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:52.556402 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.556237 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fhgs8\" (UID: \"5cd963e2-7b23-4a61-a73d-cbf757e7ea02\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fhgs8" Jul 07 18:23:52.556402 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.556257 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d442645e-7222-46af-9914-bb615255b0d5-service-ca-bundle\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:52.556402 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.556274 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:52.557003 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.556978 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d442645e-7222-46af-9914-bb615255b0d5-service-ca-bundle\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:52.558714 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.558684 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2602fe9-e2fe-47bb-88b7-cab17f6659f3-metrics-tls\") pod \"dns-default-42kxz\" (UID: \"a2602fe9-e2fe-47bb-88b7-cab17f6659f3\") " pod="openshift-dns/dns-default-42kxz" Jul 07 18:23:52.558814 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.558768 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5cd963e2-7b23-4a61-a73d-cbf757e7ea02-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fhgs8\" (UID: \"5cd963e2-7b23-4a61-a73d-cbf757e7ea02\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fhgs8" Jul 07 18:23:52.559003 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.558987 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d442645e-7222-46af-9914-bb615255b0d5-metrics-certs\") pod \"router-default-67c8dfcf49-w9wrf\" (UID: \"d442645e-7222-46af-9914-bb615255b0d5\") " pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:52.559180 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.559159 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls\") pod \"image-registry-f77fd79ff-zf7d7\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:52.605673 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.605595 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bhccg\"" Jul 07 18:23:52.613540 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.613513 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bbc47" Jul 07 18:23:52.659049 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.659016 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pwrfw\"" Jul 07 18:23:52.667215 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.667189 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jf97s" Jul 07 18:23:52.708075 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.708032 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4w8v8\"" Jul 07 18:23:52.712600 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.712548 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:52.718591 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.718571 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-944sl\"" Jul 07 18:23:52.727170 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.727001 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:52.737574 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.737551 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-q5st5\"" Jul 07 18:23:52.746316 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.746288 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bbc47"] Jul 07 18:23:52.746709 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.746616 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fhgs8" Jul 07 18:23:52.749513 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:23:52.749473 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod965e4f40_8930_40a0_9ba0_b075c40d5a0d.slice/crio-a9eb3540d743fc2d1ac554d00796b18574bc07e2eba4dd3e20e97d3444238b40 WatchSource:0}: Error finding container a9eb3540d743fc2d1ac554d00796b18574bc07e2eba4dd3e20e97d3444238b40: Status 404 returned error can't find the container with id a9eb3540d743fc2d1ac554d00796b18574bc07e2eba4dd3e20e97d3444238b40 Jul 07 18:23:52.765686 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.765651 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9fz64\"" Jul 07 18:23:52.773195 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.773145 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-42kxz" Jul 07 18:23:52.820893 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.820749 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jf97s"] Jul 07 18:23:52.927853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.927830 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67c8dfcf49-w9wrf"] Jul 07 18:23:52.932410 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:23:52.932377 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd442645e_7222_46af_9914_bb615255b0d5.slice/crio-1bc01b5e74dab19833e6919a5e123c45cd6933d07fec27e9e2931697c1285964 WatchSource:0}: Error finding container 1bc01b5e74dab19833e6919a5e123c45cd6933d07fec27e9e2931697c1285964: Status 404 returned error can't find the container with id 1bc01b5e74dab19833e6919a5e123c45cd6933d07fec27e9e2931697c1285964 Jul 07 18:23:52.964280 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.964254 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f77fd79ff-zf7d7"] Jul 07 18:23:52.974700 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.974674 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-fhgs8"] Jul 07 18:23:52.976488 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:23:52.976446 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94120e3a_209a_4ca3_8807_6e0e759f4c48.slice/crio-a070986d41425030819b2b623f2b72201f54154f3f25d5ccf1ddb90b0f667518 WatchSource:0}: Error finding container a070986d41425030819b2b623f2b72201f54154f3f25d5ccf1ddb90b0f667518: Status 404 returned error can't find the container with id a070986d41425030819b2b623f2b72201f54154f3f25d5ccf1ddb90b0f667518 Jul 07 18:23:52.977511 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:23:52.977488 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cd963e2_7b23_4a61_a73d_cbf757e7ea02.slice/crio-83fe6731f9f9a0c019eebe4b4662c125208471a0f6556c6a3834a672e7fb5294 WatchSource:0}: Error finding container 83fe6731f9f9a0c019eebe4b4662c125208471a0f6556c6a3834a672e7fb5294: Status 404 returned error can't find the container with id 83fe6731f9f9a0c019eebe4b4662c125208471a0f6556c6a3834a672e7fb5294 Jul 07 18:23:52.989312 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:52.989276 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-42kxz"] Jul 07 18:23:52.994211 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:23:52.994187 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2602fe9_e2fe_47bb_88b7_cab17f6659f3.slice/crio-5617669360b93d9d11f65e53805fe44cd44913fb99a634da6938ae2011857831 WatchSource:0}: Error finding container 5617669360b93d9d11f65e53805fe44cd44913fb99a634da6938ae2011857831: Status 404 returned error can't find the container with id 5617669360b93d9d11f65e53805fe44cd44913fb99a634da6938ae2011857831 Jul 07 18:23:53.532028 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:53.531943 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" event={"ID":"94120e3a-209a-4ca3-8807-6e0e759f4c48","Type":"ContainerStarted","Data":"886c7571247b4a12849c713bd217b59ebe40d71ee8622145da47c113e6cdce30"} Jul 07 18:23:53.532028 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:53.531998 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" event={"ID":"94120e3a-209a-4ca3-8807-6e0e759f4c48","Type":"ContainerStarted","Data":"a070986d41425030819b2b623f2b72201f54154f3f25d5ccf1ddb90b0f667518"} Jul 07 18:23:53.532655 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:53.532086 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:23:53.533357 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:53.533328 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bbc47" event={"ID":"965e4f40-8930-40a0-9ba0-b075c40d5a0d","Type":"ContainerStarted","Data":"a9eb3540d743fc2d1ac554d00796b18574bc07e2eba4dd3e20e97d3444238b40"} Jul 07 18:23:53.534821 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:53.534787 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-42kxz" event={"ID":"a2602fe9-e2fe-47bb-88b7-cab17f6659f3","Type":"ContainerStarted","Data":"5617669360b93d9d11f65e53805fe44cd44913fb99a634da6938ae2011857831"} Jul 07 18:23:53.536366 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:53.536338 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fhgs8" event={"ID":"5cd963e2-7b23-4a61-a73d-cbf757e7ea02","Type":"ContainerStarted","Data":"83fe6731f9f9a0c019eebe4b4662c125208471a0f6556c6a3834a672e7fb5294"} Jul 07 18:23:53.538126 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:53.538086 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" event={"ID":"d442645e-7222-46af-9914-bb615255b0d5","Type":"ContainerStarted","Data":"ed0204764ed7c7a5eb79ba79b03285f174c35be30188f92383ded4608ed6c8eb"} Jul 07 18:23:53.538242 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:53.538128 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" event={"ID":"d442645e-7222-46af-9914-bb615255b0d5","Type":"ContainerStarted","Data":"1bc01b5e74dab19833e6919a5e123c45cd6933d07fec27e9e2931697c1285964"} Jul 07 18:23:53.539524 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:53.539471 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jf97s" event={"ID":"8c2b4679-fdf3-4fdc-862d-89b27f73a954","Type":"ContainerStarted","Data":"d22130de582268a762ab8c078d4f9fdb9ea7ff9d3397ea72c314843f0bede54f"} Jul 07 18:23:53.568982 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:53.568924 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" podStartSLOduration=72.568903538 podStartE2EDuration="1m12.568903538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:22:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:23:53.568701951 +0000 UTC m=+74.699353981" watchObservedRunningTime="2026-07-07 18:23:53.568903538 +0000 UTC m=+74.699555564" Jul 07 18:23:53.712817 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:53.712737 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:53.715991 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:53.715962 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:53.768483 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:53.762536 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" podStartSLOduration=52.762513419 podStartE2EDuration="52.762513419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:23:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:23:53.630378825 +0000 UTC m=+74.761030849" watchObservedRunningTime="2026-07-07 18:23:53.762513419 +0000 UTC m=+74.893165445" Jul 07 18:23:54.544515 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:54.544488 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:54.545560 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:54.545536 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-67c8dfcf49-w9wrf" Jul 07 18:23:55.550040 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:55.549992 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fhgs8" event={"ID":"5cd963e2-7b23-4a61-a73d-cbf757e7ea02","Type":"ContainerStarted","Data":"e505574ab46b0979cc3795ceedf8b1fa2a5ff3590b135beed87c1d09a415a246"} Jul 07 18:23:55.569683 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:55.569627 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fhgs8" podStartSLOduration=47.069004032 podStartE2EDuration="48.569606842s" totalImagesPullingTime="1.50060281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:23:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:23:55.567646888 +0000 UTC m=+76.698298916" watchObservedRunningTime="2026-07-07 18:23:55.569606842 +0000 UTC m=+76.700258868" Jul 07 18:23:56.556678 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:56.556638 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-42kxz" event={"ID":"a2602fe9-e2fe-47bb-88b7-cab17f6659f3","Type":"ContainerStarted","Data":"8090d84dd6bdda95b7e751705ac187721834b1be77c6d1b9d2605d322f0b1968"} Jul 07 18:23:56.557121 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:56.556701 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-42kxz" event={"ID":"a2602fe9-e2fe-47bb-88b7-cab17f6659f3","Type":"ContainerStarted","Data":"b2c5a46a232729a1fa43ee3b01c14a1f8d0a9647eda961fa7aafff414b679141"} Jul 07 18:23:56.557121 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:56.556732 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-42kxz" Jul 07 18:23:56.558531 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:56.558508 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jf97s" event={"ID":"8c2b4679-fdf3-4fdc-862d-89b27f73a954","Type":"ContainerStarted","Data":"d158490b3b392e919c2c4097c6c3fd5722c2a64ba3b8300715924f8cdc3d538b"} Jul 07 18:23:56.558651 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:56.558558 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jf97s" event={"ID":"8c2b4679-fdf3-4fdc-862d-89b27f73a954","Type":"ContainerStarted","Data":"b74e558419c4d96cee9a3a2a29c3ecc7e80ce795c6b86d6aea038bfe596740cd"} Jul 07 18:23:56.559954 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:56.559921 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bbc47" event={"ID":"965e4f40-8930-40a0-9ba0-b075c40d5a0d","Type":"ContainerStarted","Data":"6e83a3d52bbb0f17a1395806cee32f084faaa36a4b0bdf1c4ac308197625bc1f"} Jul 07 18:23:56.659589 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:56.659487 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-42kxz" podStartSLOduration=33.486354895 podStartE2EDuration="36.659441664s" totalImagesPullingTime="3.173086769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:23:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:23:56.658293836 +0000 UTC m=+77.788945870" watchObservedRunningTime="2026-07-07 18:23:56.659441664 +0000 UTC m=+77.790093678" Jul 07 18:23:56.763949 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:56.763894 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-bbc47" podStartSLOduration=52.346809981 podStartE2EDuration="55.76387614s" totalImagesPullingTime="3.417066159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:23:56.748948474 +0000 UTC m=+77.879600497" watchObservedRunningTime="2026-07-07 18:23:56.76387614 +0000 UTC m=+77.894528168" Jul 07 18:23:56.857359 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:23:56.854119 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jf97s" podStartSLOduration=52.599290938 podStartE2EDuration="55.854098587s" totalImagesPullingTime="3.254807649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:23:56.852512894 +0000 UTC m=+77.983164917" watchObservedRunningTime="2026-07-07 18:23:56.854098587 +0000 UTC m=+77.984750611" Jul 07 18:24:01.835389 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:01.835267 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:24:01.837557 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:01.837526 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71a0ffb2-a8fc-4bd3-abc3-b56cd594349f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nlrr4\" (UID: \"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f\") " pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:24:02.128086 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:02.128010 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-62q56\"" Jul 07 18:24:02.135194 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:02.135177 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nlrr4" Jul 07 18:24:02.186872 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:02.186232 2580 scope.go:117] "RemoveContainer" containerID="87cf4405d1f4be534e0c02aeada9a7e94bbeb94b2f8e0bbf4e1c5f7bc40a83b3" Jul 07 18:24:02.186872 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:24:02.186427 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-c8qbd_openshift-console-operator(f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7)\"" pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" podUID="f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7" Jul 07 18:24:02.280510 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:02.280485 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nlrr4"] Jul 07 18:24:02.283149 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:24:02.283126 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a0ffb2_a8fc_4bd3_abc3_b56cd594349f.slice/crio-6bcdf9bdafdf92580c525ff7a9f9fb852d92859558667e5a756dde55f0c3e4be WatchSource:0}: Error finding container 6bcdf9bdafdf92580c525ff7a9f9fb852d92859558667e5a756dde55f0c3e4be: Status 404 returned error can't find the container with id 6bcdf9bdafdf92580c525ff7a9f9fb852d92859558667e5a756dde55f0c3e4be Jul 07 18:24:02.582907 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:02.582873 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nlrr4" event={"ID":"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f","Type":"ContainerStarted","Data":"6bcdf9bdafdf92580c525ff7a9f9fb852d92859558667e5a756dde55f0c3e4be"} Jul 07 18:24:06.567313 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:06.567280 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-42kxz" Jul 07 18:24:06.601152 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:06.601115 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nlrr4" event={"ID":"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f","Type":"ContainerStarted","Data":"90150e38cd9ba5989fcbc6734d30a76084d2502434bbfb84937146d310524390"} Jul 07 18:24:07.606916 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:07.606884 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nlrr4" event={"ID":"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f","Type":"ContainerStarted","Data":"f31070573c00e2ffd7aaba38f046f5e7fc1f8647a72af187650d8ea22d8a62bd"} Jul 07 18:24:08.670203 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.670168 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-kcvpf"] Jul 07 18:24:08.678246 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.678186 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kcvpf" Jul 07 18:24:08.681666 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.681639 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 07 18:24:08.682499 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.682474 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 07 18:24:08.682608 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.682530 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 18:24:08.682608 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.682531 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-qg6kz\"" Jul 07 18:24:08.682936 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.682915 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53423e2a-4b4a-4536-a4f9-7fb58b014a23-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-kcvpf\" (UID: \"53423e2a-4b4a-4536-a4f9-7fb58b014a23\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kcvpf" Jul 07 18:24:08.683100 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.683014 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/53423e2a-4b4a-4536-a4f9-7fb58b014a23-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-kcvpf\" (UID: \"53423e2a-4b4a-4536-a4f9-7fb58b014a23\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kcvpf" Jul 07 18:24:08.683100 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.683077 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sxq4\" (UniqueName: \"kubernetes.io/projected/53423e2a-4b4a-4536-a4f9-7fb58b014a23-kube-api-access-8sxq4\") pod \"openshift-state-metrics-54cf96dfcf-kcvpf\" (UID: \"53423e2a-4b4a-4536-a4f9-7fb58b014a23\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kcvpf" Jul 07 18:24:08.683262 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.683144 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53423e2a-4b4a-4536-a4f9-7fb58b014a23-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-kcvpf\" (UID: \"53423e2a-4b4a-4536-a4f9-7fb58b014a23\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kcvpf" Jul 07 18:24:08.695861 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.695838 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-kcvpf"] Jul 07 18:24:08.696954 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.696933 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fwmfm"] Jul 07 18:24:08.700821 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.700800 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.703705 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.703683 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 18:24:08.704375 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.704352 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 18:24:08.704490 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.704444 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 18:24:08.708599 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.708583 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j2kzd\"" Jul 07 18:24:08.784138 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.784102 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-root\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.784323 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.784157 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.784323 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.784196 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-node-exporter-tls\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.784323 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.784224 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6sq9\" (UniqueName: \"kubernetes.io/projected/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-kube-api-access-f6sq9\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.784323 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.784280 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/53423e2a-4b4a-4536-a4f9-7fb58b014a23-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-kcvpf\" (UID: \"53423e2a-4b4a-4536-a4f9-7fb58b014a23\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kcvpf" Jul 07 18:24:08.784560 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.784326 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-metrics-client-ca\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.784560 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.784377 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sxq4\" (UniqueName: \"kubernetes.io/projected/53423e2a-4b4a-4536-a4f9-7fb58b014a23-kube-api-access-8sxq4\") pod \"openshift-state-metrics-54cf96dfcf-kcvpf\" (UID: \"53423e2a-4b4a-4536-a4f9-7fb58b014a23\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kcvpf" Jul 07 18:24:08.784560 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.784405 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-sys\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.784560 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.784470 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53423e2a-4b4a-4536-a4f9-7fb58b014a23-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-kcvpf\" (UID: \"53423e2a-4b4a-4536-a4f9-7fb58b014a23\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kcvpf" Jul 07 18:24:08.784744 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.784643 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53423e2a-4b4a-4536-a4f9-7fb58b014a23-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-kcvpf\" (UID: \"53423e2a-4b4a-4536-a4f9-7fb58b014a23\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kcvpf" Jul 07 18:24:08.784744 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.784675 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-node-exporter-accelerators-collector-config\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.784744 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.784706 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-node-exporter-textfile\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.784744 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.784739 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-node-exporter-wtmp\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.785498 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.785477 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53423e2a-4b4a-4536-a4f9-7fb58b014a23-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-kcvpf\" (UID: \"53423e2a-4b4a-4536-a4f9-7fb58b014a23\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kcvpf" Jul 07 18:24:08.787632 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.787594 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53423e2a-4b4a-4536-a4f9-7fb58b014a23-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-kcvpf\" (UID: \"53423e2a-4b4a-4536-a4f9-7fb58b014a23\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kcvpf" Jul 07 18:24:08.787750 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.787664 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/53423e2a-4b4a-4536-a4f9-7fb58b014a23-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-kcvpf\" (UID: \"53423e2a-4b4a-4536-a4f9-7fb58b014a23\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kcvpf" Jul 07 18:24:08.794909 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.794884 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sxq4\" (UniqueName: \"kubernetes.io/projected/53423e2a-4b4a-4536-a4f9-7fb58b014a23-kube-api-access-8sxq4\") pod \"openshift-state-metrics-54cf96dfcf-kcvpf\" (UID: \"53423e2a-4b4a-4536-a4f9-7fb58b014a23\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kcvpf" Jul 07 18:24:08.885406 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.885374 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-sys\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.885590 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.885433 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-node-exporter-accelerators-collector-config\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.885590 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.885475 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-node-exporter-textfile\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.885590 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.885505 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-node-exporter-wtmp\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.885590 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.885503 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-sys\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.885590 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.885543 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-root\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.885590 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.885575 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.885915 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.885609 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-node-exporter-tls\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.885915 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.885653 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-root\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.885915 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.885677 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-node-exporter-wtmp\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.885915 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.885701 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6sq9\" (UniqueName: \"kubernetes.io/projected/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-kube-api-access-f6sq9\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.885915 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.885735 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-metrics-client-ca\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.885915 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.885844 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-node-exporter-textfile\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.886236 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.886124 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-node-exporter-accelerators-collector-config\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.886359 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.886329 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-metrics-client-ca\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.888338 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.888312 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-node-exporter-tls\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.888445 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.888401 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.893930 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.893906 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6sq9\" (UniqueName: \"kubernetes.io/projected/b4434b20-ebc6-4f42-b4c8-0799b44eb4bb-kube-api-access-f6sq9\") pod \"node-exporter-fwmfm\" (UID: \"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb\") " pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:08.988164 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:08.988107 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kcvpf" Jul 07 18:24:09.011513 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.011488 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fwmfm" Jul 07 18:24:09.039962 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:24:09.039915 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4434b20_ebc6_4f42_b4c8_0799b44eb4bb.slice/crio-dd50d9f7662a174ba98b5abace481fcd44b09485eb5ec68061d5e06b63217647 WatchSource:0}: Error finding container dd50d9f7662a174ba98b5abace481fcd44b09485eb5ec68061d5e06b63217647: Status 404 returned error can't find the container with id dd50d9f7662a174ba98b5abace481fcd44b09485eb5ec68061d5e06b63217647 Jul 07 18:24:09.176646 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.176619 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-kcvpf"] Jul 07 18:24:09.178919 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:24:09.178888 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53423e2a_4b4a_4536_a4f9_7fb58b014a23.slice/crio-157cedd1abc3978d7324a97605c9020597f8eeedb10a9dfdbb9cbd8d4f5bef91 WatchSource:0}: Error finding container 157cedd1abc3978d7324a97605c9020597f8eeedb10a9dfdbb9cbd8d4f5bef91: Status 404 returned error can't find the container with id 157cedd1abc3978d7324a97605c9020597f8eeedb10a9dfdbb9cbd8d4f5bef91 Jul 07 18:24:09.620341 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.620256 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kcvpf" event={"ID":"53423e2a-4b4a-4536-a4f9-7fb58b014a23","Type":"ContainerStarted","Data":"d3dada1027abee81699858e3c0af4e43198e0ff6859236138d73811e8c81df0e"} Jul 07 18:24:09.620341 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.620325 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kcvpf" event={"ID":"53423e2a-4b4a-4536-a4f9-7fb58b014a23","Type":"ContainerStarted","Data":"9824f10a09bf2ff73dc19a6515f52c87d645bf6f4c35452f3581273e8efbac82"} Jul 07 18:24:09.620543 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.620346 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kcvpf" event={"ID":"53423e2a-4b4a-4536-a4f9-7fb58b014a23","Type":"ContainerStarted","Data":"157cedd1abc3978d7324a97605c9020597f8eeedb10a9dfdbb9cbd8d4f5bef91"} Jul 07 18:24:09.623659 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.623181 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nlrr4" event={"ID":"71a0ffb2-a8fc-4bd3-abc3-b56cd594349f","Type":"ContainerStarted","Data":"a859fc0431774d95a20c3e6aa9144209c28ce7672eeed9f0f27c895fe29b1304"} Jul 07 18:24:09.624748 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.624721 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fwmfm" event={"ID":"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb","Type":"ContainerStarted","Data":"dd50d9f7662a174ba98b5abace481fcd44b09485eb5ec68061d5e06b63217647"} Jul 07 18:24:09.648152 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.648093 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nlrr4" podStartSLOduration=33.98774428 podStartE2EDuration="40.64806941s" totalImagesPullingTime="6.66032513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:23:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:24:09.646260762 +0000 UTC m=+90.776912795" watchObservedRunningTime="2026-07-07 18:24:09.64806941 +0000 UTC m=+90.778721436" Jul 07 18:24:09.785958 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.785920 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 18:24:09.788968 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.788947 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.791997 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.791972 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 18:24:09.792116 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.792043 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 18:24:09.792177 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.792127 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 18:24:09.792177 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.792137 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 18:24:09.792292 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.792226 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 18:24:09.792799 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.792780 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-k6kxg\"" Jul 07 18:24:09.792799 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.792797 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 18:24:09.792952 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.792805 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 18:24:09.792952 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.792797 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 18:24:09.792952 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.792816 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 18:24:09.809307 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.809232 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 18:24:09.892304 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.892231 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.892304 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.892271 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01b8fe54-da10-4161-aa6f-9edd9214bdc6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.892554 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.892306 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.892554 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.892382 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01b8fe54-da10-4161-aa6f-9edd9214bdc6-config-out\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.892554 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.892448 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-config-volume\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.892554 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.892492 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/01b8fe54-da10-4161-aa6f-9edd9214bdc6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.892554 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.892531 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-web-config\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.892838 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.892626 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.892838 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.892656 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01b8fe54-da10-4161-aa6f-9edd9214bdc6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.892838 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.892698 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgz7l\" (UniqueName: \"kubernetes.io/projected/01b8fe54-da10-4161-aa6f-9edd9214bdc6-kube-api-access-zgz7l\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.892838 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.892729 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01b8fe54-da10-4161-aa6f-9edd9214bdc6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.892838 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.892776 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.892838 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.892815 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.994276 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.994236 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.994501 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.994292 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01b8fe54-da10-4161-aa6f-9edd9214bdc6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.994501 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.994335 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.994501 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.994408 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01b8fe54-da10-4161-aa6f-9edd9214bdc6-config-out\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.994501 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.994482 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-config-volume\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.994730 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.994513 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/01b8fe54-da10-4161-aa6f-9edd9214bdc6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.994730 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.994556 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-web-config\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.994730 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.994600 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.994730 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.994626 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01b8fe54-da10-4161-aa6f-9edd9214bdc6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.994730 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.994673 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgz7l\" (UniqueName: \"kubernetes.io/projected/01b8fe54-da10-4161-aa6f-9edd9214bdc6-kube-api-access-zgz7l\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.994730 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.994705 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01b8fe54-da10-4161-aa6f-9edd9214bdc6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.995023 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.994735 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.995023 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.994767 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.995023 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.994985 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/01b8fe54-da10-4161-aa6f-9edd9214bdc6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.995842 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:24:09.995798 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01b8fe54-da10-4161-aa6f-9edd9214bdc6-alertmanager-trusted-ca-bundle podName:01b8fe54-da10-4161-aa6f-9edd9214bdc6 nodeName:}" failed. No retries permitted until 2026-07-07 18:24:10.495773363 +0000 UTC m=+91.626425365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/01b8fe54-da10-4161-aa6f-9edd9214bdc6-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "01b8fe54-da10-4161-aa6f-9edd9214bdc6") : configmap references non-existent config key: ca-bundle.crt Jul 07 18:24:09.996944 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.996922 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01b8fe54-da10-4161-aa6f-9edd9214bdc6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.997623 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.997580 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01b8fe54-da10-4161-aa6f-9edd9214bdc6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.998386 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.998360 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01b8fe54-da10-4161-aa6f-9edd9214bdc6-config-out\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:09.999484 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:09.999430 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-web-config\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:10.000690 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:10.000669 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-config-volume\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:10.001243 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:10.000876 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:10.001243 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:10.001201 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:10.001851 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:10.001829 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:10.002272 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:10.002224 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:10.002548 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:10.002527 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:10.016398 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:10.016331 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgz7l\" (UniqueName: \"kubernetes.io/projected/01b8fe54-da10-4161-aa6f-9edd9214bdc6-kube-api-access-zgz7l\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:10.303689 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:24:10.303655 2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4434b20_ebc6_4f42_b4c8_0799b44eb4bb.slice/crio-conmon-e5a534cdf67da2bbdd568318a43279a19185aa40cbb4c9a005186e1fb374a56b.scope\": RecentStats: unable to find data in memory cache]" Jul 07 18:24:10.499630 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:10.499599 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01b8fe54-da10-4161-aa6f-9edd9214bdc6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:10.500374 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:10.500350 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01b8fe54-da10-4161-aa6f-9edd9214bdc6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:10.631230 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:10.631186 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kcvpf" event={"ID":"53423e2a-4b4a-4536-a4f9-7fb58b014a23","Type":"ContainerStarted","Data":"9517563f471544e8c295207915d87d96642b7613427d4d3a8a82de6e3936f458"} Jul 07 18:24:10.632872 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:10.632849 2580 generic.go:356] "Generic (PLEG): container finished" podID="b4434b20-ebc6-4f42-b4c8-0799b44eb4bb" containerID="e5a534cdf67da2bbdd568318a43279a19185aa40cbb4c9a005186e1fb374a56b" exitCode=0 Jul 07 18:24:10.632980 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:10.632908 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fwmfm" event={"ID":"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb","Type":"ContainerDied","Data":"e5a534cdf67da2bbdd568318a43279a19185aa40cbb4c9a005186e1fb374a56b"} Jul 07 18:24:10.663068 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:10.663024 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kcvpf" podStartSLOduration=1.5160207730000002 podStartE2EDuration="2.663009553s" totalImagesPullingTime="1.14698878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:24:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:24:10.661828132 +0000 UTC m=+91.792480155" watchObservedRunningTime="2026-07-07 18:24:10.663009553 +0000 UTC m=+91.793661576" Jul 07 18:24:10.710043 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:10.710024 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:24:10.853662 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:10.853637 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 18:24:10.855874 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:24:10.855844 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01b8fe54_da10_4161_aa6f_9edd9214bdc6.slice/crio-510338f49d74fde92ceabe3c8d36a744cefb0250000612676878ab3a99fe60c4 WatchSource:0}: Error finding container 510338f49d74fde92ceabe3c8d36a744cefb0250000612676878ab3a99fe60c4: Status 404 returned error can't find the container with id 510338f49d74fde92ceabe3c8d36a744cefb0250000612676878ab3a99fe60c4 Jul 07 18:24:11.640098 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.640035 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fwmfm" event={"ID":"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb","Type":"ContainerStarted","Data":"5bc2e970377043acc2c33d4080f3272ab3e13f8d7f7b242232b1144557f2fb96"} Jul 07 18:24:11.640275 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.640117 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fwmfm" event={"ID":"b4434b20-ebc6-4f42-b4c8-0799b44eb4bb","Type":"ContainerStarted","Data":"04a8ea99c24b0c49ca53a62edc576d4238ebe02723b7ef7556de8cb052603c49"} Jul 07 18:24:11.641373 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.641347 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01b8fe54-da10-4161-aa6f-9edd9214bdc6","Type":"ContainerStarted","Data":"510338f49d74fde92ceabe3c8d36a744cefb0250000612676878ab3a99fe60c4"} Jul 07 18:24:11.666364 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.666314 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fwmfm" podStartSLOduration=2.527273777 podStartE2EDuration="3.66629728s" totalImagesPullingTime="1.068117252s" totalInitContainerRuntime="70.906251ms" isStatefulPod=true podCreationTimestamp="2026-07-07 18:24:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:24:11.665576238 +0000 UTC m=+92.796228263" watchObservedRunningTime="2026-07-07 18:24:11.66629728 +0000 UTC m=+92.796949302" Jul 07 18:24:11.686153 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.686122 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-78dcc646dd-qfcfd"] Jul 07 18:24:11.689297 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.689270 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.692227 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.692150 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 07 18:24:11.692227 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.692217 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 07 18:24:11.692405 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.692155 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 07 18:24:11.692405 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.692287 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 07 18:24:11.692405 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.692364 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-px59j\"" Jul 07 18:24:11.692579 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.692427 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3cmotosfcuusq\"" Jul 07 18:24:11.692744 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.692707 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 07 18:24:11.703520 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.703501 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-78dcc646dd-qfcfd"] Jul 07 18:24:11.713386 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.713366 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/98f3f7b3-5659-426d-a36b-917abed54f90-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.713486 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.713394 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/98f3f7b3-5659-426d-a36b-917abed54f90-secret-grpc-tls\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.713486 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.713474 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98f3f7b3-5659-426d-a36b-917abed54f90-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.713646 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.713600 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98f3f7b3-5659-426d-a36b-917abed54f90-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.713725 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.713686 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/98f3f7b3-5659-426d-a36b-917abed54f90-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.713725 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.713717 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98f3f7b3-5659-426d-a36b-917abed54f90-metrics-client-ca\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.713824 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.713801 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/98f3f7b3-5659-426d-a36b-917abed54f90-secret-thanos-querier-tls\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.713880 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.713827 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvnqj\" (UniqueName: \"kubernetes.io/projected/98f3f7b3-5659-426d-a36b-917abed54f90-kube-api-access-nvnqj\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.814970 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.814932 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/98f3f7b3-5659-426d-a36b-917abed54f90-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.814970 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.814975 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/98f3f7b3-5659-426d-a36b-917abed54f90-secret-grpc-tls\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.815172 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.815020 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98f3f7b3-5659-426d-a36b-917abed54f90-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.815172 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.815050 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98f3f7b3-5659-426d-a36b-917abed54f90-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.815172 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.815087 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/98f3f7b3-5659-426d-a36b-917abed54f90-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.815172 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.815110 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98f3f7b3-5659-426d-a36b-917abed54f90-metrics-client-ca\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.815172 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.815153 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/98f3f7b3-5659-426d-a36b-917abed54f90-secret-thanos-querier-tls\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.815417 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.815176 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvnqj\" (UniqueName: \"kubernetes.io/projected/98f3f7b3-5659-426d-a36b-917abed54f90-kube-api-access-nvnqj\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.815981 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.815929 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98f3f7b3-5659-426d-a36b-917abed54f90-metrics-client-ca\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.823411 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.818554 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98f3f7b3-5659-426d-a36b-917abed54f90-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.823411 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.818643 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/98f3f7b3-5659-426d-a36b-917abed54f90-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.823411 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.818719 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/98f3f7b3-5659-426d-a36b-917abed54f90-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.823411 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.818723 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/98f3f7b3-5659-426d-a36b-917abed54f90-secret-grpc-tls\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.823411 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.818735 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/98f3f7b3-5659-426d-a36b-917abed54f90-secret-thanos-querier-tls\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.823910 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.823879 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98f3f7b3-5659-426d-a36b-917abed54f90-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:11.824541 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:11.824522 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvnqj\" (UniqueName: \"kubernetes.io/projected/98f3f7b3-5659-426d-a36b-917abed54f90-kube-api-access-nvnqj\") pod \"thanos-querier-78dcc646dd-qfcfd\" (UID: \"98f3f7b3-5659-426d-a36b-917abed54f90\") " pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:12.000900 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:12.000867 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:12.308243 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:12.308220 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-78dcc646dd-qfcfd"] Jul 07 18:24:12.345626 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:24:12.345596 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98f3f7b3_5659_426d_a36b_917abed54f90.slice/crio-b3c5a564b4fd907b41aefd3ba18c61bf747f0eef7a38bbfd1f73c703b37f55fa WatchSource:0}: Error finding container b3c5a564b4fd907b41aefd3ba18c61bf747f0eef7a38bbfd1f73c703b37f55fa: Status 404 returned error can't find the container with id b3c5a564b4fd907b41aefd3ba18c61bf747f0eef7a38bbfd1f73c703b37f55fa Jul 07 18:24:12.646178 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:12.646091 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" event={"ID":"98f3f7b3-5659-426d-a36b-917abed54f90","Type":"ContainerStarted","Data":"b3c5a564b4fd907b41aefd3ba18c61bf747f0eef7a38bbfd1f73c703b37f55fa"} Jul 07 18:24:12.647521 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:12.647493 2580 generic.go:356] "Generic (PLEG): container finished" podID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerID="ca1dabdc64bdb2522b0583a782b36f53430dff022506516c52b65a8d8cdcff81" exitCode=0 Jul 07 18:24:12.647622 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:12.647583 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01b8fe54-da10-4161-aa6f-9edd9214bdc6","Type":"ContainerDied","Data":"ca1dabdc64bdb2522b0583a782b36f53430dff022506516c52b65a8d8cdcff81"} Jul 07 18:24:12.984113 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:12.984079 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5bfb47d9b4-q54np"] Jul 07 18:24:12.986820 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:12.986801 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:12.989275 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:12.989250 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 07 18:24:12.989657 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:12.989635 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-38vc4644bm900\"" Jul 07 18:24:12.989785 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:12.989766 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 18:24:12.990128 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:12.990110 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rp6fx\"" Jul 07 18:24:12.990217 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:12.990112 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 07 18:24:12.990705 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:12.990678 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 07 18:24:12.995887 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:12.995867 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bfb47d9b4-q54np"] Jul 07 18:24:13.027056 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.027026 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/174e26f4-6d04-471c-9c43-14fcf2477ce7-metrics-server-audit-profiles\") pod \"metrics-server-5bfb47d9b4-q54np\" (UID: \"174e26f4-6d04-471c-9c43-14fcf2477ce7\") " pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:13.027490 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.027080 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/174e26f4-6d04-471c-9c43-14fcf2477ce7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bfb47d9b4-q54np\" (UID: \"174e26f4-6d04-471c-9c43-14fcf2477ce7\") " pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:13.027490 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.027132 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/174e26f4-6d04-471c-9c43-14fcf2477ce7-audit-log\") pod \"metrics-server-5bfb47d9b4-q54np\" (UID: \"174e26f4-6d04-471c-9c43-14fcf2477ce7\") " pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:13.027490 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.027172 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thh9w\" (UniqueName: \"kubernetes.io/projected/174e26f4-6d04-471c-9c43-14fcf2477ce7-kube-api-access-thh9w\") pod \"metrics-server-5bfb47d9b4-q54np\" (UID: \"174e26f4-6d04-471c-9c43-14fcf2477ce7\") " pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:13.027490 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.027226 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/174e26f4-6d04-471c-9c43-14fcf2477ce7-secret-metrics-server-tls\") pod \"metrics-server-5bfb47d9b4-q54np\" (UID: \"174e26f4-6d04-471c-9c43-14fcf2477ce7\") " pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:13.027490 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.027321 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/174e26f4-6d04-471c-9c43-14fcf2477ce7-secret-metrics-server-client-certs\") pod \"metrics-server-5bfb47d9b4-q54np\" (UID: \"174e26f4-6d04-471c-9c43-14fcf2477ce7\") " pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:13.027490 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.027359 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/174e26f4-6d04-471c-9c43-14fcf2477ce7-client-ca-bundle\") pod \"metrics-server-5bfb47d9b4-q54np\" (UID: \"174e26f4-6d04-471c-9c43-14fcf2477ce7\") " pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:13.128532 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.128488 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/174e26f4-6d04-471c-9c43-14fcf2477ce7-secret-metrics-server-client-certs\") pod \"metrics-server-5bfb47d9b4-q54np\" (UID: \"174e26f4-6d04-471c-9c43-14fcf2477ce7\") " pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:13.128532 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.128532 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/174e26f4-6d04-471c-9c43-14fcf2477ce7-client-ca-bundle\") pod \"metrics-server-5bfb47d9b4-q54np\" (UID: \"174e26f4-6d04-471c-9c43-14fcf2477ce7\") " pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:13.128744 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.128551 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/174e26f4-6d04-471c-9c43-14fcf2477ce7-metrics-server-audit-profiles\") pod \"metrics-server-5bfb47d9b4-q54np\" (UID: \"174e26f4-6d04-471c-9c43-14fcf2477ce7\") " pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:13.128744 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.128586 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/174e26f4-6d04-471c-9c43-14fcf2477ce7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bfb47d9b4-q54np\" (UID: \"174e26f4-6d04-471c-9c43-14fcf2477ce7\") " pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:13.128744 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.128634 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/174e26f4-6d04-471c-9c43-14fcf2477ce7-audit-log\") pod \"metrics-server-5bfb47d9b4-q54np\" (UID: \"174e26f4-6d04-471c-9c43-14fcf2477ce7\") " pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:13.128744 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.128677 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thh9w\" (UniqueName: \"kubernetes.io/projected/174e26f4-6d04-471c-9c43-14fcf2477ce7-kube-api-access-thh9w\") pod \"metrics-server-5bfb47d9b4-q54np\" (UID: \"174e26f4-6d04-471c-9c43-14fcf2477ce7\") " pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:13.128744 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.128723 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/174e26f4-6d04-471c-9c43-14fcf2477ce7-secret-metrics-server-tls\") pod \"metrics-server-5bfb47d9b4-q54np\" (UID: \"174e26f4-6d04-471c-9c43-14fcf2477ce7\") " pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:13.129172 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.129139 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/174e26f4-6d04-471c-9c43-14fcf2477ce7-audit-log\") pod \"metrics-server-5bfb47d9b4-q54np\" (UID: \"174e26f4-6d04-471c-9c43-14fcf2477ce7\") " pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:13.129449 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.129426 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/174e26f4-6d04-471c-9c43-14fcf2477ce7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bfb47d9b4-q54np\" (UID: \"174e26f4-6d04-471c-9c43-14fcf2477ce7\") " pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:13.129590 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.129572 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/174e26f4-6d04-471c-9c43-14fcf2477ce7-metrics-server-audit-profiles\") pod \"metrics-server-5bfb47d9b4-q54np\" (UID: \"174e26f4-6d04-471c-9c43-14fcf2477ce7\") " pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:13.131104 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.131076 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/174e26f4-6d04-471c-9c43-14fcf2477ce7-client-ca-bundle\") pod \"metrics-server-5bfb47d9b4-q54np\" (UID: \"174e26f4-6d04-471c-9c43-14fcf2477ce7\") " pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:13.131197 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.131168 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/174e26f4-6d04-471c-9c43-14fcf2477ce7-secret-metrics-server-tls\") pod \"metrics-server-5bfb47d9b4-q54np\" (UID: \"174e26f4-6d04-471c-9c43-14fcf2477ce7\") " pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:13.131258 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.131241 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/174e26f4-6d04-471c-9c43-14fcf2477ce7-secret-metrics-server-client-certs\") pod \"metrics-server-5bfb47d9b4-q54np\" (UID: \"174e26f4-6d04-471c-9c43-14fcf2477ce7\") " pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:13.137670 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.137650 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thh9w\" (UniqueName: \"kubernetes.io/projected/174e26f4-6d04-471c-9c43-14fcf2477ce7-kube-api-access-thh9w\") pod \"metrics-server-5bfb47d9b4-q54np\" (UID: \"174e26f4-6d04-471c-9c43-14fcf2477ce7\") " pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:13.185404 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.185368 2580 scope.go:117] "RemoveContainer" containerID="87cf4405d1f4be534e0c02aeada9a7e94bbeb94b2f8e0bbf4e1c5f7bc40a83b3" Jul 07 18:24:13.298346 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.298314 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:13.463867 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.463839 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bfb47d9b4-q54np"] Jul 07 18:24:13.465413 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:24:13.465385 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod174e26f4_6d04_471c_9c43_14fcf2477ce7.slice/crio-3028a6764303aee7980b35cd3df67bf3b2015ac53856837ea0579e1de04d9bd8 WatchSource:0}: Error finding container 3028a6764303aee7980b35cd3df67bf3b2015ac53856837ea0579e1de04d9bd8: Status 404 returned error can't find the container with id 3028a6764303aee7980b35cd3df67bf3b2015ac53856837ea0579e1de04d9bd8 Jul 07 18:24:13.656432 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.656356 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/2.log" Jul 07 18:24:13.656619 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.656482 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" event={"ID":"f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7","Type":"ContainerStarted","Data":"3faecc2fca44dcb1a9365f293017931b3417a752d9ae3606d19059d5ff901d65"} Jul 07 18:24:13.657141 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.656954 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" Jul 07 18:24:13.657918 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.657864 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" event={"ID":"174e26f4-6d04-471c-9c43-14fcf2477ce7","Type":"ContainerStarted","Data":"3028a6764303aee7980b35cd3df67bf3b2015ac53856837ea0579e1de04d9bd8"} Jul 07 18:24:13.675017 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:13.674961 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" podStartSLOduration=65.278544926 podStartE2EDuration="1m12.674944669s" totalImagesPullingTime="7.396399743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:24:13.673024667 +0000 UTC m=+94.803676691" watchObservedRunningTime="2026-07-07 18:24:13.674944669 +0000 UTC m=+94.805596691" Jul 07 18:24:14.526048 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:14.526019 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-c8qbd" Jul 07 18:24:14.549237 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:14.549211 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:24:16.677104 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:16.677056 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" event={"ID":"174e26f4-6d04-471c-9c43-14fcf2477ce7","Type":"ContainerStarted","Data":"50ee993afd6ca9ad8c5cceeb1baacd2cffbc6d2f89f44d18ee4f483ec82b65ea"} Jul 07 18:24:16.679232 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:16.679201 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" event={"ID":"98f3f7b3-5659-426d-a36b-917abed54f90","Type":"ContainerStarted","Data":"acb50199567585c0c2ac8908e11ecb176df0002b97d54e8ae0d8b75d20a11006"} Jul 07 18:24:16.679391 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:16.679264 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" event={"ID":"98f3f7b3-5659-426d-a36b-917abed54f90","Type":"ContainerStarted","Data":"3925b144bad5a6534efcfba695b3b89b5ea4f54d067ebcf8d0269ece8ec56fc3"} Jul 07 18:24:16.679391 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:16.679300 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" event={"ID":"98f3f7b3-5659-426d-a36b-917abed54f90","Type":"ContainerStarted","Data":"b6ac130689c064e7c86f9f28ecf008e9dfce93ff5bc2386c405e5e4bf8ef657c"} Jul 07 18:24:16.682168 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:16.682147 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01b8fe54-da10-4161-aa6f-9edd9214bdc6","Type":"ContainerStarted","Data":"3a6e79b3040e41c9bd41b90becce47d1de266e319f4f1fd7064f117f120b3086"} Jul 07 18:24:16.682262 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:16.682195 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01b8fe54-da10-4161-aa6f-9edd9214bdc6","Type":"ContainerStarted","Data":"a4dedbb7b7c4e2e484113ecb307202e1a0fc7f4942335a6506800a307440bee3"} Jul 07 18:24:16.682262 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:16.682221 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01b8fe54-da10-4161-aa6f-9edd9214bdc6","Type":"ContainerStarted","Data":"51d82cca41f0cb5ab9c9be0e014db1c0ffbec99ec23bd68eb8c05f76dd1a3e30"} Jul 07 18:24:16.682262 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:16.682244 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01b8fe54-da10-4161-aa6f-9edd9214bdc6","Type":"ContainerStarted","Data":"16828d2babd8216c1e0916931122b4ae234cb97b05e671b85a776a954bd293c3"} Jul 07 18:24:16.682358 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:16.682266 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01b8fe54-da10-4161-aa6f-9edd9214bdc6","Type":"ContainerStarted","Data":"69127456cc12659a008bacd4fd942f025eca5279151e2360fe1325d5db9c3db7"} Jul 07 18:24:17.689336 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:17.689294 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" event={"ID":"98f3f7b3-5659-426d-a36b-917abed54f90","Type":"ContainerStarted","Data":"6e5a53be5a484aed3827a436c22ae638026b76a95949bebfe4fb877f7e35b9d9"} Jul 07 18:24:17.689817 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:17.689385 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" event={"ID":"98f3f7b3-5659-426d-a36b-917abed54f90","Type":"ContainerStarted","Data":"33b27346c080062b54e92eb3b07aa8cd16c85e370bb3280d62e67cfc4b66700d"} Jul 07 18:24:17.689817 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:17.689477 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:17.689817 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:17.689519 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" event={"ID":"98f3f7b3-5659-426d-a36b-917abed54f90","Type":"ContainerStarted","Data":"d9571038e563767d81796f9146bdf292eb2b98ab72996e74eceb230fa0cd0d6c"} Jul 07 18:24:17.695514 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:17.695485 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01b8fe54-da10-4161-aa6f-9edd9214bdc6","Type":"ContainerStarted","Data":"e1764766d7b68e8f018a210c14d41ef4fd42687044316e79b111e7f4b56320fa"} Jul 07 18:24:17.727712 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:17.727665 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" podStartSLOduration=2.230035508 podStartE2EDuration="6.727649419s" totalImagesPullingTime="4.497613911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:24:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:24:17.726130492 +0000 UTC m=+98.856782525" watchObservedRunningTime="2026-07-07 18:24:17.727649419 +0000 UTC m=+98.858301475" Jul 07 18:24:17.727934 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:17.727915 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" podStartSLOduration=3.225933474 podStartE2EDuration="5.727908144s" totalImagesPullingTime="2.50197467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:24:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:24:16.719207452 +0000 UTC m=+97.849859475" watchObservedRunningTime="2026-07-07 18:24:17.727908144 +0000 UTC m=+98.858560529" Jul 07 18:24:17.808494 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:17.808432 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.373653627 podStartE2EDuration="8.808411537s" totalImagesPullingTime="5.4134084s" totalInitContainerRuntime="21.34951ms" isStatefulPod=false podCreationTimestamp="2026-07-07 18:24:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:24:17.806605275 +0000 UTC m=+98.937257298" watchObservedRunningTime="2026-07-07 18:24:17.808411537 +0000 UTC m=+98.939063561" Jul 07 18:24:18.373609 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:18.373572 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f77fd79ff-zf7d7"] Jul 07 18:24:18.514808 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:18.514781 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lg59n" Jul 07 18:24:19.080208 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.080177 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-657b6c9d5b-qfxnp"] Jul 07 18:24:19.082925 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.082906 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:19.085718 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.085691 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 18:24:19.086980 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.086955 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sh5tt\"" Jul 07 18:24:19.087062 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.086980 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 18:24:19.087062 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.087035 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 18:24:19.087629 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.087613 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 18:24:19.087629 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.087622 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 18:24:19.087753 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.087637 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 18:24:19.087753 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.087623 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 18:24:19.098208 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.098188 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657b6c9d5b-qfxnp"] Jul 07 18:24:19.184378 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.184341 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6j5x\" (UniqueName: \"kubernetes.io/projected/99591410-cf61-48c7-aaa1-5844a7cbdc2d-kube-api-access-h6j5x\") pod \"console-657b6c9d5b-qfxnp\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:19.184576 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.184401 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99591410-cf61-48c7-aaa1-5844a7cbdc2d-console-oauth-config\") pod \"console-657b6c9d5b-qfxnp\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:19.184576 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.184425 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99591410-cf61-48c7-aaa1-5844a7cbdc2d-service-ca\") pod \"console-657b6c9d5b-qfxnp\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:19.184576 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.184481 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99591410-cf61-48c7-aaa1-5844a7cbdc2d-oauth-serving-cert\") pod \"console-657b6c9d5b-qfxnp\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:19.184576 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.184541 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99591410-cf61-48c7-aaa1-5844a7cbdc2d-console-config\") pod \"console-657b6c9d5b-qfxnp\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:19.184713 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.184592 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99591410-cf61-48c7-aaa1-5844a7cbdc2d-console-serving-cert\") pod \"console-657b6c9d5b-qfxnp\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:19.285515 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.285445 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99591410-cf61-48c7-aaa1-5844a7cbdc2d-console-serving-cert\") pod \"console-657b6c9d5b-qfxnp\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:19.285629 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.285562 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6j5x\" (UniqueName: \"kubernetes.io/projected/99591410-cf61-48c7-aaa1-5844a7cbdc2d-kube-api-access-h6j5x\") pod \"console-657b6c9d5b-qfxnp\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:19.285629 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.285609 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99591410-cf61-48c7-aaa1-5844a7cbdc2d-console-oauth-config\") pod \"console-657b6c9d5b-qfxnp\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:19.285738 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.285640 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99591410-cf61-48c7-aaa1-5844a7cbdc2d-service-ca\") pod \"console-657b6c9d5b-qfxnp\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:19.285738 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.285671 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99591410-cf61-48c7-aaa1-5844a7cbdc2d-oauth-serving-cert\") pod \"console-657b6c9d5b-qfxnp\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:19.285738 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.285691 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99591410-cf61-48c7-aaa1-5844a7cbdc2d-console-config\") pod \"console-657b6c9d5b-qfxnp\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:19.286401 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.286377 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99591410-cf61-48c7-aaa1-5844a7cbdc2d-console-config\") pod \"console-657b6c9d5b-qfxnp\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:19.286529 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.286429 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99591410-cf61-48c7-aaa1-5844a7cbdc2d-oauth-serving-cert\") pod \"console-657b6c9d5b-qfxnp\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:19.286607 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.286580 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99591410-cf61-48c7-aaa1-5844a7cbdc2d-service-ca\") pod \"console-657b6c9d5b-qfxnp\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:19.287961 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.287943 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99591410-cf61-48c7-aaa1-5844a7cbdc2d-console-serving-cert\") pod \"console-657b6c9d5b-qfxnp\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:19.288059 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.287947 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99591410-cf61-48c7-aaa1-5844a7cbdc2d-console-oauth-config\") pod \"console-657b6c9d5b-qfxnp\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:19.298499 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.298479 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6j5x\" (UniqueName: \"kubernetes.io/projected/99591410-cf61-48c7-aaa1-5844a7cbdc2d-kube-api-access-h6j5x\") pod \"console-657b6c9d5b-qfxnp\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:19.392648 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.392571 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:19.525319 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.525293 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657b6c9d5b-qfxnp"] Jul 07 18:24:19.527605 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:24:19.527581 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99591410_cf61_48c7_aaa1_5844a7cbdc2d.slice/crio-6bbc3aaa3a5dd5a746b767ddc61bd5a4b2319a6ab5bdcdc2b3577324f6525bc4 WatchSource:0}: Error finding container 6bbc3aaa3a5dd5a746b767ddc61bd5a4b2319a6ab5bdcdc2b3577324f6525bc4: Status 404 returned error can't find the container with id 6bbc3aaa3a5dd5a746b767ddc61bd5a4b2319a6ab5bdcdc2b3577324f6525bc4 Jul 07 18:24:19.704666 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:19.704574 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657b6c9d5b-qfxnp" event={"ID":"99591410-cf61-48c7-aaa1-5844a7cbdc2d","Type":"ContainerStarted","Data":"6bbc3aaa3a5dd5a746b767ddc61bd5a4b2319a6ab5bdcdc2b3577324f6525bc4"} Jul 07 18:24:23.705250 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:23.705222 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-78dcc646dd-qfcfd" Jul 07 18:24:24.728503 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:24.728449 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657b6c9d5b-qfxnp" event={"ID":"99591410-cf61-48c7-aaa1-5844a7cbdc2d","Type":"ContainerStarted","Data":"349a170bb4d202dd06ae97cc9c47375108271335eeb439019244ed690874914b"} Jul 07 18:24:24.758057 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:24.758009 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-657b6c9d5b-qfxnp" podStartSLOduration=1.5360123799999998 podStartE2EDuration="5.757991251s" totalImagesPullingTime="4.221978871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:24:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:24:24.755044137 +0000 UTC m=+105.885696159" watchObservedRunningTime="2026-07-07 18:24:24.757991251 +0000 UTC m=+105.888643274" Jul 07 18:24:29.393246 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:29.393212 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:29.393652 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:29.393273 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:29.397658 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:29.397640 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:29.751683 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:29.751652 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:24:33.299346 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:33.299312 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:33.299753 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:33.299377 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:38.716238 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:38.716205 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-657b6c9d5b-qfxnp"] Jul 07 18:24:43.393880 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.393835 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" podUID="94120e3a-209a-4ca3-8807-6e0e759f4c48" containerName="registry" containerID="cri-o://886c7571247b4a12849c713bd217b59ebe40d71ee8622145da47c113e6cdce30" gracePeriod=30 Jul 07 18:24:43.639301 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.639277 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:24:43.804913 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.804881 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94120e3a-209a-4ca3-8807-6e0e759f4c48-trusted-ca\") pod \"94120e3a-209a-4ca3-8807-6e0e759f4c48\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " Jul 07 18:24:43.805110 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.804926 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/94120e3a-209a-4ca3-8807-6e0e759f4c48-ca-trust-extracted\") pod \"94120e3a-209a-4ca3-8807-6e0e759f4c48\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " Jul 07 18:24:43.805110 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.804964 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-bound-sa-token\") pod \"94120e3a-209a-4ca3-8807-6e0e759f4c48\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " Jul 07 18:24:43.805110 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.805037 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zzb6\" (UniqueName: \"kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-kube-api-access-5zzb6\") pod \"94120e3a-209a-4ca3-8807-6e0e759f4c48\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " Jul 07 18:24:43.805110 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.805071 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/94120e3a-209a-4ca3-8807-6e0e759f4c48-installation-pull-secrets\") pod \"94120e3a-209a-4ca3-8807-6e0e759f4c48\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " Jul 07 18:24:43.805344 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.805114 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls\") pod \"94120e3a-209a-4ca3-8807-6e0e759f4c48\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " Jul 07 18:24:43.805344 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.805325 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-certificates\") pod \"94120e3a-209a-4ca3-8807-6e0e759f4c48\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " Jul 07 18:24:43.805452 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.805335 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94120e3a-209a-4ca3-8807-6e0e759f4c48-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "94120e3a-209a-4ca3-8807-6e0e759f4c48" (UID: "94120e3a-209a-4ca3-8807-6e0e759f4c48"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:24:43.805452 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.805382 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/94120e3a-209a-4ca3-8807-6e0e759f4c48-image-registry-private-configuration\") pod \"94120e3a-209a-4ca3-8807-6e0e759f4c48\" (UID: \"94120e3a-209a-4ca3-8807-6e0e759f4c48\") " Jul 07 18:24:43.805710 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.805690 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94120e3a-209a-4ca3-8807-6e0e759f4c48-trusted-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:24:43.805920 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.805873 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "94120e3a-209a-4ca3-8807-6e0e759f4c48" (UID: "94120e3a-209a-4ca3-8807-6e0e759f4c48"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:24:43.806647 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.806315 2580 generic.go:356] "Generic (PLEG): container finished" podID="94120e3a-209a-4ca3-8807-6e0e759f4c48" containerID="886c7571247b4a12849c713bd217b59ebe40d71ee8622145da47c113e6cdce30" exitCode=0 Jul 07 18:24:43.806647 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.806387 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" Jul 07 18:24:43.806647 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.806423 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" event={"ID":"94120e3a-209a-4ca3-8807-6e0e759f4c48","Type":"ContainerDied","Data":"886c7571247b4a12849c713bd217b59ebe40d71ee8622145da47c113e6cdce30"} Jul 07 18:24:43.806647 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.806490 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f77fd79ff-zf7d7" event={"ID":"94120e3a-209a-4ca3-8807-6e0e759f4c48","Type":"ContainerDied","Data":"a070986d41425030819b2b623f2b72201f54154f3f25d5ccf1ddb90b0f667518"} Jul 07 18:24:43.806647 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.806520 2580 scope.go:117] "RemoveContainer" containerID="886c7571247b4a12849c713bd217b59ebe40d71ee8622145da47c113e6cdce30" Jul 07 18:24:43.808296 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.808215 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94120e3a-209a-4ca3-8807-6e0e759f4c48-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "94120e3a-209a-4ca3-8807-6e0e759f4c48" (UID: "94120e3a-209a-4ca3-8807-6e0e759f4c48"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:24:43.808296 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.808259 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "94120e3a-209a-4ca3-8807-6e0e759f4c48" (UID: "94120e3a-209a-4ca3-8807-6e0e759f4c48"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:24:43.808472 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.808390 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-kube-api-access-5zzb6" (OuterVolumeSpecName: "kube-api-access-5zzb6") pod "94120e3a-209a-4ca3-8807-6e0e759f4c48" (UID: "94120e3a-209a-4ca3-8807-6e0e759f4c48"). InnerVolumeSpecName "kube-api-access-5zzb6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:24:43.808537 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.808473 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "94120e3a-209a-4ca3-8807-6e0e759f4c48" (UID: "94120e3a-209a-4ca3-8807-6e0e759f4c48"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:24:43.808714 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.808679 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94120e3a-209a-4ca3-8807-6e0e759f4c48-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "94120e3a-209a-4ca3-8807-6e0e759f4c48" (UID: "94120e3a-209a-4ca3-8807-6e0e759f4c48"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:24:43.816848 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.816822 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94120e3a-209a-4ca3-8807-6e0e759f4c48-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "94120e3a-209a-4ca3-8807-6e0e759f4c48" (UID: "94120e3a-209a-4ca3-8807-6e0e759f4c48"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:24:43.825225 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.825206 2580 scope.go:117] "RemoveContainer" containerID="886c7571247b4a12849c713bd217b59ebe40d71ee8622145da47c113e6cdce30" Jul 07 18:24:43.825558 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:24:43.825529 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"886c7571247b4a12849c713bd217b59ebe40d71ee8622145da47c113e6cdce30\": container with ID starting with 886c7571247b4a12849c713bd217b59ebe40d71ee8622145da47c113e6cdce30 not found: ID does not exist" containerID="886c7571247b4a12849c713bd217b59ebe40d71ee8622145da47c113e6cdce30" Jul 07 18:24:43.825623 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.825571 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"886c7571247b4a12849c713bd217b59ebe40d71ee8622145da47c113e6cdce30"} err="failed to get container status \"886c7571247b4a12849c713bd217b59ebe40d71ee8622145da47c113e6cdce30\": rpc error: code = NotFound desc = could not find container \"886c7571247b4a12849c713bd217b59ebe40d71ee8622145da47c113e6cdce30\": container with ID starting with 886c7571247b4a12849c713bd217b59ebe40d71ee8622145da47c113e6cdce30 not found: ID does not exist" Jul 07 18:24:43.906725 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.906695 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-bound-sa-token\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:24:43.906725 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.906721 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zzb6\" (UniqueName: \"kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-kube-api-access-5zzb6\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:24:43.906725 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.906730 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/94120e3a-209a-4ca3-8807-6e0e759f4c48-installation-pull-secrets\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:24:43.906940 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.906739 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:24:43.906940 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.906748 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/94120e3a-209a-4ca3-8807-6e0e759f4c48-registry-certificates\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:24:43.906940 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.906758 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/94120e3a-209a-4ca3-8807-6e0e759f4c48-image-registry-private-configuration\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:24:43.906940 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:43.906767 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/94120e3a-209a-4ca3-8807-6e0e759f4c48-ca-trust-extracted\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:24:44.144262 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:44.144232 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f77fd79ff-zf7d7"] Jul 07 18:24:44.151324 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:44.151295 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-f77fd79ff-zf7d7"] Jul 07 18:24:44.194835 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:44.194803 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94120e3a-209a-4ca3-8807-6e0e759f4c48" path="/var/lib/kubelet/pods/94120e3a-209a-4ca3-8807-6e0e759f4c48/volumes" Jul 07 18:24:44.812034 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:44.812003 2580 generic.go:356] "Generic (PLEG): container finished" podID="b8491d42-ab30-44db-a098-d51bb210dbeb" containerID="a75ea1ee3c3a2bf06aafa846e2a952a46f02fecfedeb8597a3ad94c91388b260" exitCode=0 Jul 07 18:24:44.812523 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:44.812083 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vtgpm" event={"ID":"b8491d42-ab30-44db-a098-d51bb210dbeb","Type":"ContainerDied","Data":"a75ea1ee3c3a2bf06aafa846e2a952a46f02fecfedeb8597a3ad94c91388b260"} Jul 07 18:24:44.812523 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:44.812504 2580 scope.go:117] "RemoveContainer" containerID="a75ea1ee3c3a2bf06aafa846e2a952a46f02fecfedeb8597a3ad94c91388b260" Jul 07 18:24:45.819598 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:45.819563 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-vtgpm" event={"ID":"b8491d42-ab30-44db-a098-d51bb210dbeb","Type":"ContainerStarted","Data":"c54a9eba3e2a398e5aa33f66a50aa5b8f650e11ac558b16080bf05498a7c7e8c"} Jul 07 18:24:49.836602 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:49.836509 2580 generic.go:356] "Generic (PLEG): container finished" podID="3c6efb43-250b-4db1-bd62-e87d1ee11077" containerID="460894f91ff17eb9c71a2f459199c25602645d1f26d1999896dbedbddf9e0914" exitCode=0 Jul 07 18:24:49.836602 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:49.836585 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" event={"ID":"3c6efb43-250b-4db1-bd62-e87d1ee11077","Type":"ContainerDied","Data":"460894f91ff17eb9c71a2f459199c25602645d1f26d1999896dbedbddf9e0914"} Jul 07 18:24:49.837104 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:49.836982 2580 scope.go:117] "RemoveContainer" containerID="460894f91ff17eb9c71a2f459199c25602645d1f26d1999896dbedbddf9e0914" Jul 07 18:24:50.842997 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:50.842963 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-g9hm4" event={"ID":"3c6efb43-250b-4db1-bd62-e87d1ee11077","Type":"ContainerStarted","Data":"89d25873f530c43aa2630dfb2766596250a04620b508b363f5a1bb5670d563da"} Jul 07 18:24:53.304591 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:53.304562 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:24:53.308291 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:24:53.308270 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5bfb47d9b4-q54np" Jul 07 18:25:03.737695 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:03.737618 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-657b6c9d5b-qfxnp" podUID="99591410-cf61-48c7-aaa1-5844a7cbdc2d" containerName="console" containerID="cri-o://349a170bb4d202dd06ae97cc9c47375108271335eeb439019244ed690874914b" gracePeriod=15 Jul 07 18:25:03.898637 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:03.898599 2580 generic.go:356] "Generic (PLEG): container finished" podID="99591410-cf61-48c7-aaa1-5844a7cbdc2d" containerID="349a170bb4d202dd06ae97cc9c47375108271335eeb439019244ed690874914b" exitCode=0 Jul 07 18:25:03.898804 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:03.898670 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657b6c9d5b-qfxnp" event={"ID":"99591410-cf61-48c7-aaa1-5844a7cbdc2d","Type":"ContainerDied","Data":"349a170bb4d202dd06ae97cc9c47375108271335eeb439019244ed690874914b"} Jul 07 18:25:04.024580 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.024555 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:25:04.083817 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.083785 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99591410-cf61-48c7-aaa1-5844a7cbdc2d-console-config\") pod \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " Jul 07 18:25:04.084182 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.084152 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99591410-cf61-48c7-aaa1-5844a7cbdc2d-console-serving-cert\") pod \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " Jul 07 18:25:04.084331 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.084226 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99591410-cf61-48c7-aaa1-5844a7cbdc2d-oauth-serving-cert\") pod \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " Jul 07 18:25:04.084331 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.084254 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99591410-cf61-48c7-aaa1-5844a7cbdc2d-console-oauth-config\") pod \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " Jul 07 18:25:04.084331 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.084277 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99591410-cf61-48c7-aaa1-5844a7cbdc2d-service-ca\") pod \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " Jul 07 18:25:04.084331 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.084307 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6j5x\" (UniqueName: \"kubernetes.io/projected/99591410-cf61-48c7-aaa1-5844a7cbdc2d-kube-api-access-h6j5x\") pod \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\" (UID: \"99591410-cf61-48c7-aaa1-5844a7cbdc2d\") " Jul 07 18:25:04.084331 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.084316 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99591410-cf61-48c7-aaa1-5844a7cbdc2d-console-config" (OuterVolumeSpecName: "console-config") pod "99591410-cf61-48c7-aaa1-5844a7cbdc2d" (UID: "99591410-cf61-48c7-aaa1-5844a7cbdc2d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:25:04.084626 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.084569 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99591410-cf61-48c7-aaa1-5844a7cbdc2d-console-config\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:25:04.084626 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.084605 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99591410-cf61-48c7-aaa1-5844a7cbdc2d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "99591410-cf61-48c7-aaa1-5844a7cbdc2d" (UID: "99591410-cf61-48c7-aaa1-5844a7cbdc2d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:25:04.084735 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.084618 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99591410-cf61-48c7-aaa1-5844a7cbdc2d-service-ca" (OuterVolumeSpecName: "service-ca") pod "99591410-cf61-48c7-aaa1-5844a7cbdc2d" (UID: "99591410-cf61-48c7-aaa1-5844a7cbdc2d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:25:04.087167 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.087127 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99591410-cf61-48c7-aaa1-5844a7cbdc2d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "99591410-cf61-48c7-aaa1-5844a7cbdc2d" (UID: "99591410-cf61-48c7-aaa1-5844a7cbdc2d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:25:04.087272 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.087210 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99591410-cf61-48c7-aaa1-5844a7cbdc2d-kube-api-access-h6j5x" (OuterVolumeSpecName: "kube-api-access-h6j5x") pod "99591410-cf61-48c7-aaa1-5844a7cbdc2d" (UID: "99591410-cf61-48c7-aaa1-5844a7cbdc2d"). InnerVolumeSpecName "kube-api-access-h6j5x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:25:04.098562 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.098534 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99591410-cf61-48c7-aaa1-5844a7cbdc2d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "99591410-cf61-48c7-aaa1-5844a7cbdc2d" (UID: "99591410-cf61-48c7-aaa1-5844a7cbdc2d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:25:04.185677 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.185646 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99591410-cf61-48c7-aaa1-5844a7cbdc2d-console-serving-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:25:04.185677 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.185674 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99591410-cf61-48c7-aaa1-5844a7cbdc2d-oauth-serving-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:25:04.185677 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.185683 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99591410-cf61-48c7-aaa1-5844a7cbdc2d-console-oauth-config\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:25:04.185893 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.185693 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99591410-cf61-48c7-aaa1-5844a7cbdc2d-service-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:25:04.185893 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.185701 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6j5x\" (UniqueName: \"kubernetes.io/projected/99591410-cf61-48c7-aaa1-5844a7cbdc2d-kube-api-access-h6j5x\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:25:04.906750 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.906712 2580 generic.go:356] "Generic (PLEG): container finished" podID="f5c769ba-6ad9-4cf7-94e5-4a7dbab806cc" containerID="a7450c293ce8339d71ddcfab159d6351b66f82722abce0b0f088f6af4ad65c0c" exitCode=0 Jul 07 18:25:04.907191 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.906797 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4trkp" event={"ID":"f5c769ba-6ad9-4cf7-94e5-4a7dbab806cc","Type":"ContainerDied","Data":"a7450c293ce8339d71ddcfab159d6351b66f82722abce0b0f088f6af4ad65c0c"} Jul 07 18:25:04.907262 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.907200 2580 scope.go:117] "RemoveContainer" containerID="a7450c293ce8339d71ddcfab159d6351b66f82722abce0b0f088f6af4ad65c0c" Jul 07 18:25:04.908266 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.908240 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657b6c9d5b-qfxnp" event={"ID":"99591410-cf61-48c7-aaa1-5844a7cbdc2d","Type":"ContainerDied","Data":"6bbc3aaa3a5dd5a746b767ddc61bd5a4b2319a6ab5bdcdc2b3577324f6525bc4"} Jul 07 18:25:04.908366 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.908291 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657b6c9d5b-qfxnp" Jul 07 18:25:04.908366 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.908298 2580 scope.go:117] "RemoveContainer" containerID="349a170bb4d202dd06ae97cc9c47375108271335eeb439019244ed690874914b" Jul 07 18:25:04.941222 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.941194 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-657b6c9d5b-qfxnp"] Jul 07 18:25:04.947609 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:04.947582 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-657b6c9d5b-qfxnp"] Jul 07 18:25:05.915208 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:05.915170 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-4trkp" event={"ID":"f5c769ba-6ad9-4cf7-94e5-4a7dbab806cc","Type":"ContainerStarted","Data":"4e57b79fee1e13352dae58ec31be71883fa53a8556209be918320a97e493f742"} Jul 07 18:25:06.189932 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:06.189856 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99591410-cf61-48c7-aaa1-5844a7cbdc2d" path="/var/lib/kubelet/pods/99591410-cf61-48c7-aaa1-5844a7cbdc2d/volumes" Jul 07 18:25:29.267867 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:29.267832 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 18:25:29.268298 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:29.268152 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="alertmanager" containerID="cri-o://69127456cc12659a008bacd4fd942f025eca5279151e2360fe1325d5db9c3db7" gracePeriod=120 Jul 07 18:25:29.268298 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:29.268219 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="kube-rbac-proxy-metric" containerID="cri-o://3a6e79b3040e41c9bd41b90becce47d1de266e319f4f1fd7064f117f120b3086" gracePeriod=120 Jul 07 18:25:29.268417 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:29.268268 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="kube-rbac-proxy-web" containerID="cri-o://51d82cca41f0cb5ab9c9be0e014db1c0ffbec99ec23bd68eb8c05f76dd1a3e30" gracePeriod=120 Jul 07 18:25:29.268417 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:29.268308 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="config-reloader" containerID="cri-o://16828d2babd8216c1e0916931122b4ae234cb97b05e671b85a776a954bd293c3" gracePeriod=120 Jul 07 18:25:29.268417 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:29.268287 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="kube-rbac-proxy" containerID="cri-o://a4dedbb7b7c4e2e484113ecb307202e1a0fc7f4942335a6506800a307440bee3" gracePeriod=120 Jul 07 18:25:29.268611 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:29.268426 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="prom-label-proxy" containerID="cri-o://e1764766d7b68e8f018a210c14d41ef4fd42687044316e79b111e7f4b56320fa" gracePeriod=120 Jul 07 18:25:30.014530 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.014495 2580 generic.go:356] "Generic (PLEG): container finished" podID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerID="e1764766d7b68e8f018a210c14d41ef4fd42687044316e79b111e7f4b56320fa" exitCode=0 Jul 07 18:25:30.014530 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.014521 2580 generic.go:356] "Generic (PLEG): container finished" podID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerID="a4dedbb7b7c4e2e484113ecb307202e1a0fc7f4942335a6506800a307440bee3" exitCode=0 Jul 07 18:25:30.014530 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.014531 2580 generic.go:356] "Generic (PLEG): container finished" podID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerID="16828d2babd8216c1e0916931122b4ae234cb97b05e671b85a776a954bd293c3" exitCode=0 Jul 07 18:25:30.014530 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.014540 2580 generic.go:356] "Generic (PLEG): container finished" podID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerID="69127456cc12659a008bacd4fd942f025eca5279151e2360fe1325d5db9c3db7" exitCode=0 Jul 07 18:25:30.014786 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.014566 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01b8fe54-da10-4161-aa6f-9edd9214bdc6","Type":"ContainerDied","Data":"e1764766d7b68e8f018a210c14d41ef4fd42687044316e79b111e7f4b56320fa"} Jul 07 18:25:30.014786 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.014630 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01b8fe54-da10-4161-aa6f-9edd9214bdc6","Type":"ContainerDied","Data":"a4dedbb7b7c4e2e484113ecb307202e1a0fc7f4942335a6506800a307440bee3"} Jul 07 18:25:30.014786 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.014656 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01b8fe54-da10-4161-aa6f-9edd9214bdc6","Type":"ContainerDied","Data":"16828d2babd8216c1e0916931122b4ae234cb97b05e671b85a776a954bd293c3"} Jul 07 18:25:30.014786 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.014680 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01b8fe54-da10-4161-aa6f-9edd9214bdc6","Type":"ContainerDied","Data":"69127456cc12659a008bacd4fd942f025eca5279151e2360fe1325d5db9c3db7"} Jul 07 18:25:30.520354 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.520330 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:30.616895 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.616814 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01b8fe54-da10-4161-aa6f-9edd9214bdc6-tls-assets\") pod \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " Jul 07 18:25:30.616895 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.616861 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-kube-rbac-proxy-web\") pod \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " Jul 07 18:25:30.616895 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.616887 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01b8fe54-da10-4161-aa6f-9edd9214bdc6-config-out\") pod \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " Jul 07 18:25:30.617131 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.616916 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-web-config\") pod \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " Jul 07 18:25:30.617131 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.616951 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-cluster-tls-config\") pod \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " Jul 07 18:25:30.617131 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.616989 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-config-volume\") pod \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " Jul 07 18:25:30.617131 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.617012 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/01b8fe54-da10-4161-aa6f-9edd9214bdc6-alertmanager-main-db\") pod \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " Jul 07 18:25:30.617131 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.617062 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01b8fe54-da10-4161-aa6f-9edd9214bdc6-alertmanager-trusted-ca-bundle\") pod \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " Jul 07 18:25:30.617131 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.617085 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-kube-rbac-proxy\") pod \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " Jul 07 18:25:30.617131 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.617121 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgz7l\" (UniqueName: \"kubernetes.io/projected/01b8fe54-da10-4161-aa6f-9edd9214bdc6-kube-api-access-zgz7l\") pod \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " Jul 07 18:25:30.617509 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.617145 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-main-tls\") pod \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " Jul 07 18:25:30.617509 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.617210 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01b8fe54-da10-4161-aa6f-9edd9214bdc6-metrics-client-ca\") pod \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " Jul 07 18:25:30.617509 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.617260 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\" (UID: \"01b8fe54-da10-4161-aa6f-9edd9214bdc6\") " Jul 07 18:25:30.617665 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.617643 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01b8fe54-da10-4161-aa6f-9edd9214bdc6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "01b8fe54-da10-4161-aa6f-9edd9214bdc6" (UID: "01b8fe54-da10-4161-aa6f-9edd9214bdc6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:25:30.620100 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.619922 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01b8fe54-da10-4161-aa6f-9edd9214bdc6-config-out" (OuterVolumeSpecName: "config-out") pod "01b8fe54-da10-4161-aa6f-9edd9214bdc6" (UID: "01b8fe54-da10-4161-aa6f-9edd9214bdc6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:25:30.620243 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.620107 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "01b8fe54-da10-4161-aa6f-9edd9214bdc6" (UID: "01b8fe54-da10-4161-aa6f-9edd9214bdc6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:25:30.620243 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.620190 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "01b8fe54-da10-4161-aa6f-9edd9214bdc6" (UID: "01b8fe54-da10-4161-aa6f-9edd9214bdc6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:25:30.620358 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.620244 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01b8fe54-da10-4161-aa6f-9edd9214bdc6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "01b8fe54-da10-4161-aa6f-9edd9214bdc6" (UID: "01b8fe54-da10-4161-aa6f-9edd9214bdc6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:25:30.620586 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.620417 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01b8fe54-da10-4161-aa6f-9edd9214bdc6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "01b8fe54-da10-4161-aa6f-9edd9214bdc6" (UID: "01b8fe54-da10-4161-aa6f-9edd9214bdc6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:25:30.620764 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.620563 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01b8fe54-da10-4161-aa6f-9edd9214bdc6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "01b8fe54-da10-4161-aa6f-9edd9214bdc6" (UID: "01b8fe54-da10-4161-aa6f-9edd9214bdc6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:25:30.620764 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.620746 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01b8fe54-da10-4161-aa6f-9edd9214bdc6-kube-api-access-zgz7l" (OuterVolumeSpecName: "kube-api-access-zgz7l") pod "01b8fe54-da10-4161-aa6f-9edd9214bdc6" (UID: "01b8fe54-da10-4161-aa6f-9edd9214bdc6"). InnerVolumeSpecName "kube-api-access-zgz7l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:25:30.622226 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.622193 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "01b8fe54-da10-4161-aa6f-9edd9214bdc6" (UID: "01b8fe54-da10-4161-aa6f-9edd9214bdc6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:25:30.622226 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.622207 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-config-volume" (OuterVolumeSpecName: "config-volume") pod "01b8fe54-da10-4161-aa6f-9edd9214bdc6" (UID: "01b8fe54-da10-4161-aa6f-9edd9214bdc6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:25:30.622443 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.622422 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "01b8fe54-da10-4161-aa6f-9edd9214bdc6" (UID: "01b8fe54-da10-4161-aa6f-9edd9214bdc6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:25:30.624824 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.624792 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "01b8fe54-da10-4161-aa6f-9edd9214bdc6" (UID: "01b8fe54-da10-4161-aa6f-9edd9214bdc6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:25:30.632354 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.632334 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-web-config" (OuterVolumeSpecName: "web-config") pod "01b8fe54-da10-4161-aa6f-9edd9214bdc6" (UID: "01b8fe54-da10-4161-aa6f-9edd9214bdc6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:25:30.718118 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.718077 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:25:30.718118 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.718110 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01b8fe54-da10-4161-aa6f-9edd9214bdc6-tls-assets\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:25:30.718118 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.718120 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:25:30.718118 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.718131 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01b8fe54-da10-4161-aa6f-9edd9214bdc6-config-out\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:25:30.718379 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.718140 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-web-config\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:25:30.718379 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.718148 2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-cluster-tls-config\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:25:30.718379 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.718158 2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-config-volume\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:25:30.718379 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.718166 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/01b8fe54-da10-4161-aa6f-9edd9214bdc6-alertmanager-main-db\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:25:30.718379 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.718174 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01b8fe54-da10-4161-aa6f-9edd9214bdc6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:25:30.718379 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.718183 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:25:30.718379 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.718191 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgz7l\" (UniqueName: \"kubernetes.io/projected/01b8fe54-da10-4161-aa6f-9edd9214bdc6-kube-api-access-zgz7l\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:25:30.718379 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.718200 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/01b8fe54-da10-4161-aa6f-9edd9214bdc6-secret-alertmanager-main-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:25:30.718379 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:30.718208 2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01b8fe54-da10-4161-aa6f-9edd9214bdc6-metrics-client-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:25:31.027038 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.026997 2580 generic.go:356] "Generic (PLEG): container finished" podID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerID="3a6e79b3040e41c9bd41b90becce47d1de266e319f4f1fd7064f117f120b3086" exitCode=0 Jul 07 18:25:31.027038 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.027033 2580 generic.go:356] "Generic (PLEG): container finished" podID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerID="51d82cca41f0cb5ab9c9be0e014db1c0ffbec99ec23bd68eb8c05f76dd1a3e30" exitCode=0 Jul 07 18:25:31.027299 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.027097 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.027299 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.027094 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01b8fe54-da10-4161-aa6f-9edd9214bdc6","Type":"ContainerDied","Data":"3a6e79b3040e41c9bd41b90becce47d1de266e319f4f1fd7064f117f120b3086"} Jul 07 18:25:31.027299 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.027208 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01b8fe54-da10-4161-aa6f-9edd9214bdc6","Type":"ContainerDied","Data":"51d82cca41f0cb5ab9c9be0e014db1c0ffbec99ec23bd68eb8c05f76dd1a3e30"} Jul 07 18:25:31.027299 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.027251 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01b8fe54-da10-4161-aa6f-9edd9214bdc6","Type":"ContainerDied","Data":"510338f49d74fde92ceabe3c8d36a744cefb0250000612676878ab3a99fe60c4"} Jul 07 18:25:31.027299 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.027278 2580 scope.go:117] "RemoveContainer" containerID="e1764766d7b68e8f018a210c14d41ef4fd42687044316e79b111e7f4b56320fa" Jul 07 18:25:31.035004 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.034985 2580 scope.go:117] "RemoveContainer" containerID="3a6e79b3040e41c9bd41b90becce47d1de266e319f4f1fd7064f117f120b3086" Jul 07 18:25:31.044604 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.044586 2580 scope.go:117] "RemoveContainer" containerID="a4dedbb7b7c4e2e484113ecb307202e1a0fc7f4942335a6506800a307440bee3" Jul 07 18:25:31.051415 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.051398 2580 scope.go:117] "RemoveContainer" containerID="51d82cca41f0cb5ab9c9be0e014db1c0ffbec99ec23bd68eb8c05f76dd1a3e30" Jul 07 18:25:31.058049 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.058029 2580 scope.go:117] "RemoveContainer" containerID="16828d2babd8216c1e0916931122b4ae234cb97b05e671b85a776a954bd293c3" Jul 07 18:25:31.065012 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.064993 2580 scope.go:117] "RemoveContainer" containerID="69127456cc12659a008bacd4fd942f025eca5279151e2360fe1325d5db9c3db7" Jul 07 18:25:31.070842 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.070821 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 18:25:31.072930 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.072905 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 18:25:31.073438 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.073426 2580 scope.go:117] "RemoveContainer" containerID="ca1dabdc64bdb2522b0583a782b36f53430dff022506516c52b65a8d8cdcff81" Jul 07 18:25:31.080239 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.080222 2580 scope.go:117] "RemoveContainer" containerID="e1764766d7b68e8f018a210c14d41ef4fd42687044316e79b111e7f4b56320fa" Jul 07 18:25:31.080510 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:25:31.080491 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1764766d7b68e8f018a210c14d41ef4fd42687044316e79b111e7f4b56320fa\": container with ID starting with e1764766d7b68e8f018a210c14d41ef4fd42687044316e79b111e7f4b56320fa not found: ID does not exist" containerID="e1764766d7b68e8f018a210c14d41ef4fd42687044316e79b111e7f4b56320fa" Jul 07 18:25:31.080565 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.080518 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1764766d7b68e8f018a210c14d41ef4fd42687044316e79b111e7f4b56320fa"} err="failed to get container status \"e1764766d7b68e8f018a210c14d41ef4fd42687044316e79b111e7f4b56320fa\": rpc error: code = NotFound desc = could not find container \"e1764766d7b68e8f018a210c14d41ef4fd42687044316e79b111e7f4b56320fa\": container with ID starting with e1764766d7b68e8f018a210c14d41ef4fd42687044316e79b111e7f4b56320fa not found: ID does not exist" Jul 07 18:25:31.080565 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.080537 2580 scope.go:117] "RemoveContainer" containerID="3a6e79b3040e41c9bd41b90becce47d1de266e319f4f1fd7064f117f120b3086" Jul 07 18:25:31.080800 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:25:31.080776 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a6e79b3040e41c9bd41b90becce47d1de266e319f4f1fd7064f117f120b3086\": container with ID starting with 3a6e79b3040e41c9bd41b90becce47d1de266e319f4f1fd7064f117f120b3086 not found: ID does not exist" containerID="3a6e79b3040e41c9bd41b90becce47d1de266e319f4f1fd7064f117f120b3086" Jul 07 18:25:31.080856 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.080807 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a6e79b3040e41c9bd41b90becce47d1de266e319f4f1fd7064f117f120b3086"} err="failed to get container status \"3a6e79b3040e41c9bd41b90becce47d1de266e319f4f1fd7064f117f120b3086\": rpc error: code = NotFound desc = could not find container \"3a6e79b3040e41c9bd41b90becce47d1de266e319f4f1fd7064f117f120b3086\": container with ID starting with 3a6e79b3040e41c9bd41b90becce47d1de266e319f4f1fd7064f117f120b3086 not found: ID does not exist" Jul 07 18:25:31.080856 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.080823 2580 scope.go:117] "RemoveContainer" containerID="a4dedbb7b7c4e2e484113ecb307202e1a0fc7f4942335a6506800a307440bee3" Jul 07 18:25:31.081035 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:25:31.081018 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4dedbb7b7c4e2e484113ecb307202e1a0fc7f4942335a6506800a307440bee3\": container with ID starting with a4dedbb7b7c4e2e484113ecb307202e1a0fc7f4942335a6506800a307440bee3 not found: ID does not exist" containerID="a4dedbb7b7c4e2e484113ecb307202e1a0fc7f4942335a6506800a307440bee3" Jul 07 18:25:31.081071 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.081040 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4dedbb7b7c4e2e484113ecb307202e1a0fc7f4942335a6506800a307440bee3"} err="failed to get container status \"a4dedbb7b7c4e2e484113ecb307202e1a0fc7f4942335a6506800a307440bee3\": rpc error: code = NotFound desc = could not find container \"a4dedbb7b7c4e2e484113ecb307202e1a0fc7f4942335a6506800a307440bee3\": container with ID starting with a4dedbb7b7c4e2e484113ecb307202e1a0fc7f4942335a6506800a307440bee3 not found: ID does not exist" Jul 07 18:25:31.081071 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.081055 2580 scope.go:117] "RemoveContainer" containerID="51d82cca41f0cb5ab9c9be0e014db1c0ffbec99ec23bd68eb8c05f76dd1a3e30" Jul 07 18:25:31.081303 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:25:31.081287 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51d82cca41f0cb5ab9c9be0e014db1c0ffbec99ec23bd68eb8c05f76dd1a3e30\": container with ID starting with 51d82cca41f0cb5ab9c9be0e014db1c0ffbec99ec23bd68eb8c05f76dd1a3e30 not found: ID does not exist" containerID="51d82cca41f0cb5ab9c9be0e014db1c0ffbec99ec23bd68eb8c05f76dd1a3e30" Jul 07 18:25:31.081342 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.081309 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51d82cca41f0cb5ab9c9be0e014db1c0ffbec99ec23bd68eb8c05f76dd1a3e30"} err="failed to get container status \"51d82cca41f0cb5ab9c9be0e014db1c0ffbec99ec23bd68eb8c05f76dd1a3e30\": rpc error: code = NotFound desc = could not find container \"51d82cca41f0cb5ab9c9be0e014db1c0ffbec99ec23bd68eb8c05f76dd1a3e30\": container with ID starting with 51d82cca41f0cb5ab9c9be0e014db1c0ffbec99ec23bd68eb8c05f76dd1a3e30 not found: ID does not exist" Jul 07 18:25:31.081342 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.081323 2580 scope.go:117] "RemoveContainer" containerID="16828d2babd8216c1e0916931122b4ae234cb97b05e671b85a776a954bd293c3" Jul 07 18:25:31.081581 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:25:31.081565 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16828d2babd8216c1e0916931122b4ae234cb97b05e671b85a776a954bd293c3\": container with ID starting with 16828d2babd8216c1e0916931122b4ae234cb97b05e671b85a776a954bd293c3 not found: ID does not exist" containerID="16828d2babd8216c1e0916931122b4ae234cb97b05e671b85a776a954bd293c3" Jul 07 18:25:31.081625 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.081585 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16828d2babd8216c1e0916931122b4ae234cb97b05e671b85a776a954bd293c3"} err="failed to get container status \"16828d2babd8216c1e0916931122b4ae234cb97b05e671b85a776a954bd293c3\": rpc error: code = NotFound desc = could not find container \"16828d2babd8216c1e0916931122b4ae234cb97b05e671b85a776a954bd293c3\": container with ID starting with 16828d2babd8216c1e0916931122b4ae234cb97b05e671b85a776a954bd293c3 not found: ID does not exist" Jul 07 18:25:31.081625 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.081599 2580 scope.go:117] "RemoveContainer" containerID="69127456cc12659a008bacd4fd942f025eca5279151e2360fe1325d5db9c3db7" Jul 07 18:25:31.081787 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:25:31.081772 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69127456cc12659a008bacd4fd942f025eca5279151e2360fe1325d5db9c3db7\": container with ID starting with 69127456cc12659a008bacd4fd942f025eca5279151e2360fe1325d5db9c3db7 not found: ID does not exist" containerID="69127456cc12659a008bacd4fd942f025eca5279151e2360fe1325d5db9c3db7" Jul 07 18:25:31.081852 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.081793 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69127456cc12659a008bacd4fd942f025eca5279151e2360fe1325d5db9c3db7"} err="failed to get container status \"69127456cc12659a008bacd4fd942f025eca5279151e2360fe1325d5db9c3db7\": rpc error: code = NotFound desc = could not find container \"69127456cc12659a008bacd4fd942f025eca5279151e2360fe1325d5db9c3db7\": container with ID starting with 69127456cc12659a008bacd4fd942f025eca5279151e2360fe1325d5db9c3db7 not found: ID does not exist" Jul 07 18:25:31.081852 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.081807 2580 scope.go:117] "RemoveContainer" containerID="ca1dabdc64bdb2522b0583a782b36f53430dff022506516c52b65a8d8cdcff81" Jul 07 18:25:31.082004 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:25:31.081990 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca1dabdc64bdb2522b0583a782b36f53430dff022506516c52b65a8d8cdcff81\": container with ID starting with ca1dabdc64bdb2522b0583a782b36f53430dff022506516c52b65a8d8cdcff81 not found: ID does not exist" containerID="ca1dabdc64bdb2522b0583a782b36f53430dff022506516c52b65a8d8cdcff81" Jul 07 18:25:31.082040 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.082008 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca1dabdc64bdb2522b0583a782b36f53430dff022506516c52b65a8d8cdcff81"} err="failed to get container status \"ca1dabdc64bdb2522b0583a782b36f53430dff022506516c52b65a8d8cdcff81\": rpc error: code = NotFound desc = could not find container \"ca1dabdc64bdb2522b0583a782b36f53430dff022506516c52b65a8d8cdcff81\": container with ID starting with ca1dabdc64bdb2522b0583a782b36f53430dff022506516c52b65a8d8cdcff81 not found: ID does not exist" Jul 07 18:25:31.082040 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.082020 2580 scope.go:117] "RemoveContainer" containerID="e1764766d7b68e8f018a210c14d41ef4fd42687044316e79b111e7f4b56320fa" Jul 07 18:25:31.082205 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.082188 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1764766d7b68e8f018a210c14d41ef4fd42687044316e79b111e7f4b56320fa"} err="failed to get container status \"e1764766d7b68e8f018a210c14d41ef4fd42687044316e79b111e7f4b56320fa\": rpc error: code = NotFound desc = could not find container \"e1764766d7b68e8f018a210c14d41ef4fd42687044316e79b111e7f4b56320fa\": container with ID starting with e1764766d7b68e8f018a210c14d41ef4fd42687044316e79b111e7f4b56320fa not found: ID does not exist" Jul 07 18:25:31.082243 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.082206 2580 scope.go:117] "RemoveContainer" containerID="3a6e79b3040e41c9bd41b90becce47d1de266e319f4f1fd7064f117f120b3086" Jul 07 18:25:31.082412 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.082389 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a6e79b3040e41c9bd41b90becce47d1de266e319f4f1fd7064f117f120b3086"} err="failed to get container status \"3a6e79b3040e41c9bd41b90becce47d1de266e319f4f1fd7064f117f120b3086\": rpc error: code = NotFound desc = could not find container \"3a6e79b3040e41c9bd41b90becce47d1de266e319f4f1fd7064f117f120b3086\": container with ID starting with 3a6e79b3040e41c9bd41b90becce47d1de266e319f4f1fd7064f117f120b3086 not found: ID does not exist" Jul 07 18:25:31.082412 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.082411 2580 scope.go:117] "RemoveContainer" containerID="a4dedbb7b7c4e2e484113ecb307202e1a0fc7f4942335a6506800a307440bee3" Jul 07 18:25:31.082687 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.082671 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4dedbb7b7c4e2e484113ecb307202e1a0fc7f4942335a6506800a307440bee3"} err="failed to get container status \"a4dedbb7b7c4e2e484113ecb307202e1a0fc7f4942335a6506800a307440bee3\": rpc error: code = NotFound desc = could not find container \"a4dedbb7b7c4e2e484113ecb307202e1a0fc7f4942335a6506800a307440bee3\": container with ID starting with a4dedbb7b7c4e2e484113ecb307202e1a0fc7f4942335a6506800a307440bee3 not found: ID does not exist" Jul 07 18:25:31.082687 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.082687 2580 scope.go:117] "RemoveContainer" containerID="51d82cca41f0cb5ab9c9be0e014db1c0ffbec99ec23bd68eb8c05f76dd1a3e30" Jul 07 18:25:31.082929 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.082910 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51d82cca41f0cb5ab9c9be0e014db1c0ffbec99ec23bd68eb8c05f76dd1a3e30"} err="failed to get container status \"51d82cca41f0cb5ab9c9be0e014db1c0ffbec99ec23bd68eb8c05f76dd1a3e30\": rpc error: code = NotFound desc = could not find container \"51d82cca41f0cb5ab9c9be0e014db1c0ffbec99ec23bd68eb8c05f76dd1a3e30\": container with ID starting with 51d82cca41f0cb5ab9c9be0e014db1c0ffbec99ec23bd68eb8c05f76dd1a3e30 not found: ID does not exist" Jul 07 18:25:31.082994 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.082931 2580 scope.go:117] "RemoveContainer" containerID="16828d2babd8216c1e0916931122b4ae234cb97b05e671b85a776a954bd293c3" Jul 07 18:25:31.083159 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.083142 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16828d2babd8216c1e0916931122b4ae234cb97b05e671b85a776a954bd293c3"} err="failed to get container status \"16828d2babd8216c1e0916931122b4ae234cb97b05e671b85a776a954bd293c3\": rpc error: code = NotFound desc = could not find container \"16828d2babd8216c1e0916931122b4ae234cb97b05e671b85a776a954bd293c3\": container with ID starting with 16828d2babd8216c1e0916931122b4ae234cb97b05e671b85a776a954bd293c3 not found: ID does not exist" Jul 07 18:25:31.083202 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.083160 2580 scope.go:117] "RemoveContainer" containerID="69127456cc12659a008bacd4fd942f025eca5279151e2360fe1325d5db9c3db7" Jul 07 18:25:31.083369 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.083350 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69127456cc12659a008bacd4fd942f025eca5279151e2360fe1325d5db9c3db7"} err="failed to get container status \"69127456cc12659a008bacd4fd942f025eca5279151e2360fe1325d5db9c3db7\": rpc error: code = NotFound desc = could not find container \"69127456cc12659a008bacd4fd942f025eca5279151e2360fe1325d5db9c3db7\": container with ID starting with 69127456cc12659a008bacd4fd942f025eca5279151e2360fe1325d5db9c3db7 not found: ID does not exist" Jul 07 18:25:31.083411 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.083370 2580 scope.go:117] "RemoveContainer" containerID="ca1dabdc64bdb2522b0583a782b36f53430dff022506516c52b65a8d8cdcff81" Jul 07 18:25:31.083596 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.083580 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca1dabdc64bdb2522b0583a782b36f53430dff022506516c52b65a8d8cdcff81"} err="failed to get container status \"ca1dabdc64bdb2522b0583a782b36f53430dff022506516c52b65a8d8cdcff81\": rpc error: code = NotFound desc = could not find container \"ca1dabdc64bdb2522b0583a782b36f53430dff022506516c52b65a8d8cdcff81\": container with ID starting with ca1dabdc64bdb2522b0583a782b36f53430dff022506516c52b65a8d8cdcff81 not found: ID does not exist" Jul 07 18:25:31.143087 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143056 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 18:25:31.143353 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143341 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="kube-rbac-proxy" Jul 07 18:25:31.143398 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143353 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="kube-rbac-proxy" Jul 07 18:25:31.143398 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143366 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99591410-cf61-48c7-aaa1-5844a7cbdc2d" containerName="console" Jul 07 18:25:31.143398 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143371 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="99591410-cf61-48c7-aaa1-5844a7cbdc2d" containerName="console" Jul 07 18:25:31.143398 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143379 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="config-reloader" Jul 07 18:25:31.143398 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143385 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="config-reloader" Jul 07 18:25:31.143398 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143392 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="kube-rbac-proxy-metric" Jul 07 18:25:31.143398 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143398 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="kube-rbac-proxy-metric" Jul 07 18:25:31.143620 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143411 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="prom-label-proxy" Jul 07 18:25:31.143620 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143417 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="prom-label-proxy" Jul 07 18:25:31.143620 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143423 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="init-config-reloader" Jul 07 18:25:31.143620 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143428 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="init-config-reloader" Jul 07 18:25:31.143620 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143434 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="alertmanager" Jul 07 18:25:31.143620 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143438 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="alertmanager" Jul 07 18:25:31.143620 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143447 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94120e3a-209a-4ca3-8807-6e0e759f4c48" containerName="registry" Jul 07 18:25:31.143620 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143468 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="94120e3a-209a-4ca3-8807-6e0e759f4c48" containerName="registry" Jul 07 18:25:31.143620 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143475 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="kube-rbac-proxy-web" Jul 07 18:25:31.143620 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143481 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="kube-rbac-proxy-web" Jul 07 18:25:31.143620 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143530 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="94120e3a-209a-4ca3-8807-6e0e759f4c48" containerName="registry" Jul 07 18:25:31.143620 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143538 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="kube-rbac-proxy" Jul 07 18:25:31.143620 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143545 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="prom-label-proxy" Jul 07 18:25:31.143620 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143550 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="kube-rbac-proxy-metric" Jul 07 18:25:31.143620 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143557 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="99591410-cf61-48c7-aaa1-5844a7cbdc2d" containerName="console" Jul 07 18:25:31.143620 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143562 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="config-reloader" Jul 07 18:25:31.143620 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143569 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="alertmanager" Jul 07 18:25:31.143620 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.143573 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" containerName="kube-rbac-proxy-web" Jul 07 18:25:31.147260 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.147241 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.156433 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.156416 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 18:25:31.156629 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.156616 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 18:25:31.156971 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.156948 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 18:25:31.156971 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.156970 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 18:25:31.157102 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.156976 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 18:25:31.157102 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.156985 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 18:25:31.157102 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.157021 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 18:25:31.157102 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.157077 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-k6kxg\"" Jul 07 18:25:31.158076 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.158062 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 18:25:31.166545 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.166529 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 18:25:31.198555 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.198526 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 18:25:31.325313 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.325227 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b977a65f-624c-48a3-a330-a0665d92237e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.325313 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.325271 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b977a65f-624c-48a3-a330-a0665d92237e-config-out\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.325504 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.325340 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b977a65f-624c-48a3-a330-a0665d92237e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.325504 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.325380 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b977a65f-624c-48a3-a330-a0665d92237e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.325504 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.325409 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b977a65f-624c-48a3-a330-a0665d92237e-config-volume\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.325504 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.325427 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b977a65f-624c-48a3-a330-a0665d92237e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.325504 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.325450 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b977a65f-624c-48a3-a330-a0665d92237e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.325504 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.325492 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b977a65f-624c-48a3-a330-a0665d92237e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.325681 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.325515 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmjr8\" (UniqueName: \"kubernetes.io/projected/b977a65f-624c-48a3-a330-a0665d92237e-kube-api-access-cmjr8\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.325681 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.325545 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b977a65f-624c-48a3-a330-a0665d92237e-web-config\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.325681 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.325575 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b977a65f-624c-48a3-a330-a0665d92237e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.325681 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.325601 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b977a65f-624c-48a3-a330-a0665d92237e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.325681 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.325621 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b977a65f-624c-48a3-a330-a0665d92237e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.427041 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.427004 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b977a65f-624c-48a3-a330-a0665d92237e-config-volume\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.427041 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.427042 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b977a65f-624c-48a3-a330-a0665d92237e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.427241 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.427069 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b977a65f-624c-48a3-a330-a0665d92237e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.427241 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.427202 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b977a65f-624c-48a3-a330-a0665d92237e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.427409 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.427253 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmjr8\" (UniqueName: \"kubernetes.io/projected/b977a65f-624c-48a3-a330-a0665d92237e-kube-api-access-cmjr8\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.427409 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.427299 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b977a65f-624c-48a3-a330-a0665d92237e-web-config\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.427409 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.427326 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b977a65f-624c-48a3-a330-a0665d92237e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.427409 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.427366 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b977a65f-624c-48a3-a330-a0665d92237e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.427409 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.427399 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b977a65f-624c-48a3-a330-a0665d92237e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.427713 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.427473 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b977a65f-624c-48a3-a330-a0665d92237e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.427713 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.427526 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b977a65f-624c-48a3-a330-a0665d92237e-config-out\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.427713 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.427562 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b977a65f-624c-48a3-a330-a0665d92237e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.427713 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.427593 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b977a65f-624c-48a3-a330-a0665d92237e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.427926 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.427905 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b977a65f-624c-48a3-a330-a0665d92237e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.428040 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.428011 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b977a65f-624c-48a3-a330-a0665d92237e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.428195 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.428172 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b977a65f-624c-48a3-a330-a0665d92237e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.430187 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.430157 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b977a65f-624c-48a3-a330-a0665d92237e-config-volume\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.430297 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.430170 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b977a65f-624c-48a3-a330-a0665d92237e-config-out\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.430435 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.430411 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b977a65f-624c-48a3-a330-a0665d92237e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.430618 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.430597 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b977a65f-624c-48a3-a330-a0665d92237e-web-config\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.430809 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.430790 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b977a65f-624c-48a3-a330-a0665d92237e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.430882 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.430863 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b977a65f-624c-48a3-a330-a0665d92237e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.431319 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.431297 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b977a65f-624c-48a3-a330-a0665d92237e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.431474 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.431433 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b977a65f-624c-48a3-a330-a0665d92237e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.432305 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.432284 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b977a65f-624c-48a3-a330-a0665d92237e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.436958 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.436940 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmjr8\" (UniqueName: \"kubernetes.io/projected/b977a65f-624c-48a3-a330-a0665d92237e-kube-api-access-cmjr8\") pod \"alertmanager-main-0\" (UID: \"b977a65f-624c-48a3-a330-a0665d92237e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.455973 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.455950 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 18:25:31.595484 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:31.595445 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 18:25:31.597481 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:25:31.597440 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb977a65f_624c_48a3_a330_a0665d92237e.slice/crio-b04bcf223dc88b1383af8183b9aa5e46734d69efe9c4efa76783451e1e5ed321 WatchSource:0}: Error finding container b04bcf223dc88b1383af8183b9aa5e46734d69efe9c4efa76783451e1e5ed321: Status 404 returned error can't find the container with id b04bcf223dc88b1383af8183b9aa5e46734d69efe9c4efa76783451e1e5ed321 Jul 07 18:25:32.032181 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:32.032149 2580 generic.go:356] "Generic (PLEG): container finished" podID="b977a65f-624c-48a3-a330-a0665d92237e" containerID="b228f94d1334fcaa8fa6e04ced7445411fe718dd108bea45c853f33d631ae1e0" exitCode=0 Jul 07 18:25:32.032341 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:32.032235 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b977a65f-624c-48a3-a330-a0665d92237e","Type":"ContainerDied","Data":"b228f94d1334fcaa8fa6e04ced7445411fe718dd108bea45c853f33d631ae1e0"} Jul 07 18:25:32.032341 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:32.032318 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b977a65f-624c-48a3-a330-a0665d92237e","Type":"ContainerStarted","Data":"b04bcf223dc88b1383af8183b9aa5e46734d69efe9c4efa76783451e1e5ed321"} Jul 07 18:25:32.193101 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:32.193073 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01b8fe54-da10-4161-aa6f-9edd9214bdc6" path="/var/lib/kubelet/pods/01b8fe54-da10-4161-aa6f-9edd9214bdc6/volumes" Jul 07 18:25:33.040734 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.040695 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b977a65f-624c-48a3-a330-a0665d92237e","Type":"ContainerStarted","Data":"0a0c91bd7643beed9b384ec0753f23b1a4e41f76700a424b9d9c69b1433b4929"} Jul 07 18:25:33.041166 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.040787 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b977a65f-624c-48a3-a330-a0665d92237e","Type":"ContainerStarted","Data":"a5546df7e3260156129b5e50383a93bf9c31dcbaf897a51519ef28cea1e70b93"} Jul 07 18:25:33.041166 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.040814 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b977a65f-624c-48a3-a330-a0665d92237e","Type":"ContainerStarted","Data":"c6b8cfc18bcbcc5f78bad7d2db2627b454ede29ddd26733aaf14ff971e41456a"} Jul 07 18:25:33.041166 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.040839 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b977a65f-624c-48a3-a330-a0665d92237e","Type":"ContainerStarted","Data":"e3b896b610d765a6e3df6fa1914cc101da737350dca3fd7b96e2326ccbd632ec"} Jul 07 18:25:33.041166 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.040864 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b977a65f-624c-48a3-a330-a0665d92237e","Type":"ContainerStarted","Data":"10c5b96b7540b6b0750873030e76483f84822274ed70dc2b6b0f2d5a375e69e3"} Jul 07 18:25:33.041166 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.040887 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b977a65f-624c-48a3-a330-a0665d92237e","Type":"ContainerStarted","Data":"e447aead5c20c2df85cc96baa9a938e19f04ff1918524c6761cc686b1b35117a"} Jul 07 18:25:33.091835 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.091784 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.075603619 podStartE2EDuration="2.0917677s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.164081ms" isStatefulPod=false podCreationTimestamp="2026-07-07 18:25:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:25:33.090311551 +0000 UTC m=+174.220963573" watchObservedRunningTime="2026-07-07 18:25:33.0917677 +0000 UTC m=+174.222419722" Jul 07 18:25:33.478288 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.478214 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5499b9657c-v6hhl"] Jul 07 18:25:33.481705 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.481682 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.487719 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.487683 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 07 18:25:33.487850 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.487691 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 07 18:25:33.487850 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.487727 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-pmnq6\"" Jul 07 18:25:33.488233 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.488187 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 07 18:25:33.488419 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.488395 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 07 18:25:33.488763 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.488749 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 07 18:25:33.496952 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.496935 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 07 18:25:33.513760 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.513731 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5499b9657c-v6hhl"] Jul 07 18:25:33.650284 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.650251 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a4490aa2-d093-48e7-a255-d41c638bbffe-telemeter-client-tls\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.650498 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.650290 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a4490aa2-d093-48e7-a255-d41c638bbffe-federate-client-tls\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.650498 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.650323 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4490aa2-d093-48e7-a255-d41c638bbffe-serving-certs-ca-bundle\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.650498 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.650351 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4490aa2-d093-48e7-a255-d41c638bbffe-metrics-client-ca\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.650498 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.650377 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4490aa2-d093-48e7-a255-d41c638bbffe-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.650498 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.650393 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4490aa2-d093-48e7-a255-d41c638bbffe-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.650777 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.650507 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a4490aa2-d093-48e7-a255-d41c638bbffe-secret-telemeter-client\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.650777 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.650554 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqn4w\" (UniqueName: \"kubernetes.io/projected/a4490aa2-d093-48e7-a255-d41c638bbffe-kube-api-access-gqn4w\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.750997 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.750972 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a4490aa2-d093-48e7-a255-d41c638bbffe-secret-telemeter-client\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.751222 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.751010 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqn4w\" (UniqueName: \"kubernetes.io/projected/a4490aa2-d093-48e7-a255-d41c638bbffe-kube-api-access-gqn4w\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.751222 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.751053 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a4490aa2-d093-48e7-a255-d41c638bbffe-telemeter-client-tls\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.751222 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.751078 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a4490aa2-d093-48e7-a255-d41c638bbffe-federate-client-tls\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.751222 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.751102 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4490aa2-d093-48e7-a255-d41c638bbffe-serving-certs-ca-bundle\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.751222 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.751125 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4490aa2-d093-48e7-a255-d41c638bbffe-metrics-client-ca\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.751222 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.751154 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4490aa2-d093-48e7-a255-d41c638bbffe-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.751560 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.751292 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4490aa2-d093-48e7-a255-d41c638bbffe-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.752179 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.752150 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4490aa2-d093-48e7-a255-d41c638bbffe-metrics-client-ca\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.752323 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.752188 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4490aa2-d093-48e7-a255-d41c638bbffe-serving-certs-ca-bundle\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.752559 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.752536 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4490aa2-d093-48e7-a255-d41c638bbffe-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.753853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.753832 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a4490aa2-d093-48e7-a255-d41c638bbffe-federate-client-tls\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.753939 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.753908 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4490aa2-d093-48e7-a255-d41c638bbffe-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.754078 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.754063 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a4490aa2-d093-48e7-a255-d41c638bbffe-secret-telemeter-client\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.754121 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.754099 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a4490aa2-d093-48e7-a255-d41c638bbffe-telemeter-client-tls\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.764240 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.764219 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqn4w\" (UniqueName: \"kubernetes.io/projected/a4490aa2-d093-48e7-a255-d41c638bbffe-kube-api-access-gqn4w\") pod \"telemeter-client-5499b9657c-v6hhl\" (UID: \"a4490aa2-d093-48e7-a255-d41c638bbffe\") " pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.792096 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.792069 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" Jul 07 18:25:33.948897 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:33.948867 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5499b9657c-v6hhl"] Jul 07 18:25:33.951343 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:25:33.951317 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4490aa2_d093_48e7_a255_d41c638bbffe.slice/crio-0cb4f97e2f020139c7b52a78d1fe9cf76f451e517cea2175360606fcbeba647c WatchSource:0}: Error finding container 0cb4f97e2f020139c7b52a78d1fe9cf76f451e517cea2175360606fcbeba647c: Status 404 returned error can't find the container with id 0cb4f97e2f020139c7b52a78d1fe9cf76f451e517cea2175360606fcbeba647c Jul 07 18:25:34.046788 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:34.046702 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" event={"ID":"a4490aa2-d093-48e7-a255-d41c638bbffe","Type":"ContainerStarted","Data":"0cb4f97e2f020139c7b52a78d1fe9cf76f451e517cea2175360606fcbeba647c"} Jul 07 18:25:37.067846 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.067803 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" event={"ID":"a4490aa2-d093-48e7-a255-d41c638bbffe","Type":"ContainerStarted","Data":"05e0b979593675223aba2fb1606c600d04e0188acef84145518381b1278f1658"} Jul 07 18:25:37.068220 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.067870 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" event={"ID":"a4490aa2-d093-48e7-a255-d41c638bbffe","Type":"ContainerStarted","Data":"20abcb144f45aec087ad8f5ced05b870791ae49ab5bfd8447c51dcc16707fbc5"} Jul 07 18:25:37.068220 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.067892 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" event={"ID":"a4490aa2-d093-48e7-a255-d41c638bbffe","Type":"ContainerStarted","Data":"96eb63f5f7d026e102276d2299816a9cab3603175fde1b9709baf81cf268b17b"} Jul 07 18:25:37.092508 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.092437 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5499b9657c-v6hhl" podStartSLOduration=1.193490653 podStartE2EDuration="4.092422176s" totalImagesPullingTime="2.898931523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:25:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:25:37.090954945 +0000 UTC m=+178.221606968" watchObservedRunningTime="2026-07-07 18:25:37.092422176 +0000 UTC m=+178.223074199" Jul 07 18:25:37.847653 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.847618 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f987c7675-dgpvt"] Jul 07 18:25:37.851260 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.851238 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:37.853977 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.853955 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 18:25:37.854089 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.853989 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 18:25:37.854792 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.854776 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 18:25:37.854925 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.854901 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 18:25:37.854992 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.854933 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 18:25:37.854992 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.854955 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 18:25:37.856579 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.856563 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 18:25:37.858813 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.858783 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sh5tt\"" Jul 07 18:25:37.861770 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.861753 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 18:25:37.868305 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.868282 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f987c7675-dgpvt"] Jul 07 18:25:37.885987 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.885959 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkljv\" (UniqueName: \"kubernetes.io/projected/e08c5c7a-110c-4f49-b395-e0a274b2cc62-kube-api-access-jkljv\") pod \"console-7f987c7675-dgpvt\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:37.886093 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.885995 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e08c5c7a-110c-4f49-b395-e0a274b2cc62-console-oauth-config\") pod \"console-7f987c7675-dgpvt\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:37.886093 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.886030 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-oauth-serving-cert\") pod \"console-7f987c7675-dgpvt\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:37.886167 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.886093 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-console-config\") pod \"console-7f987c7675-dgpvt\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:37.886167 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.886146 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e08c5c7a-110c-4f49-b395-e0a274b2cc62-console-serving-cert\") pod \"console-7f987c7675-dgpvt\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:37.886229 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.886180 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-trusted-ca-bundle\") pod \"console-7f987c7675-dgpvt\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:37.886229 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.886206 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-service-ca\") pod \"console-7f987c7675-dgpvt\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:37.987259 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.987222 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e08c5c7a-110c-4f49-b395-e0a274b2cc62-console-oauth-config\") pod \"console-7f987c7675-dgpvt\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:37.987492 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.987270 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-oauth-serving-cert\") pod \"console-7f987c7675-dgpvt\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:37.987492 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.987304 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-console-config\") pod \"console-7f987c7675-dgpvt\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:37.987492 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.987353 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e08c5c7a-110c-4f49-b395-e0a274b2cc62-console-serving-cert\") pod \"console-7f987c7675-dgpvt\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:37.987492 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.987395 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-trusted-ca-bundle\") pod \"console-7f987c7675-dgpvt\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:37.987492 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.987426 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-service-ca\") pod \"console-7f987c7675-dgpvt\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:37.987762 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.987495 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkljv\" (UniqueName: \"kubernetes.io/projected/e08c5c7a-110c-4f49-b395-e0a274b2cc62-kube-api-access-jkljv\") pod \"console-7f987c7675-dgpvt\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:37.988077 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.988051 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-oauth-serving-cert\") pod \"console-7f987c7675-dgpvt\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:37.988171 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.988144 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-console-config\") pod \"console-7f987c7675-dgpvt\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:37.988296 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.988272 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-trusted-ca-bundle\") pod \"console-7f987c7675-dgpvt\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:37.988754 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.988734 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-service-ca\") pod \"console-7f987c7675-dgpvt\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:37.989775 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.989748 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e08c5c7a-110c-4f49-b395-e0a274b2cc62-console-oauth-config\") pod \"console-7f987c7675-dgpvt\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:37.989874 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.989857 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e08c5c7a-110c-4f49-b395-e0a274b2cc62-console-serving-cert\") pod \"console-7f987c7675-dgpvt\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:37.998325 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:37.998301 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkljv\" (UniqueName: \"kubernetes.io/projected/e08c5c7a-110c-4f49-b395-e0a274b2cc62-kube-api-access-jkljv\") pod \"console-7f987c7675-dgpvt\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:38.161029 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:38.160940 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:38.313400 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:38.313377 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f987c7675-dgpvt"] Jul 07 18:25:38.314586 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:25:38.314558 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode08c5c7a_110c_4f49_b395_e0a274b2cc62.slice/crio-f3e05e240385b20403b3c71413e506d13ccabaf07507bbcf5c91dc7a6bea4c37 WatchSource:0}: Error finding container f3e05e240385b20403b3c71413e506d13ccabaf07507bbcf5c91dc7a6bea4c37: Status 404 returned error can't find the container with id f3e05e240385b20403b3c71413e506d13ccabaf07507bbcf5c91dc7a6bea4c37 Jul 07 18:25:39.078859 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:39.078817 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f987c7675-dgpvt" event={"ID":"e08c5c7a-110c-4f49-b395-e0a274b2cc62","Type":"ContainerStarted","Data":"610c4f9614a3637cb836f68ddd864c1aed3c16d7f30282c2c52e2fcb471cc292"} Jul 07 18:25:39.079008 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:39.078905 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f987c7675-dgpvt" event={"ID":"e08c5c7a-110c-4f49-b395-e0a274b2cc62","Type":"ContainerStarted","Data":"f3e05e240385b20403b3c71413e506d13ccabaf07507bbcf5c91dc7a6bea4c37"} Jul 07 18:25:39.102746 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:39.102699 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f987c7675-dgpvt" podStartSLOduration=2.102684884 podStartE2EDuration="2.102684884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:25:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:25:39.100712101 +0000 UTC m=+180.231364123" watchObservedRunningTime="2026-07-07 18:25:39.102684884 +0000 UTC m=+180.233336906" Jul 07 18:25:48.161138 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:48.161100 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:48.161648 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:48.161160 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:48.165824 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:48.165804 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:25:49.125356 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:25:49.125326 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:27:14.743182 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:14.743150 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bb84f79f5-6jhgf"] Jul 07 18:27:14.746857 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:14.746838 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:14.757872 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:14.757843 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bb84f79f5-6jhgf"] Jul 07 18:27:14.906328 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:14.906290 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-console-config\") pod \"console-7bb84f79f5-6jhgf\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:14.906328 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:14.906331 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26add002-9ec1-4217-bc40-24b6f38fbd43-console-oauth-config\") pod \"console-7bb84f79f5-6jhgf\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:14.906581 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:14.906350 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-service-ca\") pod \"console-7bb84f79f5-6jhgf\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:14.906581 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:14.906434 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26add002-9ec1-4217-bc40-24b6f38fbd43-console-serving-cert\") pod \"console-7bb84f79f5-6jhgf\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:14.906581 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:14.906495 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5knlw\" (UniqueName: \"kubernetes.io/projected/26add002-9ec1-4217-bc40-24b6f38fbd43-kube-api-access-5knlw\") pod \"console-7bb84f79f5-6jhgf\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:14.906581 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:14.906530 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-trusted-ca-bundle\") pod \"console-7bb84f79f5-6jhgf\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:14.906581 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:14.906555 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-oauth-serving-cert\") pod \"console-7bb84f79f5-6jhgf\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:15.008031 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:15.007942 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-console-config\") pod \"console-7bb84f79f5-6jhgf\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:15.008031 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:15.007985 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26add002-9ec1-4217-bc40-24b6f38fbd43-console-oauth-config\") pod \"console-7bb84f79f5-6jhgf\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:15.008031 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:15.008004 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-service-ca\") pod \"console-7bb84f79f5-6jhgf\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:15.008295 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:15.008035 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26add002-9ec1-4217-bc40-24b6f38fbd43-console-serving-cert\") pod \"console-7bb84f79f5-6jhgf\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:15.008295 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:15.008077 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5knlw\" (UniqueName: \"kubernetes.io/projected/26add002-9ec1-4217-bc40-24b6f38fbd43-kube-api-access-5knlw\") pod \"console-7bb84f79f5-6jhgf\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:15.008295 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:15.008114 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-trusted-ca-bundle\") pod \"console-7bb84f79f5-6jhgf\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:15.008295 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:15.008153 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-oauth-serving-cert\") pod \"console-7bb84f79f5-6jhgf\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:15.008793 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:15.008770 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-console-config\") pod \"console-7bb84f79f5-6jhgf\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:15.008923 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:15.008900 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-oauth-serving-cert\") pod \"console-7bb84f79f5-6jhgf\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:15.008993 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:15.008969 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-service-ca\") pod \"console-7bb84f79f5-6jhgf\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:15.009247 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:15.009215 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-trusted-ca-bundle\") pod \"console-7bb84f79f5-6jhgf\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:15.010764 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:15.010739 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26add002-9ec1-4217-bc40-24b6f38fbd43-console-oauth-config\") pod \"console-7bb84f79f5-6jhgf\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:15.010848 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:15.010813 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26add002-9ec1-4217-bc40-24b6f38fbd43-console-serving-cert\") pod \"console-7bb84f79f5-6jhgf\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:15.018635 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:15.018612 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5knlw\" (UniqueName: \"kubernetes.io/projected/26add002-9ec1-4217-bc40-24b6f38fbd43-kube-api-access-5knlw\") pod \"console-7bb84f79f5-6jhgf\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:15.055640 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:15.055614 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:15.185896 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:15.185869 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bb84f79f5-6jhgf"] Jul 07 18:27:15.188298 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:27:15.188268 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26add002_9ec1_4217_bc40_24b6f38fbd43.slice/crio-9d9f02f2a05818c052e3afd09d198e379ed7501665f72edff8c7a3964bb49340 WatchSource:0}: Error finding container 9d9f02f2a05818c052e3afd09d198e379ed7501665f72edff8c7a3964bb49340: Status 404 returned error can't find the container with id 9d9f02f2a05818c052e3afd09d198e379ed7501665f72edff8c7a3964bb49340 Jul 07 18:27:15.488888 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:15.488851 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb84f79f5-6jhgf" event={"ID":"26add002-9ec1-4217-bc40-24b6f38fbd43","Type":"ContainerStarted","Data":"ab1b8f2ad6d9f5fbb5ab93b4407b96de7f79a5f85de89a522c3edd31cc07dcec"} Jul 07 18:27:15.489049 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:15.488922 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb84f79f5-6jhgf" event={"ID":"26add002-9ec1-4217-bc40-24b6f38fbd43","Type":"ContainerStarted","Data":"9d9f02f2a05818c052e3afd09d198e379ed7501665f72edff8c7a3964bb49340"} Jul 07 18:27:15.506259 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:15.506207 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bb84f79f5-6jhgf" podStartSLOduration=1.506192776 podStartE2EDuration="1.506192776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:27:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:27:15.505727284 +0000 UTC m=+276.636379319" watchObservedRunningTime="2026-07-07 18:27:15.506192776 +0000 UTC m=+276.636844799" Jul 07 18:27:25.055879 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:25.055845 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:25.056280 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:25.055905 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:25.060434 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:25.060416 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:25.533346 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:25.533317 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:27:25.580359 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:25.580320 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f987c7675-dgpvt"] Jul 07 18:27:40.047709 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:40.047680 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/2.log" Jul 07 18:27:40.050206 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:40.050186 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/2.log" Jul 07 18:27:40.052852 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:40.052826 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-skkmr_b7335728-d739-4c3d-877b-c1d860112c1a/ovn-acl-logging/0.log" Jul 07 18:27:40.055680 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:40.055658 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-skkmr_b7335728-d739-4c3d-877b-c1d860112c1a/ovn-acl-logging/0.log" Jul 07 18:27:40.058865 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:40.058850 2580 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 18:27:50.603316 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:50.603260 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f987c7675-dgpvt" podUID="e08c5c7a-110c-4f49-b395-e0a274b2cc62" containerName="console" containerID="cri-o://610c4f9614a3637cb836f68ddd864c1aed3c16d7f30282c2c52e2fcb471cc292" gracePeriod=15 Jul 07 18:27:50.842435 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:50.842412 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:27:50.913600 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:50.913514 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-service-ca\") pod \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " Jul 07 18:27:50.913600 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:50.913588 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e08c5c7a-110c-4f49-b395-e0a274b2cc62-console-oauth-config\") pod \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " Jul 07 18:27:50.913789 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:50.913630 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-oauth-serving-cert\") pod \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " Jul 07 18:27:50.913789 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:50.913657 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-trusted-ca-bundle\") pod \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " Jul 07 18:27:50.913789 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:50.913713 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkljv\" (UniqueName: \"kubernetes.io/projected/e08c5c7a-110c-4f49-b395-e0a274b2cc62-kube-api-access-jkljv\") pod \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " Jul 07 18:27:50.913789 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:50.913747 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-console-config\") pod \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " Jul 07 18:27:50.913789 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:50.913771 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e08c5c7a-110c-4f49-b395-e0a274b2cc62-console-serving-cert\") pod \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\" (UID: \"e08c5c7a-110c-4f49-b395-e0a274b2cc62\") " Jul 07 18:27:50.914041 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:50.913929 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-service-ca" (OuterVolumeSpecName: "service-ca") pod "e08c5c7a-110c-4f49-b395-e0a274b2cc62" (UID: "e08c5c7a-110c-4f49-b395-e0a274b2cc62"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:27:50.914041 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:50.914025 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e08c5c7a-110c-4f49-b395-e0a274b2cc62" (UID: "e08c5c7a-110c-4f49-b395-e0a274b2cc62"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:27:50.914218 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:50.914193 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-service-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:27:50.914218 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:50.914215 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-oauth-serving-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:27:50.914390 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:50.914211 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-console-config" (OuterVolumeSpecName: "console-config") pod "e08c5c7a-110c-4f49-b395-e0a274b2cc62" (UID: "e08c5c7a-110c-4f49-b395-e0a274b2cc62"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:27:50.914390 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:50.914364 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e08c5c7a-110c-4f49-b395-e0a274b2cc62" (UID: "e08c5c7a-110c-4f49-b395-e0a274b2cc62"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:27:50.915849 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:50.915824 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e08c5c7a-110c-4f49-b395-e0a274b2cc62-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e08c5c7a-110c-4f49-b395-e0a274b2cc62" (UID: "e08c5c7a-110c-4f49-b395-e0a274b2cc62"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:27:50.915849 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:50.915846 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e08c5c7a-110c-4f49-b395-e0a274b2cc62-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e08c5c7a-110c-4f49-b395-e0a274b2cc62" (UID: "e08c5c7a-110c-4f49-b395-e0a274b2cc62"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:27:50.915963 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:50.915912 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e08c5c7a-110c-4f49-b395-e0a274b2cc62-kube-api-access-jkljv" (OuterVolumeSpecName: "kube-api-access-jkljv") pod "e08c5c7a-110c-4f49-b395-e0a274b2cc62" (UID: "e08c5c7a-110c-4f49-b395-e0a274b2cc62"). InnerVolumeSpecName "kube-api-access-jkljv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:27:51.015435 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:51.015403 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkljv\" (UniqueName: \"kubernetes.io/projected/e08c5c7a-110c-4f49-b395-e0a274b2cc62-kube-api-access-jkljv\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:27:51.015435 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:51.015428 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-console-config\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:27:51.015435 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:51.015438 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e08c5c7a-110c-4f49-b395-e0a274b2cc62-console-serving-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:27:51.015655 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:51.015447 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e08c5c7a-110c-4f49-b395-e0a274b2cc62-console-oauth-config\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:27:51.015655 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:51.015470 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e08c5c7a-110c-4f49-b395-e0a274b2cc62-trusted-ca-bundle\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:27:51.641035 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:51.640995 2580 generic.go:356] "Generic (PLEG): container finished" podID="e08c5c7a-110c-4f49-b395-e0a274b2cc62" containerID="610c4f9614a3637cb836f68ddd864c1aed3c16d7f30282c2c52e2fcb471cc292" exitCode=0 Jul 07 18:27:51.641428 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:51.641045 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f987c7675-dgpvt" Jul 07 18:27:51.641428 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:51.641083 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f987c7675-dgpvt" event={"ID":"e08c5c7a-110c-4f49-b395-e0a274b2cc62","Type":"ContainerDied","Data":"610c4f9614a3637cb836f68ddd864c1aed3c16d7f30282c2c52e2fcb471cc292"} Jul 07 18:27:51.641428 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:51.641136 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f987c7675-dgpvt" event={"ID":"e08c5c7a-110c-4f49-b395-e0a274b2cc62","Type":"ContainerDied","Data":"f3e05e240385b20403b3c71413e506d13ccabaf07507bbcf5c91dc7a6bea4c37"} Jul 07 18:27:51.641428 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:51.641165 2580 scope.go:117] "RemoveContainer" containerID="610c4f9614a3637cb836f68ddd864c1aed3c16d7f30282c2c52e2fcb471cc292" Jul 07 18:27:51.650444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:51.650428 2580 scope.go:117] "RemoveContainer" containerID="610c4f9614a3637cb836f68ddd864c1aed3c16d7f30282c2c52e2fcb471cc292" Jul 07 18:27:51.650789 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:27:51.650772 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"610c4f9614a3637cb836f68ddd864c1aed3c16d7f30282c2c52e2fcb471cc292\": container with ID starting with 610c4f9614a3637cb836f68ddd864c1aed3c16d7f30282c2c52e2fcb471cc292 not found: ID does not exist" containerID="610c4f9614a3637cb836f68ddd864c1aed3c16d7f30282c2c52e2fcb471cc292" Jul 07 18:27:51.650847 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:51.650796 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"610c4f9614a3637cb836f68ddd864c1aed3c16d7f30282c2c52e2fcb471cc292"} err="failed to get container status \"610c4f9614a3637cb836f68ddd864c1aed3c16d7f30282c2c52e2fcb471cc292\": rpc error: code = NotFound desc = could not find container \"610c4f9614a3637cb836f68ddd864c1aed3c16d7f30282c2c52e2fcb471cc292\": container with ID starting with 610c4f9614a3637cb836f68ddd864c1aed3c16d7f30282c2c52e2fcb471cc292 not found: ID does not exist" Jul 07 18:27:51.662561 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:51.662540 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f987c7675-dgpvt"] Jul 07 18:27:51.666550 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:51.666530 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f987c7675-dgpvt"] Jul 07 18:27:52.190840 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:52.190813 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e08c5c7a-110c-4f49-b395-e0a274b2cc62" path="/var/lib/kubelet/pods/e08c5c7a-110c-4f49-b395-e0a274b2cc62/volumes" Jul 07 18:27:52.945244 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:52.945214 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd"] Jul 07 18:27:52.945643 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:52.945561 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e08c5c7a-110c-4f49-b395-e0a274b2cc62" containerName="console" Jul 07 18:27:52.945643 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:52.945572 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e08c5c7a-110c-4f49-b395-e0a274b2cc62" containerName="console" Jul 07 18:27:52.945643 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:52.945633 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e08c5c7a-110c-4f49-b395-e0a274b2cc62" containerName="console" Jul 07 18:27:52.950022 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:52.950007 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd" Jul 07 18:27:52.952566 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:52.952549 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jk4c4\"" Jul 07 18:27:52.952835 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:52.952819 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 18:27:52.953387 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:52.953371 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 18:27:52.959293 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:52.959271 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd"] Jul 07 18:27:53.032552 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:53.032522 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq9f8\" (UniqueName: \"kubernetes.io/projected/c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6-kube-api-access-dq9f8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd\" (UID: \"c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd" Jul 07 18:27:53.032729 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:53.032574 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd\" (UID: \"c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd" Jul 07 18:27:53.032729 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:53.032676 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd\" (UID: \"c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd" Jul 07 18:27:53.133131 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:53.133097 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd\" (UID: \"c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd" Jul 07 18:27:53.133305 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:53.133164 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd\" (UID: \"c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd" Jul 07 18:27:53.133305 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:53.133203 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq9f8\" (UniqueName: \"kubernetes.io/projected/c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6-kube-api-access-dq9f8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd\" (UID: \"c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd" Jul 07 18:27:53.133523 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:53.133483 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd\" (UID: \"c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd" Jul 07 18:27:53.133605 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:53.133577 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd\" (UID: \"c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd" Jul 07 18:27:53.141602 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:53.141581 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq9f8\" (UniqueName: \"kubernetes.io/projected/c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6-kube-api-access-dq9f8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd\" (UID: \"c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd" Jul 07 18:27:53.259762 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:53.259729 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd" Jul 07 18:27:53.392307 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:53.392274 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd"] Jul 07 18:27:53.394876 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:27:53.394852 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6c59f9e_fff8_4efd_9e47_a88ee80cb2b6.slice/crio-3527df5d53cabc7ab35b9bd1c55eaf71a08aec79ba96f9d883e3c67ae5f20adf WatchSource:0}: Error finding container 3527df5d53cabc7ab35b9bd1c55eaf71a08aec79ba96f9d883e3c67ae5f20adf: Status 404 returned error can't find the container with id 3527df5d53cabc7ab35b9bd1c55eaf71a08aec79ba96f9d883e3c67ae5f20adf Jul 07 18:27:53.396796 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:53.396776 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 18:27:53.651262 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:27:53.651180 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd" event={"ID":"c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6","Type":"ContainerStarted","Data":"3527df5d53cabc7ab35b9bd1c55eaf71a08aec79ba96f9d883e3c67ae5f20adf"} Jul 07 18:28:04.705313 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:04.705271 2580 generic.go:356] "Generic (PLEG): container finished" podID="c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6" containerID="88aa6f266ccb50a87bf086803d9577f21e036d9cf59f26e092aecd61622fa642" exitCode=0 Jul 07 18:28:04.705715 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:04.705332 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd" event={"ID":"c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6","Type":"ContainerDied","Data":"88aa6f266ccb50a87bf086803d9577f21e036d9cf59f26e092aecd61622fa642"} Jul 07 18:28:06.719244 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:06.719207 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd" event={"ID":"c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6","Type":"ContainerStarted","Data":"a8b0c93687841f2a692552061d95768630f81b7f39483fdc6572f03f2af1221e"} Jul 07 18:28:07.725060 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:07.725029 2580 generic.go:356] "Generic (PLEG): container finished" podID="c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6" containerID="a8b0c93687841f2a692552061d95768630f81b7f39483fdc6572f03f2af1221e" exitCode=0 Jul 07 18:28:07.725060 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:07.725065 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd" event={"ID":"c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6","Type":"ContainerDied","Data":"a8b0c93687841f2a692552061d95768630f81b7f39483fdc6572f03f2af1221e"} Jul 07 18:28:18.777539 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:18.777497 2580 generic.go:356] "Generic (PLEG): container finished" podID="c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6" containerID="16dd6d0dd002387540d7cb3c1a880746817f16326f9798ad83a5911f5af30217" exitCode=0 Jul 07 18:28:18.777911 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:18.777593 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd" event={"ID":"c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6","Type":"ContainerDied","Data":"16dd6d0dd002387540d7cb3c1a880746817f16326f9798ad83a5911f5af30217"} Jul 07 18:28:19.912500 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:19.912471 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd" Jul 07 18:28:19.975223 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:19.975189 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq9f8\" (UniqueName: \"kubernetes.io/projected/c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6-kube-api-access-dq9f8\") pod \"c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6\" (UID: \"c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6\") " Jul 07 18:28:19.975410 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:19.975241 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6-util\") pod \"c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6\" (UID: \"c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6\") " Jul 07 18:28:19.975410 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:19.975274 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6-bundle\") pod \"c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6\" (UID: \"c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6\") " Jul 07 18:28:19.975963 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:19.975940 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6-bundle" (OuterVolumeSpecName: "bundle") pod "c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6" (UID: "c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:28:19.977478 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:19.977437 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6-kube-api-access-dq9f8" (OuterVolumeSpecName: "kube-api-access-dq9f8") pod "c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6" (UID: "c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6"). InnerVolumeSpecName "kube-api-access-dq9f8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:28:19.979223 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:19.979202 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6-util" (OuterVolumeSpecName: "util") pod "c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6" (UID: "c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:28:20.076574 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:20.076496 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6-util\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:28:20.076574 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:20.076524 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6-bundle\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:28:20.076574 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:20.076537 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq9f8\" (UniqueName: \"kubernetes.io/projected/c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6-kube-api-access-dq9f8\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:28:20.788054 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:20.788021 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd" event={"ID":"c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6","Type":"ContainerDied","Data":"3527df5d53cabc7ab35b9bd1c55eaf71a08aec79ba96f9d883e3c67ae5f20adf"} Jul 07 18:28:20.788245 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:20.788069 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3527df5d53cabc7ab35b9bd1c55eaf71a08aec79ba96f9d883e3c67ae5f20adf" Jul 07 18:28:20.788245 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:20.788030 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xdhfd" Jul 07 18:28:27.160007 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:27.159962 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9s9hs"] Jul 07 18:28:27.160519 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:27.160314 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6" containerName="extract" Jul 07 18:28:27.160519 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:27.160325 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6" containerName="extract" Jul 07 18:28:27.160519 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:27.160337 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6" containerName="util" Jul 07 18:28:27.160519 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:27.160342 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6" containerName="util" Jul 07 18:28:27.160519 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:27.160354 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6" containerName="pull" Jul 07 18:28:27.160519 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:27.160360 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6" containerName="pull" Jul 07 18:28:27.160519 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:27.160415 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6c59f9e-fff8-4efd-9e47-a88ee80cb2b6" containerName="extract" Jul 07 18:28:27.202084 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:27.202049 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9s9hs"] Jul 07 18:28:27.202261 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:27.202182 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9s9hs" Jul 07 18:28:27.204948 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:27.204924 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 07 18:28:27.205085 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:27.204992 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-6bh8h\"" Jul 07 18:28:27.205085 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:27.204932 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 07 18:28:27.233719 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:27.233687 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b964437-3367-4540-af06-b93b75efa740-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9s9hs\" (UID: \"0b964437-3367-4540-af06-b93b75efa740\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9s9hs" Jul 07 18:28:27.233719 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:27.233722 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbrrp\" (UniqueName: \"kubernetes.io/projected/0b964437-3367-4540-af06-b93b75efa740-kube-api-access-pbrrp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9s9hs\" (UID: \"0b964437-3367-4540-af06-b93b75efa740\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9s9hs" Jul 07 18:28:27.335014 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:27.334974 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b964437-3367-4540-af06-b93b75efa740-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9s9hs\" (UID: \"0b964437-3367-4540-af06-b93b75efa740\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9s9hs" Jul 07 18:28:27.335014 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:27.335016 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbrrp\" (UniqueName: \"kubernetes.io/projected/0b964437-3367-4540-af06-b93b75efa740-kube-api-access-pbrrp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9s9hs\" (UID: \"0b964437-3367-4540-af06-b93b75efa740\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9s9hs" Jul 07 18:28:27.335367 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:27.335347 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b964437-3367-4540-af06-b93b75efa740-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9s9hs\" (UID: \"0b964437-3367-4540-af06-b93b75efa740\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9s9hs" Jul 07 18:28:27.345703 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:27.345676 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbrrp\" (UniqueName: \"kubernetes.io/projected/0b964437-3367-4540-af06-b93b75efa740-kube-api-access-pbrrp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9s9hs\" (UID: \"0b964437-3367-4540-af06-b93b75efa740\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9s9hs" Jul 07 18:28:27.511394 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:27.511363 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9s9hs" Jul 07 18:28:27.666827 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:27.666720 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9s9hs"] Jul 07 18:28:27.669136 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:28:27.669106 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b964437_3367_4540_af06_b93b75efa740.slice/crio-b5c4883bd6a8f5ada862c40de06cc5b304b7bf9d15f405ee29244434f7c424aa WatchSource:0}: Error finding container b5c4883bd6a8f5ada862c40de06cc5b304b7bf9d15f405ee29244434f7c424aa: Status 404 returned error can't find the container with id b5c4883bd6a8f5ada862c40de06cc5b304b7bf9d15f405ee29244434f7c424aa Jul 07 18:28:27.820785 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:27.820710 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9s9hs" event={"ID":"0b964437-3367-4540-af06-b93b75efa740","Type":"ContainerStarted","Data":"b5c4883bd6a8f5ada862c40de06cc5b304b7bf9d15f405ee29244434f7c424aa"} Jul 07 18:28:29.832068 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:29.832031 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9s9hs" event={"ID":"0b964437-3367-4540-af06-b93b75efa740","Type":"ContainerStarted","Data":"050a202fcb802d538056972f50f4e33de291e257d9ff7cebedec7bda147e80b8"} Jul 07 18:28:29.877741 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:29.877685 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9s9hs" podStartSLOduration=1.2683338 podStartE2EDuration="2.877668843s" totalImagesPullingTime="1.609335043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:28:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:28:29.873845399 +0000 UTC m=+351.004497422" watchObservedRunningTime="2026-07-07 18:28:29.877668843 +0000 UTC m=+351.008320866" Jul 07 18:28:31.102502 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:31.102416 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl"] Jul 07 18:28:31.104811 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:31.104790 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl" Jul 07 18:28:31.107668 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:31.107641 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 18:28:31.108626 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:31.108610 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 18:28:31.108726 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:31.108619 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jk4c4\"" Jul 07 18:28:31.136801 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:31.136767 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl"] Jul 07 18:28:31.178608 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:31.178582 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgssg\" (UniqueName: \"kubernetes.io/projected/ce86feb4-5cbc-46e3-af7e-e243f33bd343-kube-api-access-pgssg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl\" (UID: \"ce86feb4-5cbc-46e3-af7e-e243f33bd343\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl" Jul 07 18:28:31.178747 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:31.178623 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce86feb4-5cbc-46e3-af7e-e243f33bd343-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl\" (UID: \"ce86feb4-5cbc-46e3-af7e-e243f33bd343\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl" Jul 07 18:28:31.178747 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:31.178675 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce86feb4-5cbc-46e3-af7e-e243f33bd343-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl\" (UID: \"ce86feb4-5cbc-46e3-af7e-e243f33bd343\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl" Jul 07 18:28:31.279672 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:31.279637 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce86feb4-5cbc-46e3-af7e-e243f33bd343-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl\" (UID: \"ce86feb4-5cbc-46e3-af7e-e243f33bd343\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl" Jul 07 18:28:31.279905 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:31.279698 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce86feb4-5cbc-46e3-af7e-e243f33bd343-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl\" (UID: \"ce86feb4-5cbc-46e3-af7e-e243f33bd343\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl" Jul 07 18:28:31.279905 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:31.279771 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgssg\" (UniqueName: \"kubernetes.io/projected/ce86feb4-5cbc-46e3-af7e-e243f33bd343-kube-api-access-pgssg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl\" (UID: \"ce86feb4-5cbc-46e3-af7e-e243f33bd343\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl" Jul 07 18:28:31.280111 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:31.280085 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce86feb4-5cbc-46e3-af7e-e243f33bd343-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl\" (UID: \"ce86feb4-5cbc-46e3-af7e-e243f33bd343\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl" Jul 07 18:28:31.280176 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:31.280159 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce86feb4-5cbc-46e3-af7e-e243f33bd343-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl\" (UID: \"ce86feb4-5cbc-46e3-af7e-e243f33bd343\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl" Jul 07 18:28:31.301566 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:31.301535 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgssg\" (UniqueName: \"kubernetes.io/projected/ce86feb4-5cbc-46e3-af7e-e243f33bd343-kube-api-access-pgssg\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl\" (UID: \"ce86feb4-5cbc-46e3-af7e-e243f33bd343\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl" Jul 07 18:28:31.413804 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:31.413710 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl" Jul 07 18:28:31.561432 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:31.561398 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl"] Jul 07 18:28:31.574956 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:28:31.574932 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce86feb4_5cbc_46e3_af7e_e243f33bd343.slice/crio-2f52a76459a193d240ce7f8b60410eed14611e162f88bdb2a52dae9c837a4c31 WatchSource:0}: Error finding container 2f52a76459a193d240ce7f8b60410eed14611e162f88bdb2a52dae9c837a4c31: Status 404 returned error can't find the container with id 2f52a76459a193d240ce7f8b60410eed14611e162f88bdb2a52dae9c837a4c31 Jul 07 18:28:31.843174 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:31.843137 2580 generic.go:356] "Generic (PLEG): container finished" podID="ce86feb4-5cbc-46e3-af7e-e243f33bd343" containerID="15c71a415ae1b61ddfc3f0843b107255ead2aa16eeffddd38e36333bc7d48f74" exitCode=0 Jul 07 18:28:31.843368 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:31.843185 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl" event={"ID":"ce86feb4-5cbc-46e3-af7e-e243f33bd343","Type":"ContainerDied","Data":"15c71a415ae1b61ddfc3f0843b107255ead2aa16eeffddd38e36333bc7d48f74"} Jul 07 18:28:31.843368 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:31.843231 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl" event={"ID":"ce86feb4-5cbc-46e3-af7e-e243f33bd343","Type":"ContainerStarted","Data":"2f52a76459a193d240ce7f8b60410eed14611e162f88bdb2a52dae9c837a4c31"} Jul 07 18:28:33.854795 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:33.854760 2580 generic.go:356] "Generic (PLEG): container finished" podID="ce86feb4-5cbc-46e3-af7e-e243f33bd343" containerID="240e79ef8a847c28d5836b7001191a500417337981ac7741bee7276f0eb25d67" exitCode=0 Jul 07 18:28:33.855125 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:33.854843 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl" event={"ID":"ce86feb4-5cbc-46e3-af7e-e243f33bd343","Type":"ContainerDied","Data":"240e79ef8a847c28d5836b7001191a500417337981ac7741bee7276f0eb25d67"} Jul 07 18:28:34.861204 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:34.861170 2580 generic.go:356] "Generic (PLEG): container finished" podID="ce86feb4-5cbc-46e3-af7e-e243f33bd343" containerID="c655d764322af5b6c9a891eeeec9ea8a3e4cd618bd2d41b004d79822cff4c1ca" exitCode=0 Jul 07 18:28:34.861623 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:34.861243 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl" event={"ID":"ce86feb4-5cbc-46e3-af7e-e243f33bd343","Type":"ContainerDied","Data":"c655d764322af5b6c9a891eeeec9ea8a3e4cd618bd2d41b004d79822cff4c1ca"} Jul 07 18:28:35.996434 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:35.996413 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl" Jul 07 18:28:36.121894 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.121808 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce86feb4-5cbc-46e3-af7e-e243f33bd343-util\") pod \"ce86feb4-5cbc-46e3-af7e-e243f33bd343\" (UID: \"ce86feb4-5cbc-46e3-af7e-e243f33bd343\") " Jul 07 18:28:36.121894 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.121842 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce86feb4-5cbc-46e3-af7e-e243f33bd343-bundle\") pod \"ce86feb4-5cbc-46e3-af7e-e243f33bd343\" (UID: \"ce86feb4-5cbc-46e3-af7e-e243f33bd343\") " Jul 07 18:28:36.122104 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.121912 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgssg\" (UniqueName: \"kubernetes.io/projected/ce86feb4-5cbc-46e3-af7e-e243f33bd343-kube-api-access-pgssg\") pod \"ce86feb4-5cbc-46e3-af7e-e243f33bd343\" (UID: \"ce86feb4-5cbc-46e3-af7e-e243f33bd343\") " Jul 07 18:28:36.122284 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.122262 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce86feb4-5cbc-46e3-af7e-e243f33bd343-bundle" (OuterVolumeSpecName: "bundle") pod "ce86feb4-5cbc-46e3-af7e-e243f33bd343" (UID: "ce86feb4-5cbc-46e3-af7e-e243f33bd343"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:28:36.124056 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.124025 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce86feb4-5cbc-46e3-af7e-e243f33bd343-kube-api-access-pgssg" (OuterVolumeSpecName: "kube-api-access-pgssg") pod "ce86feb4-5cbc-46e3-af7e-e243f33bd343" (UID: "ce86feb4-5cbc-46e3-af7e-e243f33bd343"). InnerVolumeSpecName "kube-api-access-pgssg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:28:36.126603 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.126580 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce86feb4-5cbc-46e3-af7e-e243f33bd343-util" (OuterVolumeSpecName: "util") pod "ce86feb4-5cbc-46e3-af7e-e243f33bd343" (UID: "ce86feb4-5cbc-46e3-af7e-e243f33bd343"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:28:36.222754 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.222713 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgssg\" (UniqueName: \"kubernetes.io/projected/ce86feb4-5cbc-46e3-af7e-e243f33bd343-kube-api-access-pgssg\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:28:36.222754 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.222751 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce86feb4-5cbc-46e3-af7e-e243f33bd343-util\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:28:36.222931 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.222765 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce86feb4-5cbc-46e3-af7e-e243f33bd343-bundle\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:28:36.751107 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.751072 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-66tlm"] Jul 07 18:28:36.751417 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.751406 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce86feb4-5cbc-46e3-af7e-e243f33bd343" containerName="pull" Jul 07 18:28:36.751520 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.751419 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce86feb4-5cbc-46e3-af7e-e243f33bd343" containerName="pull" Jul 07 18:28:36.751520 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.751435 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce86feb4-5cbc-46e3-af7e-e243f33bd343" containerName="util" Jul 07 18:28:36.751520 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.751441 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce86feb4-5cbc-46e3-af7e-e243f33bd343" containerName="util" Jul 07 18:28:36.751520 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.751468 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce86feb4-5cbc-46e3-af7e-e243f33bd343" containerName="extract" Jul 07 18:28:36.751520 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.751480 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce86feb4-5cbc-46e3-af7e-e243f33bd343" containerName="extract" Jul 07 18:28:36.751701 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.751550 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce86feb4-5cbc-46e3-af7e-e243f33bd343" containerName="extract" Jul 07 18:28:36.753595 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.753572 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-66tlm" Jul 07 18:28:36.756245 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.756225 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 18:28:36.756373 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.756231 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-lv6cn\"" Jul 07 18:28:36.757041 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.757022 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 18:28:36.765128 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.765109 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-66tlm"] Jul 07 18:28:36.828801 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.828772 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8487e161-ff69-4a0d-8b85-80008e4bb854-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-66tlm\" (UID: \"8487e161-ff69-4a0d-8b85-80008e4bb854\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-66tlm" Jul 07 18:28:36.828801 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.828802 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f424w\" (UniqueName: \"kubernetes.io/projected/8487e161-ff69-4a0d-8b85-80008e4bb854-kube-api-access-f424w\") pod \"cert-manager-cainjector-559cdd8c87-66tlm\" (UID: \"8487e161-ff69-4a0d-8b85-80008e4bb854\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-66tlm" Jul 07 18:28:36.872412 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.872386 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl" event={"ID":"ce86feb4-5cbc-46e3-af7e-e243f33bd343","Type":"ContainerDied","Data":"2f52a76459a193d240ce7f8b60410eed14611e162f88bdb2a52dae9c837a4c31"} Jul 07 18:28:36.872547 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.872415 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6zrdl" Jul 07 18:28:36.872547 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.872428 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f52a76459a193d240ce7f8b60410eed14611e162f88bdb2a52dae9c837a4c31" Jul 07 18:28:36.929265 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.929237 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8487e161-ff69-4a0d-8b85-80008e4bb854-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-66tlm\" (UID: \"8487e161-ff69-4a0d-8b85-80008e4bb854\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-66tlm" Jul 07 18:28:36.929409 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.929270 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f424w\" (UniqueName: \"kubernetes.io/projected/8487e161-ff69-4a0d-8b85-80008e4bb854-kube-api-access-f424w\") pod \"cert-manager-cainjector-559cdd8c87-66tlm\" (UID: \"8487e161-ff69-4a0d-8b85-80008e4bb854\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-66tlm" Jul 07 18:28:36.940838 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.940805 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8487e161-ff69-4a0d-8b85-80008e4bb854-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-66tlm\" (UID: \"8487e161-ff69-4a0d-8b85-80008e4bb854\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-66tlm" Jul 07 18:28:36.940951 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:36.940886 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f424w\" (UniqueName: \"kubernetes.io/projected/8487e161-ff69-4a0d-8b85-80008e4bb854-kube-api-access-f424w\") pod \"cert-manager-cainjector-559cdd8c87-66tlm\" (UID: \"8487e161-ff69-4a0d-8b85-80008e4bb854\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-66tlm" Jul 07 18:28:37.079647 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:37.079564 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-66tlm" Jul 07 18:28:37.215322 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:37.215300 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-66tlm"] Jul 07 18:28:37.217322 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:28:37.217293 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8487e161_ff69_4a0d_8b85_80008e4bb854.slice/crio-3afed9568e3bca092049194f84dc9d5b57d58cda9d260a6f3ddfbe8b3dcb9f5d WatchSource:0}: Error finding container 3afed9568e3bca092049194f84dc9d5b57d58cda9d260a6f3ddfbe8b3dcb9f5d: Status 404 returned error can't find the container with id 3afed9568e3bca092049194f84dc9d5b57d58cda9d260a6f3ddfbe8b3dcb9f5d Jul 07 18:28:37.881042 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:37.881006 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-66tlm" event={"ID":"8487e161-ff69-4a0d-8b85-80008e4bb854","Type":"ContainerStarted","Data":"3afed9568e3bca092049194f84dc9d5b57d58cda9d260a6f3ddfbe8b3dcb9f5d"} Jul 07 18:28:40.896501 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:40.896440 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-66tlm" event={"ID":"8487e161-ff69-4a0d-8b85-80008e4bb854","Type":"ContainerStarted","Data":"fe66546d93092245e106fb9eec31b35786d262a0fa9271e7309059ef6b3f4bce"} Jul 07 18:28:40.913951 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:40.913901 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-66tlm" podStartSLOduration=2.273140524 podStartE2EDuration="4.91388603s" totalImagesPullingTime="2.640745506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:28:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:28:40.912234159 +0000 UTC m=+362.042886182" watchObservedRunningTime="2026-07-07 18:28:40.91388603 +0000 UTC m=+362.044538052" Jul 07 18:28:43.140530 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:43.140497 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fbc26"] Jul 07 18:28:43.143385 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:43.143369 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fbc26" Jul 07 18:28:43.145803 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:43.145782 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-j2jtn\"" Jul 07 18:28:43.146111 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:43.146092 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 18:28:43.147094 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:43.147075 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 18:28:43.155056 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:43.155036 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fbc26"] Jul 07 18:28:43.283820 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:43.283788 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4x74\" (UniqueName: \"kubernetes.io/projected/0e81400e-817c-4e04-92aa-3f3c2056ba09-kube-api-access-s4x74\") pod \"openshift-lws-operator-fd8ccff4c-fbc26\" (UID: \"0e81400e-817c-4e04-92aa-3f3c2056ba09\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fbc26" Jul 07 18:28:43.283981 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:43.283828 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e81400e-817c-4e04-92aa-3f3c2056ba09-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fbc26\" (UID: \"0e81400e-817c-4e04-92aa-3f3c2056ba09\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fbc26" Jul 07 18:28:43.384656 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:43.384616 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4x74\" (UniqueName: \"kubernetes.io/projected/0e81400e-817c-4e04-92aa-3f3c2056ba09-kube-api-access-s4x74\") pod \"openshift-lws-operator-fd8ccff4c-fbc26\" (UID: \"0e81400e-817c-4e04-92aa-3f3c2056ba09\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fbc26" Jul 07 18:28:43.384853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:43.384669 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e81400e-817c-4e04-92aa-3f3c2056ba09-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fbc26\" (UID: \"0e81400e-817c-4e04-92aa-3f3c2056ba09\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fbc26" Jul 07 18:28:43.385021 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:43.385003 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e81400e-817c-4e04-92aa-3f3c2056ba09-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fbc26\" (UID: \"0e81400e-817c-4e04-92aa-3f3c2056ba09\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fbc26" Jul 07 18:28:43.393767 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:43.393716 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4x74\" (UniqueName: \"kubernetes.io/projected/0e81400e-817c-4e04-92aa-3f3c2056ba09-kube-api-access-s4x74\") pod \"openshift-lws-operator-fd8ccff4c-fbc26\" (UID: \"0e81400e-817c-4e04-92aa-3f3c2056ba09\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fbc26" Jul 07 18:28:43.452213 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:43.452181 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fbc26" Jul 07 18:28:43.617696 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:43.617669 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fbc26"] Jul 07 18:28:43.619174 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:28:43.619149 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e81400e_817c_4e04_92aa_3f3c2056ba09.slice/crio-b840a1361d8a670e7aa2f1d9dac68fb26b15044451873d96403fde2f0ec9b794 WatchSource:0}: Error finding container b840a1361d8a670e7aa2f1d9dac68fb26b15044451873d96403fde2f0ec9b794: Status 404 returned error can't find the container with id b840a1361d8a670e7aa2f1d9dac68fb26b15044451873d96403fde2f0ec9b794 Jul 07 18:28:43.918369 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:43.918331 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fbc26" event={"ID":"0e81400e-817c-4e04-92aa-3f3c2056ba09","Type":"ContainerStarted","Data":"b840a1361d8a670e7aa2f1d9dac68fb26b15044451873d96403fde2f0ec9b794"} Jul 07 18:28:46.934892 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:46.934800 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fbc26" event={"ID":"0e81400e-817c-4e04-92aa-3f3c2056ba09","Type":"ContainerStarted","Data":"32670e05487ac1bacaecd378b32580d0d295a4129b52caf6c7865a054f8f6353"} Jul 07 18:28:46.954020 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:46.953967 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fbc26" podStartSLOduration=1.089607676 podStartE2EDuration="3.953947845s" totalImagesPullingTime="2.864340169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:28:46.952494449 +0000 UTC m=+368.083146476" watchObservedRunningTime="2026-07-07 18:28:46.953947845 +0000 UTC m=+368.084599869" Jul 07 18:28:49.557985 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:49.557950 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6"] Jul 07 18:28:49.584899 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:49.584869 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6"] Jul 07 18:28:49.585046 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:49.584981 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6" Jul 07 18:28:49.587593 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:49.587576 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 18:28:49.588408 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:49.588394 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 18:28:49.588491 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:49.588430 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jk4c4\"" Jul 07 18:28:49.743643 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:49.743608 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1dfb08a-270d-4002-b6ce-9b41b5fcea15-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6\" (UID: \"a1dfb08a-270d-4002-b6ce-9b41b5fcea15\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6" Jul 07 18:28:49.743813 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:49.743648 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1dfb08a-270d-4002-b6ce-9b41b5fcea15-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6\" (UID: \"a1dfb08a-270d-4002-b6ce-9b41b5fcea15\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6" Jul 07 18:28:49.743813 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:49.743710 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t5gj\" (UniqueName: \"kubernetes.io/projected/a1dfb08a-270d-4002-b6ce-9b41b5fcea15-kube-api-access-7t5gj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6\" (UID: \"a1dfb08a-270d-4002-b6ce-9b41b5fcea15\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6" Jul 07 18:28:49.844975 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:49.844884 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t5gj\" (UniqueName: \"kubernetes.io/projected/a1dfb08a-270d-4002-b6ce-9b41b5fcea15-kube-api-access-7t5gj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6\" (UID: \"a1dfb08a-270d-4002-b6ce-9b41b5fcea15\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6" Jul 07 18:28:49.844975 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:49.844964 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1dfb08a-270d-4002-b6ce-9b41b5fcea15-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6\" (UID: \"a1dfb08a-270d-4002-b6ce-9b41b5fcea15\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6" Jul 07 18:28:49.845219 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:49.844985 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1dfb08a-270d-4002-b6ce-9b41b5fcea15-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6\" (UID: \"a1dfb08a-270d-4002-b6ce-9b41b5fcea15\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6" Jul 07 18:28:49.845330 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:49.845313 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1dfb08a-270d-4002-b6ce-9b41b5fcea15-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6\" (UID: \"a1dfb08a-270d-4002-b6ce-9b41b5fcea15\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6" Jul 07 18:28:49.845379 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:49.845342 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1dfb08a-270d-4002-b6ce-9b41b5fcea15-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6\" (UID: \"a1dfb08a-270d-4002-b6ce-9b41b5fcea15\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6" Jul 07 18:28:49.858721 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:49.858690 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t5gj\" (UniqueName: \"kubernetes.io/projected/a1dfb08a-270d-4002-b6ce-9b41b5fcea15-kube-api-access-7t5gj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6\" (UID: \"a1dfb08a-270d-4002-b6ce-9b41b5fcea15\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6" Jul 07 18:28:49.894669 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:49.894639 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6" Jul 07 18:28:50.035478 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:50.035430 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6"] Jul 07 18:28:50.036280 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:28:50.036253 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1dfb08a_270d_4002_b6ce_9b41b5fcea15.slice/crio-5988f732123386fdef2de9429f4436014d20b53ac22a8e4ae5cad51395f37b74 WatchSource:0}: Error finding container 5988f732123386fdef2de9429f4436014d20b53ac22a8e4ae5cad51395f37b74: Status 404 returned error can't find the container with id 5988f732123386fdef2de9429f4436014d20b53ac22a8e4ae5cad51395f37b74 Jul 07 18:28:50.961878 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:50.961838 2580 generic.go:356] "Generic (PLEG): container finished" podID="a1dfb08a-270d-4002-b6ce-9b41b5fcea15" containerID="1f2d7b48444d6db367424c45bafbce9e1f95dc22c93069cd57d7169d98233189" exitCode=0 Jul 07 18:28:50.962240 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:50.961925 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6" event={"ID":"a1dfb08a-270d-4002-b6ce-9b41b5fcea15","Type":"ContainerDied","Data":"1f2d7b48444d6db367424c45bafbce9e1f95dc22c93069cd57d7169d98233189"} Jul 07 18:28:50.962240 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:50.961964 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6" event={"ID":"a1dfb08a-270d-4002-b6ce-9b41b5fcea15","Type":"ContainerStarted","Data":"5988f732123386fdef2de9429f4436014d20b53ac22a8e4ae5cad51395f37b74"} Jul 07 18:28:51.968636 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:51.968546 2580 generic.go:356] "Generic (PLEG): container finished" podID="a1dfb08a-270d-4002-b6ce-9b41b5fcea15" containerID="acf1f5ecc3c91fc1127f45c002e787c0bf0922449c6d9d81ec088a3305594058" exitCode=0 Jul 07 18:28:51.969039 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:51.968639 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6" event={"ID":"a1dfb08a-270d-4002-b6ce-9b41b5fcea15","Type":"ContainerDied","Data":"acf1f5ecc3c91fc1127f45c002e787c0bf0922449c6d9d81ec088a3305594058"} Jul 07 18:28:52.975795 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:52.975763 2580 generic.go:356] "Generic (PLEG): container finished" podID="a1dfb08a-270d-4002-b6ce-9b41b5fcea15" containerID="54f714fb5d230d545df156be0824c6ddc325bdb560e3ce71b7473e24ac983fc9" exitCode=0 Jul 07 18:28:52.975795 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:52.975800 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6" event={"ID":"a1dfb08a-270d-4002-b6ce-9b41b5fcea15","Type":"ContainerDied","Data":"54f714fb5d230d545df156be0824c6ddc325bdb560e3ce71b7473e24ac983fc9"} Jul 07 18:28:54.116082 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:54.116054 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6" Jul 07 18:28:54.285678 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:54.285592 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1dfb08a-270d-4002-b6ce-9b41b5fcea15-bundle\") pod \"a1dfb08a-270d-4002-b6ce-9b41b5fcea15\" (UID: \"a1dfb08a-270d-4002-b6ce-9b41b5fcea15\") " Jul 07 18:28:54.285678 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:54.285659 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7t5gj\" (UniqueName: \"kubernetes.io/projected/a1dfb08a-270d-4002-b6ce-9b41b5fcea15-kube-api-access-7t5gj\") pod \"a1dfb08a-270d-4002-b6ce-9b41b5fcea15\" (UID: \"a1dfb08a-270d-4002-b6ce-9b41b5fcea15\") " Jul 07 18:28:54.285964 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:54.285699 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1dfb08a-270d-4002-b6ce-9b41b5fcea15-util\") pod \"a1dfb08a-270d-4002-b6ce-9b41b5fcea15\" (UID: \"a1dfb08a-270d-4002-b6ce-9b41b5fcea15\") " Jul 07 18:28:54.286547 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:54.286513 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1dfb08a-270d-4002-b6ce-9b41b5fcea15-bundle" (OuterVolumeSpecName: "bundle") pod "a1dfb08a-270d-4002-b6ce-9b41b5fcea15" (UID: "a1dfb08a-270d-4002-b6ce-9b41b5fcea15"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:28:54.287881 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:54.287853 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1dfb08a-270d-4002-b6ce-9b41b5fcea15-kube-api-access-7t5gj" (OuterVolumeSpecName: "kube-api-access-7t5gj") pod "a1dfb08a-270d-4002-b6ce-9b41b5fcea15" (UID: "a1dfb08a-270d-4002-b6ce-9b41b5fcea15"). InnerVolumeSpecName "kube-api-access-7t5gj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:28:54.291189 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:54.291168 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1dfb08a-270d-4002-b6ce-9b41b5fcea15-util" (OuterVolumeSpecName: "util") pod "a1dfb08a-270d-4002-b6ce-9b41b5fcea15" (UID: "a1dfb08a-270d-4002-b6ce-9b41b5fcea15"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:28:54.386605 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:54.386562 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1dfb08a-270d-4002-b6ce-9b41b5fcea15-util\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:28:54.386605 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:54.386600 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1dfb08a-270d-4002-b6ce-9b41b5fcea15-bundle\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:28:54.386605 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:54.386609 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7t5gj\" (UniqueName: \"kubernetes.io/projected/a1dfb08a-270d-4002-b6ce-9b41b5fcea15-kube-api-access-7t5gj\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:28:54.987147 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:54.987116 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6" Jul 07 18:28:54.987301 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:54.987143 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9f5w6" event={"ID":"a1dfb08a-270d-4002-b6ce-9b41b5fcea15","Type":"ContainerDied","Data":"5988f732123386fdef2de9429f4436014d20b53ac22a8e4ae5cad51395f37b74"} Jul 07 18:28:54.987301 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:28:54.987221 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5988f732123386fdef2de9429f4436014d20b53ac22a8e4ae5cad51395f37b74" Jul 07 18:29:02.771378 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.771347 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf"] Jul 07 18:29:02.771750 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.771705 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1dfb08a-270d-4002-b6ce-9b41b5fcea15" containerName="extract" Jul 07 18:29:02.771750 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.771716 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1dfb08a-270d-4002-b6ce-9b41b5fcea15" containerName="extract" Jul 07 18:29:02.771750 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.771729 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1dfb08a-270d-4002-b6ce-9b41b5fcea15" containerName="util" Jul 07 18:29:02.771750 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.771735 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1dfb08a-270d-4002-b6ce-9b41b5fcea15" containerName="util" Jul 07 18:29:02.771750 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.771745 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1dfb08a-270d-4002-b6ce-9b41b5fcea15" containerName="pull" Jul 07 18:29:02.771750 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.771750 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1dfb08a-270d-4002-b6ce-9b41b5fcea15" containerName="pull" Jul 07 18:29:02.771941 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.771820 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1dfb08a-270d-4002-b6ce-9b41b5fcea15" containerName="extract" Jul 07 18:29:02.774744 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.774725 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" Jul 07 18:29:02.778449 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.778428 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 18:29:02.778830 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.778811 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 18:29:02.778933 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.778835 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 18:29:02.778933 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.778843 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-llbm9\"" Jul 07 18:29:02.779129 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.779108 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 18:29:02.804796 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.804771 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf"] Jul 07 18:29:02.854269 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.854238 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1491e747-7243-4e09-b668-2e9ae29bd515-webhook-cert\") pod \"opendatahub-operator-controller-manager-7595c859c8-zsrvf\" (UID: \"1491e747-7243-4e09-b668-2e9ae29bd515\") " pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" Jul 07 18:29:02.854474 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.854274 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1491e747-7243-4e09-b668-2e9ae29bd515-manifests\") pod \"opendatahub-operator-controller-manager-7595c859c8-zsrvf\" (UID: \"1491e747-7243-4e09-b668-2e9ae29bd515\") " pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" Jul 07 18:29:02.854474 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.854312 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp4nh\" (UniqueName: \"kubernetes.io/projected/1491e747-7243-4e09-b668-2e9ae29bd515-kube-api-access-zp4nh\") pod \"opendatahub-operator-controller-manager-7595c859c8-zsrvf\" (UID: \"1491e747-7243-4e09-b668-2e9ae29bd515\") " pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" Jul 07 18:29:02.854474 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.854357 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1491e747-7243-4e09-b668-2e9ae29bd515-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7595c859c8-zsrvf\" (UID: \"1491e747-7243-4e09-b668-2e9ae29bd515\") " pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" Jul 07 18:29:02.854474 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.854419 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1491e747-7243-4e09-b668-2e9ae29bd515-tmp\") pod \"opendatahub-operator-controller-manager-7595c859c8-zsrvf\" (UID: \"1491e747-7243-4e09-b668-2e9ae29bd515\") " pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" Jul 07 18:29:02.955423 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.955392 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp4nh\" (UniqueName: \"kubernetes.io/projected/1491e747-7243-4e09-b668-2e9ae29bd515-kube-api-access-zp4nh\") pod \"opendatahub-operator-controller-manager-7595c859c8-zsrvf\" (UID: \"1491e747-7243-4e09-b668-2e9ae29bd515\") " pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" Jul 07 18:29:02.955619 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.955430 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1491e747-7243-4e09-b668-2e9ae29bd515-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7595c859c8-zsrvf\" (UID: \"1491e747-7243-4e09-b668-2e9ae29bd515\") " pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" Jul 07 18:29:02.955619 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.955487 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1491e747-7243-4e09-b668-2e9ae29bd515-tmp\") pod \"opendatahub-operator-controller-manager-7595c859c8-zsrvf\" (UID: \"1491e747-7243-4e09-b668-2e9ae29bd515\") " pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" Jul 07 18:29:02.955619 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.955553 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1491e747-7243-4e09-b668-2e9ae29bd515-webhook-cert\") pod \"opendatahub-operator-controller-manager-7595c859c8-zsrvf\" (UID: \"1491e747-7243-4e09-b668-2e9ae29bd515\") " pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" Jul 07 18:29:02.955619 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.955581 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1491e747-7243-4e09-b668-2e9ae29bd515-manifests\") pod \"opendatahub-operator-controller-manager-7595c859c8-zsrvf\" (UID: \"1491e747-7243-4e09-b668-2e9ae29bd515\") " pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" Jul 07 18:29:02.955988 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.955963 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1491e747-7243-4e09-b668-2e9ae29bd515-manifests\") pod \"opendatahub-operator-controller-manager-7595c859c8-zsrvf\" (UID: \"1491e747-7243-4e09-b668-2e9ae29bd515\") " pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" Jul 07 18:29:02.957873 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.957850 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1491e747-7243-4e09-b668-2e9ae29bd515-tmp\") pod \"opendatahub-operator-controller-manager-7595c859c8-zsrvf\" (UID: \"1491e747-7243-4e09-b668-2e9ae29bd515\") " pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" Jul 07 18:29:02.958124 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.958102 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1491e747-7243-4e09-b668-2e9ae29bd515-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7595c859c8-zsrvf\" (UID: \"1491e747-7243-4e09-b668-2e9ae29bd515\") " pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" Jul 07 18:29:02.958205 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.958133 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1491e747-7243-4e09-b668-2e9ae29bd515-webhook-cert\") pod \"opendatahub-operator-controller-manager-7595c859c8-zsrvf\" (UID: \"1491e747-7243-4e09-b668-2e9ae29bd515\") " pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" Jul 07 18:29:02.964485 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:02.964451 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp4nh\" (UniqueName: \"kubernetes.io/projected/1491e747-7243-4e09-b668-2e9ae29bd515-kube-api-access-zp4nh\") pod \"opendatahub-operator-controller-manager-7595c859c8-zsrvf\" (UID: \"1491e747-7243-4e09-b668-2e9ae29bd515\") " pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" Jul 07 18:29:03.085045 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:03.084970 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" Jul 07 18:29:03.227601 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:03.227576 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf"] Jul 07 18:29:03.229744 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:29:03.229721 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1491e747_7243_4e09_b668_2e9ae29bd515.slice/crio-0969c10db5e264601083e9df7ceb8a0a052589b202392ddc82d3f35e4cabdfd3 WatchSource:0}: Error finding container 0969c10db5e264601083e9df7ceb8a0a052589b202392ddc82d3f35e4cabdfd3: Status 404 returned error can't find the container with id 0969c10db5e264601083e9df7ceb8a0a052589b202392ddc82d3f35e4cabdfd3 Jul 07 18:29:04.032531 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:04.032487 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" event={"ID":"1491e747-7243-4e09-b668-2e9ae29bd515","Type":"ContainerStarted","Data":"0969c10db5e264601083e9df7ceb8a0a052589b202392ddc82d3f35e4cabdfd3"} Jul 07 18:29:07.051012 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:07.050969 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" event={"ID":"1491e747-7243-4e09-b668-2e9ae29bd515","Type":"ContainerStarted","Data":"849cda1715007cbfb57306c6e8fcdb24cd0dcb2ddad4f2bf67387a80bcf33317"} Jul 07 18:29:08.056940 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:08.056906 2580 generic.go:356] "Generic (PLEG): container finished" podID="1491e747-7243-4e09-b668-2e9ae29bd515" containerID="849cda1715007cbfb57306c6e8fcdb24cd0dcb2ddad4f2bf67387a80bcf33317" exitCode=0 Jul 07 18:29:08.057427 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:08.056984 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" event={"ID":"1491e747-7243-4e09-b668-2e9ae29bd515","Type":"ContainerDied","Data":"849cda1715007cbfb57306c6e8fcdb24cd0dcb2ddad4f2bf67387a80bcf33317"} Jul 07 18:29:09.063532 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:09.063492 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" event={"ID":"1491e747-7243-4e09-b668-2e9ae29bd515","Type":"ContainerStarted","Data":"802ac1a743f966781c1a5105908943b745cb85524824c62cb2e472f8fdf8a0f1"} Jul 07 18:29:09.063915 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:09.063640 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" Jul 07 18:29:09.099980 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:09.099930 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" podStartSLOduration=2.790668981 podStartE2EDuration="7.099916369s" totalImagesPullingTime="3.300024255s" totalInitContainerRuntime="1.009223133s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:29:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:29:09.097217541 +0000 UTC m=+390.227869558" watchObservedRunningTime="2026-07-07 18:29:09.099916369 +0000 UTC m=+390.230568392" Jul 07 18:29:20.071696 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:20.071661 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7595c859c8-zsrvf" Jul 07 18:29:22.663025 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:22.662990 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-749c476b6d-q2dbx"] Jul 07 18:29:22.668230 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:22.668211 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-749c476b6d-q2dbx" Jul 07 18:29:22.671712 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:22.671688 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 07 18:29:22.671832 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:22.671722 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-msk2x\"" Jul 07 18:29:22.671966 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:22.671953 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 07 18:29:22.672027 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:22.671991 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 07 18:29:22.679974 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:22.679950 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-749c476b6d-q2dbx"] Jul 07 18:29:22.737012 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:22.736981 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86b38e18-085b-4c2f-81e7-f2993c64aa50-cert\") pod \"lws-controller-manager-749c476b6d-q2dbx\" (UID: \"86b38e18-085b-4c2f-81e7-f2993c64aa50\") " pod="openshift-lws-operator/lws-controller-manager-749c476b6d-q2dbx" Jul 07 18:29:22.737181 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:22.737032 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7hwd\" (UniqueName: \"kubernetes.io/projected/86b38e18-085b-4c2f-81e7-f2993c64aa50-kube-api-access-r7hwd\") pod \"lws-controller-manager-749c476b6d-q2dbx\" (UID: \"86b38e18-085b-4c2f-81e7-f2993c64aa50\") " pod="openshift-lws-operator/lws-controller-manager-749c476b6d-q2dbx" Jul 07 18:29:22.737181 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:22.737060 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/86b38e18-085b-4c2f-81e7-f2993c64aa50-manager-config\") pod \"lws-controller-manager-749c476b6d-q2dbx\" (UID: \"86b38e18-085b-4c2f-81e7-f2993c64aa50\") " pod="openshift-lws-operator/lws-controller-manager-749c476b6d-q2dbx" Jul 07 18:29:22.737181 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:22.737096 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/86b38e18-085b-4c2f-81e7-f2993c64aa50-metrics-cert\") pod \"lws-controller-manager-749c476b6d-q2dbx\" (UID: \"86b38e18-085b-4c2f-81e7-f2993c64aa50\") " pod="openshift-lws-operator/lws-controller-manager-749c476b6d-q2dbx" Jul 07 18:29:22.838437 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:22.838398 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/86b38e18-085b-4c2f-81e7-f2993c64aa50-manager-config\") pod \"lws-controller-manager-749c476b6d-q2dbx\" (UID: \"86b38e18-085b-4c2f-81e7-f2993c64aa50\") " pod="openshift-lws-operator/lws-controller-manager-749c476b6d-q2dbx" Jul 07 18:29:22.838437 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:22.838441 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/86b38e18-085b-4c2f-81e7-f2993c64aa50-metrics-cert\") pod \"lws-controller-manager-749c476b6d-q2dbx\" (UID: \"86b38e18-085b-4c2f-81e7-f2993c64aa50\") " pod="openshift-lws-operator/lws-controller-manager-749c476b6d-q2dbx" Jul 07 18:29:22.838699 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:22.838549 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86b38e18-085b-4c2f-81e7-f2993c64aa50-cert\") pod \"lws-controller-manager-749c476b6d-q2dbx\" (UID: \"86b38e18-085b-4c2f-81e7-f2993c64aa50\") " pod="openshift-lws-operator/lws-controller-manager-749c476b6d-q2dbx" Jul 07 18:29:22.838699 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:22.838605 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7hwd\" (UniqueName: \"kubernetes.io/projected/86b38e18-085b-4c2f-81e7-f2993c64aa50-kube-api-access-r7hwd\") pod \"lws-controller-manager-749c476b6d-q2dbx\" (UID: \"86b38e18-085b-4c2f-81e7-f2993c64aa50\") " pod="openshift-lws-operator/lws-controller-manager-749c476b6d-q2dbx" Jul 07 18:29:22.839224 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:22.839202 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/86b38e18-085b-4c2f-81e7-f2993c64aa50-manager-config\") pod \"lws-controller-manager-749c476b6d-q2dbx\" (UID: \"86b38e18-085b-4c2f-81e7-f2993c64aa50\") " pod="openshift-lws-operator/lws-controller-manager-749c476b6d-q2dbx" Jul 07 18:29:22.841133 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:22.841112 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86b38e18-085b-4c2f-81e7-f2993c64aa50-cert\") pod \"lws-controller-manager-749c476b6d-q2dbx\" (UID: \"86b38e18-085b-4c2f-81e7-f2993c64aa50\") " pod="openshift-lws-operator/lws-controller-manager-749c476b6d-q2dbx" Jul 07 18:29:22.841208 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:22.841187 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/86b38e18-085b-4c2f-81e7-f2993c64aa50-metrics-cert\") pod \"lws-controller-manager-749c476b6d-q2dbx\" (UID: \"86b38e18-085b-4c2f-81e7-f2993c64aa50\") " pod="openshift-lws-operator/lws-controller-manager-749c476b6d-q2dbx" Jul 07 18:29:22.848446 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:22.848426 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7hwd\" (UniqueName: \"kubernetes.io/projected/86b38e18-085b-4c2f-81e7-f2993c64aa50-kube-api-access-r7hwd\") pod \"lws-controller-manager-749c476b6d-q2dbx\" (UID: \"86b38e18-085b-4c2f-81e7-f2993c64aa50\") " pod="openshift-lws-operator/lws-controller-manager-749c476b6d-q2dbx" Jul 07 18:29:22.977873 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:22.977766 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-749c476b6d-q2dbx" Jul 07 18:29:23.122590 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:23.122558 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-749c476b6d-q2dbx"] Jul 07 18:29:23.125902 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:29:23.125872 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86b38e18_085b_4c2f_81e7_f2993c64aa50.slice/crio-5465d8bfbdfbea5fcaa40d4dd8b3778f61bff2a5585f9e885da43a05141395f6 WatchSource:0}: Error finding container 5465d8bfbdfbea5fcaa40d4dd8b3778f61bff2a5585f9e885da43a05141395f6: Status 404 returned error can't find the container with id 5465d8bfbdfbea5fcaa40d4dd8b3778f61bff2a5585f9e885da43a05141395f6 Jul 07 18:29:23.133793 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:23.133764 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-749c476b6d-q2dbx" event={"ID":"86b38e18-085b-4c2f-81e7-f2993c64aa50","Type":"ContainerStarted","Data":"5465d8bfbdfbea5fcaa40d4dd8b3778f61bff2a5585f9e885da43a05141395f6"} Jul 07 18:29:25.145722 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:25.145685 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-749c476b6d-q2dbx" event={"ID":"86b38e18-085b-4c2f-81e7-f2993c64aa50","Type":"ContainerStarted","Data":"7a1afce7f41fe126e889a3c6307c014ff2d361a5e5518399fc7e669befaa3cea"} Jul 07 18:29:25.146154 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:25.145819 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-749c476b6d-q2dbx" Jul 07 18:29:25.203564 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:25.203441 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-749c476b6d-q2dbx" podStartSLOduration=1.428713675 podStartE2EDuration="3.203424071s" totalImagesPullingTime="1.774710396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:29:25.201491511 +0000 UTC m=+406.332143538" watchObservedRunningTime="2026-07-07 18:29:25.203424071 +0000 UTC m=+406.334076094" Jul 07 18:29:31.324901 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.324866 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5"] Jul 07 18:29:31.327189 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.327173 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.331403 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:29:31.331366 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="a89bd6a3-489e-4cf9-9260-ec7a80649035" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.332060 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.332043 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 18:29:31.332274 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.332260 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-mgnzt\"" Jul 07 18:29:31.370659 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.370625 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5"] Jul 07 18:29:31.417798 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.417754 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a89bd6a3-489e-4cf9-9260-ec7a80649035-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.417974 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.417821 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a89bd6a3-489e-4cf9-9260-ec7a80649035-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.417974 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.417841 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a89bd6a3-489e-4cf9-9260-ec7a80649035-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.417974 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.417864 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxzdf\" (UniqueName: \"kubernetes.io/projected/a89bd6a3-489e-4cf9-9260-ec7a80649035-kube-api-access-pxzdf\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.417974 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.417882 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a89bd6a3-489e-4cf9-9260-ec7a80649035-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.417974 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.417903 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a89bd6a3-489e-4cf9-9260-ec7a80649035-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.417974 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.417925 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a89bd6a3-489e-4cf9-9260-ec7a80649035-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.418194 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.417980 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a89bd6a3-489e-4cf9-9260-ec7a80649035-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.418194 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.418020 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a89bd6a3-489e-4cf9-9260-ec7a80649035-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.519052 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.519014 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a89bd6a3-489e-4cf9-9260-ec7a80649035-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.519052 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.519049 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a89bd6a3-489e-4cf9-9260-ec7a80649035-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.519314 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.519073 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxzdf\" (UniqueName: \"kubernetes.io/projected/a89bd6a3-489e-4cf9-9260-ec7a80649035-kube-api-access-pxzdf\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.519314 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.519092 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a89bd6a3-489e-4cf9-9260-ec7a80649035-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.519314 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.519115 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a89bd6a3-489e-4cf9-9260-ec7a80649035-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.519314 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.519135 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a89bd6a3-489e-4cf9-9260-ec7a80649035-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.519314 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.519181 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a89bd6a3-489e-4cf9-9260-ec7a80649035-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.519314 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.519228 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a89bd6a3-489e-4cf9-9260-ec7a80649035-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.519314 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.519270 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a89bd6a3-489e-4cf9-9260-ec7a80649035-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.519691 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.519524 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a89bd6a3-489e-4cf9-9260-ec7a80649035-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.519691 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.519584 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a89bd6a3-489e-4cf9-9260-ec7a80649035-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.519691 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.519621 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a89bd6a3-489e-4cf9-9260-ec7a80649035-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.519691 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.519669 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a89bd6a3-489e-4cf9-9260-ec7a80649035-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.519988 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.519964 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a89bd6a3-489e-4cf9-9260-ec7a80649035-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.521716 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.521697 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a89bd6a3-489e-4cf9-9260-ec7a80649035-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.521840 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.521822 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a89bd6a3-489e-4cf9-9260-ec7a80649035-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.534601 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.534577 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxzdf\" (UniqueName: \"kubernetes.io/projected/a89bd6a3-489e-4cf9-9260-ec7a80649035-kube-api-access-pxzdf\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.534712 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.534692 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a89bd6a3-489e-4cf9-9260-ec7a80649035-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xrtm5\" (UID: \"a89bd6a3-489e-4cf9-9260-ec7a80649035\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.637565 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.637474 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:31.638602 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.638580 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7"] Jul 07 18:29:31.640807 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.640793 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:31.643333 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.643316 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 18:29:31.644547 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.644529 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 18:29:31.644636 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.644534 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 18:29:31.644636 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.644570 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-m7jp2\"" Jul 07 18:29:31.668186 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.668139 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7"] Jul 07 18:29:31.721223 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.721182 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eea9a5c1-5b85-4583-af77-58e889a3b4da-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hccw7\" (UID: \"eea9a5c1-5b85-4583-af77-58e889a3b4da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:31.721387 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.721256 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eea9a5c1-5b85-4583-af77-58e889a3b4da-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hccw7\" (UID: \"eea9a5c1-5b85-4583-af77-58e889a3b4da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:31.721387 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.721292 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eea9a5c1-5b85-4583-af77-58e889a3b4da-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hccw7\" (UID: \"eea9a5c1-5b85-4583-af77-58e889a3b4da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:31.721387 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.721337 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eea9a5c1-5b85-4583-af77-58e889a3b4da-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hccw7\" (UID: \"eea9a5c1-5b85-4583-af77-58e889a3b4da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:31.721387 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.721360 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eea9a5c1-5b85-4583-af77-58e889a3b4da-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hccw7\" (UID: \"eea9a5c1-5b85-4583-af77-58e889a3b4da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:31.721616 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.721392 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eea9a5c1-5b85-4583-af77-58e889a3b4da-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hccw7\" (UID: \"eea9a5c1-5b85-4583-af77-58e889a3b4da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:31.721616 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.721409 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzk5b\" (UniqueName: \"kubernetes.io/projected/eea9a5c1-5b85-4583-af77-58e889a3b4da-kube-api-access-fzk5b\") pod \"istiod-openshift-gateway-94bb8fbfd-hccw7\" (UID: \"eea9a5c1-5b85-4583-af77-58e889a3b4da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:31.801436 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.801411 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5"] Jul 07 18:29:31.802282 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:29:31.802256 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda89bd6a3_489e_4cf9_9260_ec7a80649035.slice/crio-7ac1c89514b14975e4c5bb9975180cf5e70b9fb125f4abc92f0737e22dba33d6 WatchSource:0}: Error finding container 7ac1c89514b14975e4c5bb9975180cf5e70b9fb125f4abc92f0737e22dba33d6: Status 404 returned error can't find the container with id 7ac1c89514b14975e4c5bb9975180cf5e70b9fb125f4abc92f0737e22dba33d6 Jul 07 18:29:31.822644 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.822619 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eea9a5c1-5b85-4583-af77-58e889a3b4da-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hccw7\" (UID: \"eea9a5c1-5b85-4583-af77-58e889a3b4da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:31.822759 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.822676 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eea9a5c1-5b85-4583-af77-58e889a3b4da-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hccw7\" (UID: \"eea9a5c1-5b85-4583-af77-58e889a3b4da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:31.822759 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.822716 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eea9a5c1-5b85-4583-af77-58e889a3b4da-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hccw7\" (UID: \"eea9a5c1-5b85-4583-af77-58e889a3b4da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:31.822759 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.822750 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eea9a5c1-5b85-4583-af77-58e889a3b4da-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hccw7\" (UID: \"eea9a5c1-5b85-4583-af77-58e889a3b4da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:31.822899 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.822780 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eea9a5c1-5b85-4583-af77-58e889a3b4da-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hccw7\" (UID: \"eea9a5c1-5b85-4583-af77-58e889a3b4da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:31.822899 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.822816 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eea9a5c1-5b85-4583-af77-58e889a3b4da-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hccw7\" (UID: \"eea9a5c1-5b85-4583-af77-58e889a3b4da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:31.822899 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.822836 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzk5b\" (UniqueName: \"kubernetes.io/projected/eea9a5c1-5b85-4583-af77-58e889a3b4da-kube-api-access-fzk5b\") pod \"istiod-openshift-gateway-94bb8fbfd-hccw7\" (UID: \"eea9a5c1-5b85-4583-af77-58e889a3b4da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:31.823591 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.823566 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eea9a5c1-5b85-4583-af77-58e889a3b4da-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hccw7\" (UID: \"eea9a5c1-5b85-4583-af77-58e889a3b4da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:31.825037 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.825011 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eea9a5c1-5b85-4583-af77-58e889a3b4da-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hccw7\" (UID: \"eea9a5c1-5b85-4583-af77-58e889a3b4da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:31.825113 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.825048 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eea9a5c1-5b85-4583-af77-58e889a3b4da-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hccw7\" (UID: \"eea9a5c1-5b85-4583-af77-58e889a3b4da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:31.825344 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.825324 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eea9a5c1-5b85-4583-af77-58e889a3b4da-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hccw7\" (UID: \"eea9a5c1-5b85-4583-af77-58e889a3b4da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:31.825390 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.825371 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eea9a5c1-5b85-4583-af77-58e889a3b4da-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hccw7\" (UID: \"eea9a5c1-5b85-4583-af77-58e889a3b4da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:31.848526 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.848493 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzk5b\" (UniqueName: \"kubernetes.io/projected/eea9a5c1-5b85-4583-af77-58e889a3b4da-kube-api-access-fzk5b\") pod \"istiod-openshift-gateway-94bb8fbfd-hccw7\" (UID: \"eea9a5c1-5b85-4583-af77-58e889a3b4da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:31.848845 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.848827 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eea9a5c1-5b85-4583-af77-58e889a3b4da-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hccw7\" (UID: \"eea9a5c1-5b85-4583-af77-58e889a3b4da\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:31.970120 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:31.970026 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:32.161973 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:29:32.161922 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeea9a5c1_5b85_4583_af77_58e889a3b4da.slice/crio-170fe56a71c8e2540fe5ab5719acab6a922b2d13ffcc611d1de2ef4686118f7a WatchSource:0}: Error finding container 170fe56a71c8e2540fe5ab5719acab6a922b2d13ffcc611d1de2ef4686118f7a: Status 404 returned error can't find the container with id 170fe56a71c8e2540fe5ab5719acab6a922b2d13ffcc611d1de2ef4686118f7a Jul 07 18:29:32.163945 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:32.163873 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7"] Jul 07 18:29:32.192552 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:32.192515 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" event={"ID":"a89bd6a3-489e-4cf9-9260-ec7a80649035","Type":"ContainerStarted","Data":"7ac1c89514b14975e4c5bb9975180cf5e70b9fb125f4abc92f0737e22dba33d6"} Jul 07 18:29:32.192738 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:32.192716 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" event={"ID":"eea9a5c1-5b85-4583-af77-58e889a3b4da","Type":"ContainerStarted","Data":"170fe56a71c8e2540fe5ab5719acab6a922b2d13ffcc611d1de2ef4686118f7a"} Jul 07 18:29:35.179263 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:35.179205 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:29:35.179607 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:35.179297 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:29:35.179607 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:35.179516 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:29:35.179607 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:35.179590 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:29:35.179960 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:35.179629 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:29:36.152575 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:36.152548 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-749c476b6d-q2dbx" Jul 07 18:29:36.216193 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:36.216135 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" event={"ID":"eea9a5c1-5b85-4583-af77-58e889a3b4da","Type":"ContainerStarted","Data":"c398302dfc07bd764d08ec5b35c5e16ca9a971ffa817d33dae7c595ecce89b15"} Jul 07 18:29:36.216666 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:36.216204 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:36.217935 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:36.217914 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" Jul 07 18:29:36.218213 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:36.218192 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" event={"ID":"a89bd6a3-489e-4cf9-9260-ec7a80649035","Type":"ContainerStarted","Data":"e92f035583da86d2a0dbd52e400555944296762485b7c41346ff9bcaf9b28fb4"} Jul 07 18:29:36.249600 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:36.249540 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hccw7" podStartSLOduration=2.234815353 podStartE2EDuration="5.249521616s" totalImagesPullingTime="3.014706263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:29:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:29:36.24668902 +0000 UTC m=+417.377341043" watchObservedRunningTime="2026-07-07 18:29:36.249521616 +0000 UTC m=+417.380173621" Jul 07 18:29:36.279161 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:36.279113 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" podStartSLOduration=1.90404697 podStartE2EDuration="5.279095815s" totalImagesPullingTime="3.375048845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:29:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:29:36.277528771 +0000 UTC m=+417.408180795" watchObservedRunningTime="2026-07-07 18:29:36.279095815 +0000 UTC m=+417.409747838" Jul 07 18:29:36.638652 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:36.638614 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:36.642857 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:36.642837 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:37.223835 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:37.223804 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:29:37.224855 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:29:37.224837 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xrtm5" Jul 07 18:30:39.652179 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:39.652141 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n"] Jul 07 18:30:39.654833 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:39.654817 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n" Jul 07 18:30:39.657252 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:39.657228 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 18:30:39.657405 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:39.657297 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 18:30:39.658055 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:39.658038 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z7bnh\"" Jul 07 18:30:39.666505 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:39.666479 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n"] Jul 07 18:30:39.743866 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:39.743828 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ea6da50-29b2-4b9b-ad99-73a77b297822-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n\" (UID: \"6ea6da50-29b2-4b9b-ad99-73a77b297822\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n" Jul 07 18:30:39.744044 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:39.743914 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ea6da50-29b2-4b9b-ad99-73a77b297822-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n\" (UID: \"6ea6da50-29b2-4b9b-ad99-73a77b297822\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n" Jul 07 18:30:39.744044 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:39.743949 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcfpb\" (UniqueName: \"kubernetes.io/projected/6ea6da50-29b2-4b9b-ad99-73a77b297822-kube-api-access-vcfpb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n\" (UID: \"6ea6da50-29b2-4b9b-ad99-73a77b297822\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n" Jul 07 18:30:39.845365 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:39.845327 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ea6da50-29b2-4b9b-ad99-73a77b297822-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n\" (UID: \"6ea6da50-29b2-4b9b-ad99-73a77b297822\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n" Jul 07 18:30:39.845365 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:39.845372 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcfpb\" (UniqueName: \"kubernetes.io/projected/6ea6da50-29b2-4b9b-ad99-73a77b297822-kube-api-access-vcfpb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n\" (UID: \"6ea6da50-29b2-4b9b-ad99-73a77b297822\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n" Jul 07 18:30:39.845590 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:39.845419 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ea6da50-29b2-4b9b-ad99-73a77b297822-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n\" (UID: \"6ea6da50-29b2-4b9b-ad99-73a77b297822\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n" Jul 07 18:30:39.845810 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:39.845794 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ea6da50-29b2-4b9b-ad99-73a77b297822-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n\" (UID: \"6ea6da50-29b2-4b9b-ad99-73a77b297822\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n" Jul 07 18:30:39.845854 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:39.845792 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ea6da50-29b2-4b9b-ad99-73a77b297822-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n\" (UID: \"6ea6da50-29b2-4b9b-ad99-73a77b297822\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n" Jul 07 18:30:39.853772 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:39.853753 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcfpb\" (UniqueName: \"kubernetes.io/projected/6ea6da50-29b2-4b9b-ad99-73a77b297822-kube-api-access-vcfpb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n\" (UID: \"6ea6da50-29b2-4b9b-ad99-73a77b297822\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n" Jul 07 18:30:39.964254 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:39.964169 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n" Jul 07 18:30:40.047618 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.047584 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs"] Jul 07 18:30:40.050877 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.050855 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs" Jul 07 18:30:40.062125 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.062061 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs"] Jul 07 18:30:40.104691 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.104668 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n"] Jul 07 18:30:40.106498 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:30:40.106473 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ea6da50_29b2_4b9b_ad99_73a77b297822.slice/crio-509c69b9a491733c5e6145d8f636ef1073b427663697a0dfa122d8462ef5e1f5 WatchSource:0}: Error finding container 509c69b9a491733c5e6145d8f636ef1073b427663697a0dfa122d8462ef5e1f5: Status 404 returned error can't find the container with id 509c69b9a491733c5e6145d8f636ef1073b427663697a0dfa122d8462ef5e1f5 Jul 07 18:30:40.148711 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.148681 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94989ca4-1abb-4930-9f08-49946987d363-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs\" (UID: \"94989ca4-1abb-4930-9f08-49946987d363\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs" Jul 07 18:30:40.148812 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.148779 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djfz2\" (UniqueName: \"kubernetes.io/projected/94989ca4-1abb-4930-9f08-49946987d363-kube-api-access-djfz2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs\" (UID: \"94989ca4-1abb-4930-9f08-49946987d363\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs" Jul 07 18:30:40.148869 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.148852 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94989ca4-1abb-4930-9f08-49946987d363-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs\" (UID: \"94989ca4-1abb-4930-9f08-49946987d363\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs" Jul 07 18:30:40.249845 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.249813 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djfz2\" (UniqueName: \"kubernetes.io/projected/94989ca4-1abb-4930-9f08-49946987d363-kube-api-access-djfz2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs\" (UID: \"94989ca4-1abb-4930-9f08-49946987d363\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs" Jul 07 18:30:40.250049 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.249892 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94989ca4-1abb-4930-9f08-49946987d363-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs\" (UID: \"94989ca4-1abb-4930-9f08-49946987d363\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs" Jul 07 18:30:40.250049 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.250011 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94989ca4-1abb-4930-9f08-49946987d363-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs\" (UID: \"94989ca4-1abb-4930-9f08-49946987d363\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs" Jul 07 18:30:40.250292 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.250262 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94989ca4-1abb-4930-9f08-49946987d363-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs\" (UID: \"94989ca4-1abb-4930-9f08-49946987d363\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs" Jul 07 18:30:40.250495 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.250450 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94989ca4-1abb-4930-9f08-49946987d363-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs\" (UID: \"94989ca4-1abb-4930-9f08-49946987d363\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs" Jul 07 18:30:40.258853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.258832 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djfz2\" (UniqueName: \"kubernetes.io/projected/94989ca4-1abb-4930-9f08-49946987d363-kube-api-access-djfz2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs\" (UID: \"94989ca4-1abb-4930-9f08-49946987d363\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs" Jul 07 18:30:40.365913 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.365876 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs" Jul 07 18:30:40.448529 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.448500 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm"] Jul 07 18:30:40.454092 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.454068 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm" Jul 07 18:30:40.463641 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.463616 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm"] Jul 07 18:30:40.503620 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.503571 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs"] Jul 07 18:30:40.505761 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:30:40.505739 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94989ca4_1abb_4930_9f08_49946987d363.slice/crio-5e01d5c3976e618e1483c1fe4dded405698ae8e09b9125e6612f65ffdad78d9c WatchSource:0}: Error finding container 5e01d5c3976e618e1483c1fe4dded405698ae8e09b9125e6612f65ffdad78d9c: Status 404 returned error can't find the container with id 5e01d5c3976e618e1483c1fe4dded405698ae8e09b9125e6612f65ffdad78d9c Jul 07 18:30:40.541991 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.541960 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs" event={"ID":"94989ca4-1abb-4930-9f08-49946987d363","Type":"ContainerStarted","Data":"5e01d5c3976e618e1483c1fe4dded405698ae8e09b9125e6612f65ffdad78d9c"} Jul 07 18:30:40.543581 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.543559 2580 generic.go:356] "Generic (PLEG): container finished" podID="6ea6da50-29b2-4b9b-ad99-73a77b297822" containerID="01a7f8336c1f31e78e8643106cca7724f158b3430ebc4d33ffc627df93d7e877" exitCode=0 Jul 07 18:30:40.543665 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.543636 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n" event={"ID":"6ea6da50-29b2-4b9b-ad99-73a77b297822","Type":"ContainerDied","Data":"01a7f8336c1f31e78e8643106cca7724f158b3430ebc4d33ffc627df93d7e877"} Jul 07 18:30:40.543713 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.543673 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n" event={"ID":"6ea6da50-29b2-4b9b-ad99-73a77b297822","Type":"ContainerStarted","Data":"509c69b9a491733c5e6145d8f636ef1073b427663697a0dfa122d8462ef5e1f5"} Jul 07 18:30:40.553523 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.553498 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f43c18f-bea7-43b8-94af-1aa0b7d79930-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm\" (UID: \"9f43c18f-bea7-43b8-94af-1aa0b7d79930\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm" Jul 07 18:30:40.553628 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.553538 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f43c18f-bea7-43b8-94af-1aa0b7d79930-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm\" (UID: \"9f43c18f-bea7-43b8-94af-1aa0b7d79930\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm" Jul 07 18:30:40.553696 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.553623 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw9gl\" (UniqueName: \"kubernetes.io/projected/9f43c18f-bea7-43b8-94af-1aa0b7d79930-kube-api-access-zw9gl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm\" (UID: \"9f43c18f-bea7-43b8-94af-1aa0b7d79930\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm" Jul 07 18:30:40.654864 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.654827 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f43c18f-bea7-43b8-94af-1aa0b7d79930-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm\" (UID: \"9f43c18f-bea7-43b8-94af-1aa0b7d79930\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm" Jul 07 18:30:40.654864 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.654867 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f43c18f-bea7-43b8-94af-1aa0b7d79930-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm\" (UID: \"9f43c18f-bea7-43b8-94af-1aa0b7d79930\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm" Jul 07 18:30:40.655260 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.654944 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw9gl\" (UniqueName: \"kubernetes.io/projected/9f43c18f-bea7-43b8-94af-1aa0b7d79930-kube-api-access-zw9gl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm\" (UID: \"9f43c18f-bea7-43b8-94af-1aa0b7d79930\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm" Jul 07 18:30:40.655299 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.655265 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f43c18f-bea7-43b8-94af-1aa0b7d79930-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm\" (UID: \"9f43c18f-bea7-43b8-94af-1aa0b7d79930\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm" Jul 07 18:30:40.655340 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.655304 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f43c18f-bea7-43b8-94af-1aa0b7d79930-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm\" (UID: \"9f43c18f-bea7-43b8-94af-1aa0b7d79930\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm" Jul 07 18:30:40.664079 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.664046 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw9gl\" (UniqueName: \"kubernetes.io/projected/9f43c18f-bea7-43b8-94af-1aa0b7d79930-kube-api-access-zw9gl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm\" (UID: \"9f43c18f-bea7-43b8-94af-1aa0b7d79930\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm" Jul 07 18:30:40.766058 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.765971 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm" Jul 07 18:30:40.860522 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.860486 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk"] Jul 07 18:30:40.864303 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.864278 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk" Jul 07 18:30:40.873211 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.873180 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk"] Jul 07 18:30:40.902300 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.902273 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm"] Jul 07 18:30:40.904355 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:30:40.904328 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f43c18f_bea7_43b8_94af_1aa0b7d79930.slice/crio-c63714d183e27a584027adc6955c089aaad56b2f65199c827915cb6d964b9203 WatchSource:0}: Error finding container c63714d183e27a584027adc6955c089aaad56b2f65199c827915cb6d964b9203: Status 404 returned error can't find the container with id c63714d183e27a584027adc6955c089aaad56b2f65199c827915cb6d964b9203 Jul 07 18:30:40.958028 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.958001 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c77b0fb7-91cd-4a06-8953-abe6b26f672b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk\" (UID: \"c77b0fb7-91cd-4a06-8953-abe6b26f672b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk" Jul 07 18:30:40.958147 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.958048 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn9wz\" (UniqueName: \"kubernetes.io/projected/c77b0fb7-91cd-4a06-8953-abe6b26f672b-kube-api-access-tn9wz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk\" (UID: \"c77b0fb7-91cd-4a06-8953-abe6b26f672b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk" Jul 07 18:30:40.958188 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:40.958138 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c77b0fb7-91cd-4a06-8953-abe6b26f672b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk\" (UID: \"c77b0fb7-91cd-4a06-8953-abe6b26f672b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk" Jul 07 18:30:41.059397 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:41.059307 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c77b0fb7-91cd-4a06-8953-abe6b26f672b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk\" (UID: \"c77b0fb7-91cd-4a06-8953-abe6b26f672b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk" Jul 07 18:30:41.059397 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:41.059352 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn9wz\" (UniqueName: \"kubernetes.io/projected/c77b0fb7-91cd-4a06-8953-abe6b26f672b-kube-api-access-tn9wz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk\" (UID: \"c77b0fb7-91cd-4a06-8953-abe6b26f672b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk" Jul 07 18:30:41.059397 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:41.059380 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c77b0fb7-91cd-4a06-8953-abe6b26f672b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk\" (UID: \"c77b0fb7-91cd-4a06-8953-abe6b26f672b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk" Jul 07 18:30:41.059719 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:41.059700 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c77b0fb7-91cd-4a06-8953-abe6b26f672b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk\" (UID: \"c77b0fb7-91cd-4a06-8953-abe6b26f672b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk" Jul 07 18:30:41.059765 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:41.059742 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c77b0fb7-91cd-4a06-8953-abe6b26f672b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk\" (UID: \"c77b0fb7-91cd-4a06-8953-abe6b26f672b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk" Jul 07 18:30:41.069265 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:41.069242 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn9wz\" (UniqueName: \"kubernetes.io/projected/c77b0fb7-91cd-4a06-8953-abe6b26f672b-kube-api-access-tn9wz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk\" (UID: \"c77b0fb7-91cd-4a06-8953-abe6b26f672b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk" Jul 07 18:30:41.181182 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:41.181138 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk" Jul 07 18:30:41.346361 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:41.346284 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk"] Jul 07 18:30:41.377059 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:30:41.377015 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc77b0fb7_91cd_4a06_8953_abe6b26f672b.slice/crio-9f5017c9348c6ffb3b7bc2b6ba32f4a8fd2344599a976c372b6a08e92909c286 WatchSource:0}: Error finding container 9f5017c9348c6ffb3b7bc2b6ba32f4a8fd2344599a976c372b6a08e92909c286: Status 404 returned error can't find the container with id 9f5017c9348c6ffb3b7bc2b6ba32f4a8fd2344599a976c372b6a08e92909c286 Jul 07 18:30:41.550610 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:41.550575 2580 generic.go:356] "Generic (PLEG): container finished" podID="94989ca4-1abb-4930-9f08-49946987d363" containerID="a7a2ad32b54521244dc258ba75f2372f02f0b58a92fc6f4b8a0a53913a6ed010" exitCode=0 Jul 07 18:30:41.550923 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:41.550654 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs" event={"ID":"94989ca4-1abb-4930-9f08-49946987d363","Type":"ContainerDied","Data":"a7a2ad32b54521244dc258ba75f2372f02f0b58a92fc6f4b8a0a53913a6ed010"} Jul 07 18:30:41.552532 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:41.552510 2580 generic.go:356] "Generic (PLEG): container finished" podID="6ea6da50-29b2-4b9b-ad99-73a77b297822" containerID="e4eaac1f1361a3e14733fffd393ab64bd64b062f36e6e45b9c8bfa854c7490d0" exitCode=0 Jul 07 18:30:41.552632 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:41.552565 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n" event={"ID":"6ea6da50-29b2-4b9b-ad99-73a77b297822","Type":"ContainerDied","Data":"e4eaac1f1361a3e14733fffd393ab64bd64b062f36e6e45b9c8bfa854c7490d0"} Jul 07 18:30:41.554267 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:41.554244 2580 generic.go:356] "Generic (PLEG): container finished" podID="c77b0fb7-91cd-4a06-8953-abe6b26f672b" containerID="9beea6bece98a77ba0ea4bf246719b3e3c5d67e482643162977b8727def3caad" exitCode=0 Jul 07 18:30:41.554356 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:41.554301 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk" event={"ID":"c77b0fb7-91cd-4a06-8953-abe6b26f672b","Type":"ContainerDied","Data":"9beea6bece98a77ba0ea4bf246719b3e3c5d67e482643162977b8727def3caad"} Jul 07 18:30:41.554356 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:41.554344 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk" event={"ID":"c77b0fb7-91cd-4a06-8953-abe6b26f672b","Type":"ContainerStarted","Data":"9f5017c9348c6ffb3b7bc2b6ba32f4a8fd2344599a976c372b6a08e92909c286"} Jul 07 18:30:41.556500 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:41.556466 2580 generic.go:356] "Generic (PLEG): container finished" podID="9f43c18f-bea7-43b8-94af-1aa0b7d79930" containerID="6d09ea48219c8fd42ed2d23208750e66243b426283bc8ccfe4bc3bbb311164af" exitCode=0 Jul 07 18:30:41.556599 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:41.556493 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm" event={"ID":"9f43c18f-bea7-43b8-94af-1aa0b7d79930","Type":"ContainerDied","Data":"6d09ea48219c8fd42ed2d23208750e66243b426283bc8ccfe4bc3bbb311164af"} Jul 07 18:30:41.556599 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:41.556550 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm" event={"ID":"9f43c18f-bea7-43b8-94af-1aa0b7d79930","Type":"ContainerStarted","Data":"c63714d183e27a584027adc6955c089aaad56b2f65199c827915cb6d964b9203"} Jul 07 18:30:41.739295 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:30:41.739262 2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ea6da50_29b2_4b9b_ad99_73a77b297822.slice/crio-conmon-d498f02e8d6cfec98207a32e97ee6cd0c1af2d365546f4212c95612cb6e223f0.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ea6da50_29b2_4b9b_ad99_73a77b297822.slice/crio-d498f02e8d6cfec98207a32e97ee6cd0c1af2d365546f4212c95612cb6e223f0.scope\": RecentStats: unable to find data in memory cache]" Jul 07 18:30:42.570102 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:42.570071 2580 generic.go:356] "Generic (PLEG): container finished" podID="94989ca4-1abb-4930-9f08-49946987d363" containerID="d5653240cf773efa237732ef87df7a3bb005d223515cdb27a39e367f2307e3ef" exitCode=0 Jul 07 18:30:42.570281 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:42.570155 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs" event={"ID":"94989ca4-1abb-4930-9f08-49946987d363","Type":"ContainerDied","Data":"d5653240cf773efa237732ef87df7a3bb005d223515cdb27a39e367f2307e3ef"} Jul 07 18:30:42.572116 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:42.572092 2580 generic.go:356] "Generic (PLEG): container finished" podID="6ea6da50-29b2-4b9b-ad99-73a77b297822" containerID="d498f02e8d6cfec98207a32e97ee6cd0c1af2d365546f4212c95612cb6e223f0" exitCode=0 Jul 07 18:30:42.572225 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:42.572168 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n" event={"ID":"6ea6da50-29b2-4b9b-ad99-73a77b297822","Type":"ContainerDied","Data":"d498f02e8d6cfec98207a32e97ee6cd0c1af2d365546f4212c95612cb6e223f0"} Jul 07 18:30:42.573748 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:42.573730 2580 generic.go:356] "Generic (PLEG): container finished" podID="c77b0fb7-91cd-4a06-8953-abe6b26f672b" containerID="54f207790d45c018f68241b55d0cdc66c49fd6eb4606b3eb2f1ba38323f91cda" exitCode=0 Jul 07 18:30:42.573845 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:42.573766 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk" event={"ID":"c77b0fb7-91cd-4a06-8953-abe6b26f672b","Type":"ContainerDied","Data":"54f207790d45c018f68241b55d0cdc66c49fd6eb4606b3eb2f1ba38323f91cda"} Jul 07 18:30:43.581618 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:43.581587 2580 generic.go:356] "Generic (PLEG): container finished" podID="c77b0fb7-91cd-4a06-8953-abe6b26f672b" containerID="4bfbfaa47f65e3780f875aa9d73abc847abf0e82810e6000ed00a92af5fabacc" exitCode=0 Jul 07 18:30:43.582059 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:43.581664 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk" event={"ID":"c77b0fb7-91cd-4a06-8953-abe6b26f672b","Type":"ContainerDied","Data":"4bfbfaa47f65e3780f875aa9d73abc847abf0e82810e6000ed00a92af5fabacc"} Jul 07 18:30:43.583446 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:43.583423 2580 generic.go:356] "Generic (PLEG): container finished" podID="9f43c18f-bea7-43b8-94af-1aa0b7d79930" containerID="50ba80f917924c5a2815e422c443fa62792a472b4ee0563483ef06ad10a5be08" exitCode=0 Jul 07 18:30:43.583587 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:43.583484 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm" event={"ID":"9f43c18f-bea7-43b8-94af-1aa0b7d79930","Type":"ContainerDied","Data":"50ba80f917924c5a2815e422c443fa62792a472b4ee0563483ef06ad10a5be08"} Jul 07 18:30:43.585615 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:43.585598 2580 generic.go:356] "Generic (PLEG): container finished" podID="94989ca4-1abb-4930-9f08-49946987d363" containerID="d92b197bd6ed4c8fbb81637633596b730241cb0ba6fa7263857ae41ee326dfb4" exitCode=0 Jul 07 18:30:43.585716 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:43.585685 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs" event={"ID":"94989ca4-1abb-4930-9f08-49946987d363","Type":"ContainerDied","Data":"d92b197bd6ed4c8fbb81637633596b730241cb0ba6fa7263857ae41ee326dfb4"} Jul 07 18:30:43.729532 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:43.729509 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n" Jul 07 18:30:43.783800 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:43.783772 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ea6da50-29b2-4b9b-ad99-73a77b297822-bundle\") pod \"6ea6da50-29b2-4b9b-ad99-73a77b297822\" (UID: \"6ea6da50-29b2-4b9b-ad99-73a77b297822\") " Jul 07 18:30:43.783941 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:43.783812 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ea6da50-29b2-4b9b-ad99-73a77b297822-util\") pod \"6ea6da50-29b2-4b9b-ad99-73a77b297822\" (UID: \"6ea6da50-29b2-4b9b-ad99-73a77b297822\") " Jul 07 18:30:43.783941 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:43.783848 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcfpb\" (UniqueName: \"kubernetes.io/projected/6ea6da50-29b2-4b9b-ad99-73a77b297822-kube-api-access-vcfpb\") pod \"6ea6da50-29b2-4b9b-ad99-73a77b297822\" (UID: \"6ea6da50-29b2-4b9b-ad99-73a77b297822\") " Jul 07 18:30:43.784349 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:43.784323 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ea6da50-29b2-4b9b-ad99-73a77b297822-bundle" (OuterVolumeSpecName: "bundle") pod "6ea6da50-29b2-4b9b-ad99-73a77b297822" (UID: "6ea6da50-29b2-4b9b-ad99-73a77b297822"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:30:43.786155 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:43.786131 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ea6da50-29b2-4b9b-ad99-73a77b297822-kube-api-access-vcfpb" (OuterVolumeSpecName: "kube-api-access-vcfpb") pod "6ea6da50-29b2-4b9b-ad99-73a77b297822" (UID: "6ea6da50-29b2-4b9b-ad99-73a77b297822"). InnerVolumeSpecName "kube-api-access-vcfpb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:30:43.789720 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:43.789696 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ea6da50-29b2-4b9b-ad99-73a77b297822-util" (OuterVolumeSpecName: "util") pod "6ea6da50-29b2-4b9b-ad99-73a77b297822" (UID: "6ea6da50-29b2-4b9b-ad99-73a77b297822"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:30:43.885641 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:43.885595 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcfpb\" (UniqueName: \"kubernetes.io/projected/6ea6da50-29b2-4b9b-ad99-73a77b297822-kube-api-access-vcfpb\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:30:43.885641 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:43.885631 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6ea6da50-29b2-4b9b-ad99-73a77b297822-bundle\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:30:43.885641 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:43.885647 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6ea6da50-29b2-4b9b-ad99-73a77b297822-util\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:30:44.592952 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.592921 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n" Jul 07 18:30:44.592952 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.592946 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n" event={"ID":"6ea6da50-29b2-4b9b-ad99-73a77b297822","Type":"ContainerDied","Data":"509c69b9a491733c5e6145d8f636ef1073b427663697a0dfa122d8462ef5e1f5"} Jul 07 18:30:44.593473 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.592993 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="509c69b9a491733c5e6145d8f636ef1073b427663697a0dfa122d8462ef5e1f5" Jul 07 18:30:44.595166 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.595132 2580 generic.go:356] "Generic (PLEG): container finished" podID="9f43c18f-bea7-43b8-94af-1aa0b7d79930" containerID="67772909e98b455f5c352b0952c1e79afb20a90128d1f812b8fb15c705112c49" exitCode=0 Jul 07 18:30:44.595304 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.595200 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm" event={"ID":"9f43c18f-bea7-43b8-94af-1aa0b7d79930","Type":"ContainerDied","Data":"67772909e98b455f5c352b0952c1e79afb20a90128d1f812b8fb15c705112c49"} Jul 07 18:30:44.731731 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.731703 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk" Jul 07 18:30:44.764515 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.764490 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs" Jul 07 18:30:44.792895 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.792863 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c77b0fb7-91cd-4a06-8953-abe6b26f672b-bundle\") pod \"c77b0fb7-91cd-4a06-8953-abe6b26f672b\" (UID: \"c77b0fb7-91cd-4a06-8953-abe6b26f672b\") " Jul 07 18:30:44.793120 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.792976 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tn9wz\" (UniqueName: \"kubernetes.io/projected/c77b0fb7-91cd-4a06-8953-abe6b26f672b-kube-api-access-tn9wz\") pod \"c77b0fb7-91cd-4a06-8953-abe6b26f672b\" (UID: \"c77b0fb7-91cd-4a06-8953-abe6b26f672b\") " Jul 07 18:30:44.793120 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.793016 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c77b0fb7-91cd-4a06-8953-abe6b26f672b-util\") pod \"c77b0fb7-91cd-4a06-8953-abe6b26f672b\" (UID: \"c77b0fb7-91cd-4a06-8953-abe6b26f672b\") " Jul 07 18:30:44.793469 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.793436 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c77b0fb7-91cd-4a06-8953-abe6b26f672b-bundle" (OuterVolumeSpecName: "bundle") pod "c77b0fb7-91cd-4a06-8953-abe6b26f672b" (UID: "c77b0fb7-91cd-4a06-8953-abe6b26f672b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:30:44.795149 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.795122 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c77b0fb7-91cd-4a06-8953-abe6b26f672b-kube-api-access-tn9wz" (OuterVolumeSpecName: "kube-api-access-tn9wz") pod "c77b0fb7-91cd-4a06-8953-abe6b26f672b" (UID: "c77b0fb7-91cd-4a06-8953-abe6b26f672b"). InnerVolumeSpecName "kube-api-access-tn9wz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:30:44.798341 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.798318 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c77b0fb7-91cd-4a06-8953-abe6b26f672b-util" (OuterVolumeSpecName: "util") pod "c77b0fb7-91cd-4a06-8953-abe6b26f672b" (UID: "c77b0fb7-91cd-4a06-8953-abe6b26f672b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:30:44.893808 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.893778 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djfz2\" (UniqueName: \"kubernetes.io/projected/94989ca4-1abb-4930-9f08-49946987d363-kube-api-access-djfz2\") pod \"94989ca4-1abb-4930-9f08-49946987d363\" (UID: \"94989ca4-1abb-4930-9f08-49946987d363\") " Jul 07 18:30:44.893952 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.893819 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94989ca4-1abb-4930-9f08-49946987d363-util\") pod \"94989ca4-1abb-4930-9f08-49946987d363\" (UID: \"94989ca4-1abb-4930-9f08-49946987d363\") " Jul 07 18:30:44.893952 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.893835 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94989ca4-1abb-4930-9f08-49946987d363-bundle\") pod \"94989ca4-1abb-4930-9f08-49946987d363\" (UID: \"94989ca4-1abb-4930-9f08-49946987d363\") " Jul 07 18:30:44.894024 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.893991 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c77b0fb7-91cd-4a06-8953-abe6b26f672b-bundle\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:30:44.894024 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.894001 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tn9wz\" (UniqueName: \"kubernetes.io/projected/c77b0fb7-91cd-4a06-8953-abe6b26f672b-kube-api-access-tn9wz\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:30:44.894024 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.894010 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c77b0fb7-91cd-4a06-8953-abe6b26f672b-util\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:30:44.894330 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.894306 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94989ca4-1abb-4930-9f08-49946987d363-bundle" (OuterVolumeSpecName: "bundle") pod "94989ca4-1abb-4930-9f08-49946987d363" (UID: "94989ca4-1abb-4930-9f08-49946987d363"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:30:44.895926 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.895897 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94989ca4-1abb-4930-9f08-49946987d363-kube-api-access-djfz2" (OuterVolumeSpecName: "kube-api-access-djfz2") pod "94989ca4-1abb-4930-9f08-49946987d363" (UID: "94989ca4-1abb-4930-9f08-49946987d363"). InnerVolumeSpecName "kube-api-access-djfz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:30:44.899266 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.899247 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94989ca4-1abb-4930-9f08-49946987d363-util" (OuterVolumeSpecName: "util") pod "94989ca4-1abb-4930-9f08-49946987d363" (UID: "94989ca4-1abb-4930-9f08-49946987d363"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:30:44.995424 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.995376 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djfz2\" (UniqueName: \"kubernetes.io/projected/94989ca4-1abb-4930-9f08-49946987d363-kube-api-access-djfz2\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:30:44.995424 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.995417 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94989ca4-1abb-4930-9f08-49946987d363-util\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:30:44.995424 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:44.995427 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94989ca4-1abb-4930-9f08-49946987d363-bundle\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:30:45.601732 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:45.601706 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs" Jul 07 18:30:45.602155 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:45.601732 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs" event={"ID":"94989ca4-1abb-4930-9f08-49946987d363","Type":"ContainerDied","Data":"5e01d5c3976e618e1483c1fe4dded405698ae8e09b9125e6612f65ffdad78d9c"} Jul 07 18:30:45.602155 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:45.601775 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e01d5c3976e618e1483c1fe4dded405698ae8e09b9125e6612f65ffdad78d9c" Jul 07 18:30:45.603555 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:45.603535 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk" event={"ID":"c77b0fb7-91cd-4a06-8953-abe6b26f672b","Type":"ContainerDied","Data":"9f5017c9348c6ffb3b7bc2b6ba32f4a8fd2344599a976c372b6a08e92909c286"} Jul 07 18:30:45.603651 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:45.603570 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f5017c9348c6ffb3b7bc2b6ba32f4a8fd2344599a976c372b6a08e92909c286" Jul 07 18:30:45.603703 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:45.603690 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk" Jul 07 18:30:45.738117 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:45.738085 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm" Jul 07 18:30:45.802595 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:45.802564 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f43c18f-bea7-43b8-94af-1aa0b7d79930-bundle\") pod \"9f43c18f-bea7-43b8-94af-1aa0b7d79930\" (UID: \"9f43c18f-bea7-43b8-94af-1aa0b7d79930\") " Jul 07 18:30:45.802762 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:45.802622 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zw9gl\" (UniqueName: \"kubernetes.io/projected/9f43c18f-bea7-43b8-94af-1aa0b7d79930-kube-api-access-zw9gl\") pod \"9f43c18f-bea7-43b8-94af-1aa0b7d79930\" (UID: \"9f43c18f-bea7-43b8-94af-1aa0b7d79930\") " Jul 07 18:30:45.802762 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:45.802718 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f43c18f-bea7-43b8-94af-1aa0b7d79930-util\") pod \"9f43c18f-bea7-43b8-94af-1aa0b7d79930\" (UID: \"9f43c18f-bea7-43b8-94af-1aa0b7d79930\") " Jul 07 18:30:45.803230 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:45.803203 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f43c18f-bea7-43b8-94af-1aa0b7d79930-bundle" (OuterVolumeSpecName: "bundle") pod "9f43c18f-bea7-43b8-94af-1aa0b7d79930" (UID: "9f43c18f-bea7-43b8-94af-1aa0b7d79930"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:30:45.804902 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:45.804874 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f43c18f-bea7-43b8-94af-1aa0b7d79930-kube-api-access-zw9gl" (OuterVolumeSpecName: "kube-api-access-zw9gl") pod "9f43c18f-bea7-43b8-94af-1aa0b7d79930" (UID: "9f43c18f-bea7-43b8-94af-1aa0b7d79930"). InnerVolumeSpecName "kube-api-access-zw9gl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:30:45.810900 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:45.810863 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f43c18f-bea7-43b8-94af-1aa0b7d79930-util" (OuterVolumeSpecName: "util") pod "9f43c18f-bea7-43b8-94af-1aa0b7d79930" (UID: "9f43c18f-bea7-43b8-94af-1aa0b7d79930"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:30:45.903750 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:45.903662 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f43c18f-bea7-43b8-94af-1aa0b7d79930-bundle\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:30:45.903750 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:45.903714 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw9gl\" (UniqueName: \"kubernetes.io/projected/9f43c18f-bea7-43b8-94af-1aa0b7d79930-kube-api-access-zw9gl\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:30:45.903750 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:45.903728 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f43c18f-bea7-43b8-94af-1aa0b7d79930-util\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:30:46.610448 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:46.610420 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm" Jul 07 18:30:46.610869 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:46.610448 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm" event={"ID":"9f43c18f-bea7-43b8-94af-1aa0b7d79930","Type":"ContainerDied","Data":"c63714d183e27a584027adc6955c089aaad56b2f65199c827915cb6d964b9203"} Jul 07 18:30:46.610869 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:46.610525 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c63714d183e27a584027adc6955c089aaad56b2f65199c827915cb6d964b9203" Jul 07 18:30:48.983510 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:30:48.983474 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bb84f79f5-6jhgf"] Jul 07 18:31:14.006008 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.005959 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7bb84f79f5-6jhgf" podUID="26add002-9ec1-4217-bc40-24b6f38fbd43" containerName="console" containerID="cri-o://ab1b8f2ad6d9f5fbb5ab93b4407b96de7f79a5f85de89a522c3edd31cc07dcec" gracePeriod=15 Jul 07 18:31:14.256793 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.256731 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:31:14.265311 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.265288 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26add002-9ec1-4217-bc40-24b6f38fbd43-console-oauth-config\") pod \"26add002-9ec1-4217-bc40-24b6f38fbd43\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " Jul 07 18:31:14.265438 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.265323 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-oauth-serving-cert\") pod \"26add002-9ec1-4217-bc40-24b6f38fbd43\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " Jul 07 18:31:14.265438 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.265356 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-console-config\") pod \"26add002-9ec1-4217-bc40-24b6f38fbd43\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " Jul 07 18:31:14.265438 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.265382 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-service-ca\") pod \"26add002-9ec1-4217-bc40-24b6f38fbd43\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " Jul 07 18:31:14.265438 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.265429 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5knlw\" (UniqueName: \"kubernetes.io/projected/26add002-9ec1-4217-bc40-24b6f38fbd43-kube-api-access-5knlw\") pod \"26add002-9ec1-4217-bc40-24b6f38fbd43\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " Jul 07 18:31:14.265672 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.265501 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-trusted-ca-bundle\") pod \"26add002-9ec1-4217-bc40-24b6f38fbd43\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " Jul 07 18:31:14.265672 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.265541 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26add002-9ec1-4217-bc40-24b6f38fbd43-console-serving-cert\") pod \"26add002-9ec1-4217-bc40-24b6f38fbd43\" (UID: \"26add002-9ec1-4217-bc40-24b6f38fbd43\") " Jul 07 18:31:14.265823 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.265800 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "26add002-9ec1-4217-bc40-24b6f38fbd43" (UID: "26add002-9ec1-4217-bc40-24b6f38fbd43"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:31:14.265823 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.265809 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-service-ca" (OuterVolumeSpecName: "service-ca") pod "26add002-9ec1-4217-bc40-24b6f38fbd43" (UID: "26add002-9ec1-4217-bc40-24b6f38fbd43"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:31:14.265944 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.265813 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-console-config" (OuterVolumeSpecName: "console-config") pod "26add002-9ec1-4217-bc40-24b6f38fbd43" (UID: "26add002-9ec1-4217-bc40-24b6f38fbd43"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:31:14.266171 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.266148 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "26add002-9ec1-4217-bc40-24b6f38fbd43" (UID: "26add002-9ec1-4217-bc40-24b6f38fbd43"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:31:14.267786 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.267757 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26add002-9ec1-4217-bc40-24b6f38fbd43-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "26add002-9ec1-4217-bc40-24b6f38fbd43" (UID: "26add002-9ec1-4217-bc40-24b6f38fbd43"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:31:14.268002 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.267980 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26add002-9ec1-4217-bc40-24b6f38fbd43-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "26add002-9ec1-4217-bc40-24b6f38fbd43" (UID: "26add002-9ec1-4217-bc40-24b6f38fbd43"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 18:31:14.268216 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.268189 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26add002-9ec1-4217-bc40-24b6f38fbd43-kube-api-access-5knlw" (OuterVolumeSpecName: "kube-api-access-5knlw") pod "26add002-9ec1-4217-bc40-24b6f38fbd43" (UID: "26add002-9ec1-4217-bc40-24b6f38fbd43"). InnerVolumeSpecName "kube-api-access-5knlw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:31:14.366466 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.366354 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26add002-9ec1-4217-bc40-24b6f38fbd43-console-oauth-config\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:31:14.366466 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.366448 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-oauth-serving-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:31:14.366709 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.366487 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-console-config\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:31:14.366709 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.366500 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-service-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:31:14.366709 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.366511 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5knlw\" (UniqueName: \"kubernetes.io/projected/26add002-9ec1-4217-bc40-24b6f38fbd43-kube-api-access-5knlw\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:31:14.366709 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.366550 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26add002-9ec1-4217-bc40-24b6f38fbd43-trusted-ca-bundle\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:31:14.366709 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.366564 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26add002-9ec1-4217-bc40-24b6f38fbd43-console-serving-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:31:14.770283 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.770249 2580 generic.go:356] "Generic (PLEG): container finished" podID="26add002-9ec1-4217-bc40-24b6f38fbd43" containerID="ab1b8f2ad6d9f5fbb5ab93b4407b96de7f79a5f85de89a522c3edd31cc07dcec" exitCode=0 Jul 07 18:31:14.770521 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.770316 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb84f79f5-6jhgf" Jul 07 18:31:14.770521 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.770350 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb84f79f5-6jhgf" event={"ID":"26add002-9ec1-4217-bc40-24b6f38fbd43","Type":"ContainerDied","Data":"ab1b8f2ad6d9f5fbb5ab93b4407b96de7f79a5f85de89a522c3edd31cc07dcec"} Jul 07 18:31:14.770521 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.770435 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb84f79f5-6jhgf" event={"ID":"26add002-9ec1-4217-bc40-24b6f38fbd43","Type":"ContainerDied","Data":"9d9f02f2a05818c052e3afd09d198e379ed7501665f72edff8c7a3964bb49340"} Jul 07 18:31:14.770521 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.770474 2580 scope.go:117] "RemoveContainer" containerID="ab1b8f2ad6d9f5fbb5ab93b4407b96de7f79a5f85de89a522c3edd31cc07dcec" Jul 07 18:31:14.779940 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.779922 2580 scope.go:117] "RemoveContainer" containerID="ab1b8f2ad6d9f5fbb5ab93b4407b96de7f79a5f85de89a522c3edd31cc07dcec" Jul 07 18:31:14.780177 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:31:14.780159 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab1b8f2ad6d9f5fbb5ab93b4407b96de7f79a5f85de89a522c3edd31cc07dcec\": container with ID starting with ab1b8f2ad6d9f5fbb5ab93b4407b96de7f79a5f85de89a522c3edd31cc07dcec not found: ID does not exist" containerID="ab1b8f2ad6d9f5fbb5ab93b4407b96de7f79a5f85de89a522c3edd31cc07dcec" Jul 07 18:31:14.780224 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.780185 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab1b8f2ad6d9f5fbb5ab93b4407b96de7f79a5f85de89a522c3edd31cc07dcec"} err="failed to get container status \"ab1b8f2ad6d9f5fbb5ab93b4407b96de7f79a5f85de89a522c3edd31cc07dcec\": rpc error: code = NotFound desc = could not find container \"ab1b8f2ad6d9f5fbb5ab93b4407b96de7f79a5f85de89a522c3edd31cc07dcec\": container with ID starting with ab1b8f2ad6d9f5fbb5ab93b4407b96de7f79a5f85de89a522c3edd31cc07dcec not found: ID does not exist" Jul 07 18:31:14.792938 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.792918 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bb84f79f5-6jhgf"] Jul 07 18:31:14.798293 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:14.798269 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bb84f79f5-6jhgf"] Jul 07 18:31:16.191968 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:31:16.191933 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26add002-9ec1-4217-bc40-24b6f38fbd43" path="/var/lib/kubelet/pods/26add002-9ec1-4217-bc40-24b6f38fbd43/volumes" Jul 07 18:32:29.412008 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.411972 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-pl6hp"] Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412354 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c77b0fb7-91cd-4a06-8953-abe6b26f672b" containerName="util" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412366 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77b0fb7-91cd-4a06-8953-abe6b26f672b" containerName="util" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412381 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ea6da50-29b2-4b9b-ad99-73a77b297822" containerName="pull" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412389 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ea6da50-29b2-4b9b-ad99-73a77b297822" containerName="pull" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412400 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94989ca4-1abb-4930-9f08-49946987d363" containerName="extract" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412408 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="94989ca4-1abb-4930-9f08-49946987d363" containerName="extract" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412425 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94989ca4-1abb-4930-9f08-49946987d363" containerName="util" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412430 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="94989ca4-1abb-4930-9f08-49946987d363" containerName="util" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412439 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94989ca4-1abb-4930-9f08-49946987d363" containerName="pull" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412445 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="94989ca4-1abb-4930-9f08-49946987d363" containerName="pull" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412450 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c77b0fb7-91cd-4a06-8953-abe6b26f672b" containerName="extract" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412483 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77b0fb7-91cd-4a06-8953-abe6b26f672b" containerName="extract" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412493 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c77b0fb7-91cd-4a06-8953-abe6b26f672b" containerName="pull" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412498 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77b0fb7-91cd-4a06-8953-abe6b26f672b" containerName="pull" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412505 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f43c18f-bea7-43b8-94af-1aa0b7d79930" containerName="pull" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412511 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f43c18f-bea7-43b8-94af-1aa0b7d79930" containerName="pull" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412523 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26add002-9ec1-4217-bc40-24b6f38fbd43" containerName="console" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412528 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="26add002-9ec1-4217-bc40-24b6f38fbd43" containerName="console" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412533 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f43c18f-bea7-43b8-94af-1aa0b7d79930" containerName="extract" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412538 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f43c18f-bea7-43b8-94af-1aa0b7d79930" containerName="extract" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412546 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ea6da50-29b2-4b9b-ad99-73a77b297822" containerName="extract" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412551 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ea6da50-29b2-4b9b-ad99-73a77b297822" containerName="extract" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412559 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ea6da50-29b2-4b9b-ad99-73a77b297822" containerName="util" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412564 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ea6da50-29b2-4b9b-ad99-73a77b297822" containerName="util" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412572 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f43c18f-bea7-43b8-94af-1aa0b7d79930" containerName="util" Jul 07 18:32:29.412563 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412577 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f43c18f-bea7-43b8-94af-1aa0b7d79930" containerName="util" Jul 07 18:32:29.413556 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412640 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f43c18f-bea7-43b8-94af-1aa0b7d79930" containerName="extract" Jul 07 18:32:29.413556 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412648 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="94989ca4-1abb-4930-9f08-49946987d363" containerName="extract" Jul 07 18:32:29.413556 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412657 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ea6da50-29b2-4b9b-ad99-73a77b297822" containerName="extract" Jul 07 18:32:29.413556 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412662 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c77b0fb7-91cd-4a06-8953-abe6b26f672b" containerName="extract" Jul 07 18:32:29.413556 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.412669 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="26add002-9ec1-4217-bc40-24b6f38fbd43" containerName="console" Jul 07 18:32:29.418125 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.418096 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-pl6hp" Jul 07 18:32:29.421240 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.421214 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kc42q\"" Jul 07 18:32:29.421620 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.421599 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 07 18:32:29.427478 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.427436 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-pl6hp"] Jul 07 18:32:29.538388 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.538352 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw7nb\" (UniqueName: \"kubernetes.io/projected/41919352-adf0-4836-9497-a89718f54bde-kube-api-access-zw7nb\") pod \"postgres-69fb4594cf-pl6hp\" (UID: \"41919352-adf0-4836-9497-a89718f54bde\") " pod="opendatahub/postgres-69fb4594cf-pl6hp" Jul 07 18:32:29.538589 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.538397 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/41919352-adf0-4836-9497-a89718f54bde-data\") pod \"postgres-69fb4594cf-pl6hp\" (UID: \"41919352-adf0-4836-9497-a89718f54bde\") " pod="opendatahub/postgres-69fb4594cf-pl6hp" Jul 07 18:32:29.639467 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.639423 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw7nb\" (UniqueName: \"kubernetes.io/projected/41919352-adf0-4836-9497-a89718f54bde-kube-api-access-zw7nb\") pod \"postgres-69fb4594cf-pl6hp\" (UID: \"41919352-adf0-4836-9497-a89718f54bde\") " pod="opendatahub/postgres-69fb4594cf-pl6hp" Jul 07 18:32:29.639648 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.639497 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/41919352-adf0-4836-9497-a89718f54bde-data\") pod \"postgres-69fb4594cf-pl6hp\" (UID: \"41919352-adf0-4836-9497-a89718f54bde\") " pod="opendatahub/postgres-69fb4594cf-pl6hp" Jul 07 18:32:29.639886 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.639865 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/41919352-adf0-4836-9497-a89718f54bde-data\") pod \"postgres-69fb4594cf-pl6hp\" (UID: \"41919352-adf0-4836-9497-a89718f54bde\") " pod="opendatahub/postgres-69fb4594cf-pl6hp" Jul 07 18:32:29.651610 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.651588 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw7nb\" (UniqueName: \"kubernetes.io/projected/41919352-adf0-4836-9497-a89718f54bde-kube-api-access-zw7nb\") pod \"postgres-69fb4594cf-pl6hp\" (UID: \"41919352-adf0-4836-9497-a89718f54bde\") " pod="opendatahub/postgres-69fb4594cf-pl6hp" Jul 07 18:32:29.733865 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.733838 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-pl6hp" Jul 07 18:32:29.865955 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:29.865928 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-pl6hp"] Jul 07 18:32:29.867543 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:32:29.867517 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41919352_adf0_4836_9497_a89718f54bde.slice/crio-06fcf04cd73de0ac12fd04d140c7626a88bce53475b1bee768974e8d72650865 WatchSource:0}: Error finding container 06fcf04cd73de0ac12fd04d140c7626a88bce53475b1bee768974e8d72650865: Status 404 returned error can't find the container with id 06fcf04cd73de0ac12fd04d140c7626a88bce53475b1bee768974e8d72650865 Jul 07 18:32:30.176978 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:30.176899 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-pl6hp" event={"ID":"41919352-adf0-4836-9497-a89718f54bde","Type":"ContainerStarted","Data":"06fcf04cd73de0ac12fd04d140c7626a88bce53475b1bee768974e8d72650865"} Jul 07 18:32:39.239234 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:39.239190 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-pl6hp" event={"ID":"41919352-adf0-4836-9497-a89718f54bde","Type":"ContainerStarted","Data":"fd296123b03c8fa72aa1a9b5f11fcebf240badc991ebc8e9fb3575b95d1d34f0"} Jul 07 18:32:39.239731 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:39.239307 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-pl6hp" Jul 07 18:32:39.256518 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:39.256468 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-pl6hp" podStartSLOduration=1.5453258920000001 podStartE2EDuration="10.256443973s" totalImagesPullingTime="8.711118081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:32:39.253569544 +0000 UTC m=+600.384221568" watchObservedRunningTime="2026-07-07 18:32:39.256443973 +0000 UTC m=+600.387096041" Jul 07 18:32:40.090217 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:40.090188 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/2.log" Jul 07 18:32:40.090405 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:40.090332 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/2.log" Jul 07 18:32:40.094905 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:40.094882 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-skkmr_b7335728-d739-4c3d-877b-c1d860112c1a/ovn-acl-logging/0.log" Jul 07 18:32:40.095322 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:40.095308 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-skkmr_b7335728-d739-4c3d-877b-c1d860112c1a/ovn-acl-logging/0.log" Jul 07 18:32:45.274526 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:32:45.274497 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-pl6hp" Jul 07 18:33:29.642931 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:33:29.642886 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-j8zkr"] Jul 07 18:33:29.646560 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:33:29.646537 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-j8zkr" Jul 07 18:33:29.676355 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:33:29.676326 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 07 18:33:29.676526 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:33:29.676424 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5q9pl\"" Jul 07 18:33:29.697501 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:33:29.697448 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-j8zkr"] Jul 07 18:33:29.701251 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:33:29.701225 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bd0579e-ef68-47bb-a79f-dfc1665dd1cb-plugins-config-volume\") pod \"payload-pre-processing-7964457696-j8zkr\" (UID: \"7bd0579e-ef68-47bb-a79f-dfc1665dd1cb\") " pod="openshift-ingress/payload-pre-processing-7964457696-j8zkr" Jul 07 18:33:29.701394 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:33:29.701375 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skk6b\" (UniqueName: \"kubernetes.io/projected/7bd0579e-ef68-47bb-a79f-dfc1665dd1cb-kube-api-access-skk6b\") pod \"payload-pre-processing-7964457696-j8zkr\" (UID: \"7bd0579e-ef68-47bb-a79f-dfc1665dd1cb\") " pod="openshift-ingress/payload-pre-processing-7964457696-j8zkr" Jul 07 18:33:29.802704 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:33:29.802662 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bd0579e-ef68-47bb-a79f-dfc1665dd1cb-plugins-config-volume\") pod \"payload-pre-processing-7964457696-j8zkr\" (UID: \"7bd0579e-ef68-47bb-a79f-dfc1665dd1cb\") " pod="openshift-ingress/payload-pre-processing-7964457696-j8zkr" Jul 07 18:33:29.802887 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:33:29.802762 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skk6b\" (UniqueName: \"kubernetes.io/projected/7bd0579e-ef68-47bb-a79f-dfc1665dd1cb-kube-api-access-skk6b\") pod \"payload-pre-processing-7964457696-j8zkr\" (UID: \"7bd0579e-ef68-47bb-a79f-dfc1665dd1cb\") " pod="openshift-ingress/payload-pre-processing-7964457696-j8zkr" Jul 07 18:33:29.803387 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:33:29.803368 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bd0579e-ef68-47bb-a79f-dfc1665dd1cb-plugins-config-volume\") pod \"payload-pre-processing-7964457696-j8zkr\" (UID: \"7bd0579e-ef68-47bb-a79f-dfc1665dd1cb\") " pod="openshift-ingress/payload-pre-processing-7964457696-j8zkr" Jul 07 18:33:29.814579 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:33:29.814553 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skk6b\" (UniqueName: \"kubernetes.io/projected/7bd0579e-ef68-47bb-a79f-dfc1665dd1cb-kube-api-access-skk6b\") pod \"payload-pre-processing-7964457696-j8zkr\" (UID: \"7bd0579e-ef68-47bb-a79f-dfc1665dd1cb\") " pod="openshift-ingress/payload-pre-processing-7964457696-j8zkr" Jul 07 18:33:29.957536 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:33:29.957427 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-j8zkr" Jul 07 18:33:30.106433 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:33:30.106407 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-j8zkr"] Jul 07 18:33:30.108567 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:33:30.108544 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bd0579e_ef68_47bb_a79f_dfc1665dd1cb.slice/crio-f8acc724b22fd084d7c0c3cd91927fb8bd30b393121c64669b5a0f188cdc49fa WatchSource:0}: Error finding container f8acc724b22fd084d7c0c3cd91927fb8bd30b393121c64669b5a0f188cdc49fa: Status 404 returned error can't find the container with id f8acc724b22fd084d7c0c3cd91927fb8bd30b393121c64669b5a0f188cdc49fa Jul 07 18:33:30.110980 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:33:30.110965 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 18:33:30.519444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:33:30.519413 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-j8zkr" event={"ID":"7bd0579e-ef68-47bb-a79f-dfc1665dd1cb","Type":"ContainerStarted","Data":"f8acc724b22fd084d7c0c3cd91927fb8bd30b393121c64669b5a0f188cdc49fa"} Jul 07 18:33:32.534188 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:33:32.534154 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-j8zkr" event={"ID":"7bd0579e-ef68-47bb-a79f-dfc1665dd1cb","Type":"ContainerStarted","Data":"9672faf70e2725a4f4e15f518228688cd2504036903419719c52a2fcf543a5b3"} Jul 07 18:33:32.534632 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:33:32.534242 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-j8zkr" Jul 07 18:33:32.553960 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:33:32.553915 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-j8zkr" podStartSLOduration=2.12960628 podStartE2EDuration="3.553899615s" totalImagesPullingTime="1.424293335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:33:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:33:32.551787991 +0000 UTC m=+653.682440013" watchObservedRunningTime="2026-07-07 18:33:32.553899615 +0000 UTC m=+653.684551639" Jul 07 18:33:43.542149 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:33:43.542114 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-j8zkr" Jul 07 18:34:12.837547 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:12.837516 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7"] Jul 07 18:34:12.841988 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:12.841967 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:34:12.844925 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:12.844902 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 18:34:12.845505 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:12.845490 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8spls\"" Jul 07 18:34:12.845895 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:12.845878 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 07 18:34:12.846081 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:12.846067 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 18:34:12.864127 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:12.864105 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7"] Jul 07 18:34:12.901301 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:12.901273 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e3fcecf-b495-41be-ab95-a63208a94b29-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xrzd7\" (UID: \"9e3fcecf-b495-41be-ab95-a63208a94b29\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:34:12.901444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:12.901317 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e3fcecf-b495-41be-ab95-a63208a94b29-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xrzd7\" (UID: \"9e3fcecf-b495-41be-ab95-a63208a94b29\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:34:12.901444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:12.901393 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e3fcecf-b495-41be-ab95-a63208a94b29-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xrzd7\" (UID: \"9e3fcecf-b495-41be-ab95-a63208a94b29\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:34:12.901444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:12.901420 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e3fcecf-b495-41be-ab95-a63208a94b29-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xrzd7\" (UID: \"9e3fcecf-b495-41be-ab95-a63208a94b29\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:34:12.901444 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:12.901436 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e3fcecf-b495-41be-ab95-a63208a94b29-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xrzd7\" (UID: \"9e3fcecf-b495-41be-ab95-a63208a94b29\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:34:12.901637 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:12.901451 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw75v\" (UniqueName: \"kubernetes.io/projected/9e3fcecf-b495-41be-ab95-a63208a94b29-kube-api-access-qw75v\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xrzd7\" (UID: \"9e3fcecf-b495-41be-ab95-a63208a94b29\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:34:13.002647 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:13.002602 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e3fcecf-b495-41be-ab95-a63208a94b29-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xrzd7\" (UID: \"9e3fcecf-b495-41be-ab95-a63208a94b29\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:34:13.002647 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:13.002650 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e3fcecf-b495-41be-ab95-a63208a94b29-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xrzd7\" (UID: \"9e3fcecf-b495-41be-ab95-a63208a94b29\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:34:13.002901 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:13.002668 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e3fcecf-b495-41be-ab95-a63208a94b29-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xrzd7\" (UID: \"9e3fcecf-b495-41be-ab95-a63208a94b29\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:34:13.002901 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:13.002782 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw75v\" (UniqueName: \"kubernetes.io/projected/9e3fcecf-b495-41be-ab95-a63208a94b29-kube-api-access-qw75v\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xrzd7\" (UID: \"9e3fcecf-b495-41be-ab95-a63208a94b29\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:34:13.002901 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:13.002874 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e3fcecf-b495-41be-ab95-a63208a94b29-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xrzd7\" (UID: \"9e3fcecf-b495-41be-ab95-a63208a94b29\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:34:13.003077 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:13.002912 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e3fcecf-b495-41be-ab95-a63208a94b29-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xrzd7\" (UID: \"9e3fcecf-b495-41be-ab95-a63208a94b29\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:34:13.003077 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:13.003041 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e3fcecf-b495-41be-ab95-a63208a94b29-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xrzd7\" (UID: \"9e3fcecf-b495-41be-ab95-a63208a94b29\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:34:13.003304 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:13.003282 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e3fcecf-b495-41be-ab95-a63208a94b29-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xrzd7\" (UID: \"9e3fcecf-b495-41be-ab95-a63208a94b29\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:34:13.003362 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:13.003294 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e3fcecf-b495-41be-ab95-a63208a94b29-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xrzd7\" (UID: \"9e3fcecf-b495-41be-ab95-a63208a94b29\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:34:13.005442 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:13.005420 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e3fcecf-b495-41be-ab95-a63208a94b29-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xrzd7\" (UID: \"9e3fcecf-b495-41be-ab95-a63208a94b29\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:34:13.005748 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:13.005728 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e3fcecf-b495-41be-ab95-a63208a94b29-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xrzd7\" (UID: \"9e3fcecf-b495-41be-ab95-a63208a94b29\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:34:13.011482 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:13.011428 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw75v\" (UniqueName: \"kubernetes.io/projected/9e3fcecf-b495-41be-ab95-a63208a94b29-kube-api-access-qw75v\") pod \"e2e-trlp-test-simulated-kserve-598466548d-xrzd7\" (UID: \"9e3fcecf-b495-41be-ab95-a63208a94b29\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:34:13.152418 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:13.152328 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:34:13.285132 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:13.285094 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7"] Jul 07 18:34:13.286744 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:34:13.286713 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e3fcecf_b495_41be_ab95_a63208a94b29.slice/crio-37d6a28ed0489ee596dabf1067273f86b7ca87eb0409ebe40d5313274dece049 WatchSource:0}: Error finding container 37d6a28ed0489ee596dabf1067273f86b7ca87eb0409ebe40d5313274dece049: Status 404 returned error can't find the container with id 37d6a28ed0489ee596dabf1067273f86b7ca87eb0409ebe40d5313274dece049 Jul 07 18:34:13.758288 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:13.758236 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" event={"ID":"9e3fcecf-b495-41be-ab95-a63208a94b29","Type":"ContainerStarted","Data":"37d6a28ed0489ee596dabf1067273f86b7ca87eb0409ebe40d5313274dece049"} Jul 07 18:34:14.766343 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:14.766307 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" event={"ID":"9e3fcecf-b495-41be-ab95-a63208a94b29","Type":"ContainerStarted","Data":"03bf51cea8c6744ed64ca8ab3bf3978b1ebfe3f6066f11a239c12a0183a23de4"} Jul 07 18:34:14.786057 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:14.786003 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" podStartSLOduration=1.653115585 podStartE2EDuration="2.785988098s" totalImagesPullingTime="1.132872513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:34:14.784059273 +0000 UTC m=+695.914711298" watchObservedRunningTime="2026-07-07 18:34:14.785988098 +0000 UTC m=+695.916640141" Jul 07 18:34:23.152780 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:23.152745 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:34:23.153190 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:23.152798 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:34:23.165224 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:23.165202 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:34:23.832942 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:34:23.832859 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-xrzd7" Jul 07 18:37:40.127772 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:37:40.127689 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/2.log" Jul 07 18:37:40.129543 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:37:40.129517 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/2.log" Jul 07 18:37:40.133419 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:37:40.133400 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-skkmr_b7335728-d739-4c3d-877b-c1d860112c1a/ovn-acl-logging/0.log" Jul 07 18:37:40.134981 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:37:40.134966 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-skkmr_b7335728-d739-4c3d-877b-c1d860112c1a/ovn-acl-logging/0.log" Jul 07 18:42:40.164882 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:42:40.164800 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/2.log" Jul 07 18:42:40.168976 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:42:40.168953 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/2.log" Jul 07 18:42:40.169865 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:42:40.169850 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-skkmr_b7335728-d739-4c3d-877b-c1d860112c1a/ovn-acl-logging/0.log" Jul 07 18:42:40.173777 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:42:40.173762 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-skkmr_b7335728-d739-4c3d-877b-c1d860112c1a/ovn-acl-logging/0.log" Jul 07 18:45:00.158841 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:45:00.158808 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29724165-7jnzr"] Jul 07 18:45:00.162161 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:45:00.162146 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724165-7jnzr" Jul 07 18:45:00.164816 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:45:00.164801 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-4v97g\"" Jul 07 18:45:00.172499 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:45:00.172478 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724165-7jnzr"] Jul 07 18:45:00.287955 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:45:00.287875 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp4ln\" (UniqueName: \"kubernetes.io/projected/b38ac223-f206-4a0a-b81f-e1be0124b6f8-kube-api-access-dp4ln\") pod \"maas-api-key-cleanup-29724165-7jnzr\" (UID: \"b38ac223-f206-4a0a-b81f-e1be0124b6f8\") " pod="opendatahub/maas-api-key-cleanup-29724165-7jnzr" Jul 07 18:45:00.388803 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:45:00.388774 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp4ln\" (UniqueName: \"kubernetes.io/projected/b38ac223-f206-4a0a-b81f-e1be0124b6f8-kube-api-access-dp4ln\") pod \"maas-api-key-cleanup-29724165-7jnzr\" (UID: \"b38ac223-f206-4a0a-b81f-e1be0124b6f8\") " pod="opendatahub/maas-api-key-cleanup-29724165-7jnzr" Jul 07 18:45:00.398508 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:45:00.398479 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp4ln\" (UniqueName: \"kubernetes.io/projected/b38ac223-f206-4a0a-b81f-e1be0124b6f8-kube-api-access-dp4ln\") pod \"maas-api-key-cleanup-29724165-7jnzr\" (UID: \"b38ac223-f206-4a0a-b81f-e1be0124b6f8\") " pod="opendatahub/maas-api-key-cleanup-29724165-7jnzr" Jul 07 18:45:00.473250 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:45:00.473182 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724165-7jnzr" Jul 07 18:45:00.610649 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:45:00.610626 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724165-7jnzr"] Jul 07 18:45:00.612848 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:45:00.612820 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb38ac223_f206_4a0a_b81f_e1be0124b6f8.slice/crio-16269977bcd3846da4d19d0d1b782d68f3ef551c3fe130c129d77d2005471759 WatchSource:0}: Error finding container 16269977bcd3846da4d19d0d1b782d68f3ef551c3fe130c129d77d2005471759: Status 404 returned error can't find the container with id 16269977bcd3846da4d19d0d1b782d68f3ef551c3fe130c129d77d2005471759 Jul 07 18:45:00.614720 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:45:00.614703 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 18:45:01.259048 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:45:01.259013 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724165-7jnzr" event={"ID":"b38ac223-f206-4a0a-b81f-e1be0124b6f8","Type":"ContainerStarted","Data":"16269977bcd3846da4d19d0d1b782d68f3ef551c3fe130c129d77d2005471759"} Jul 07 18:45:03.272639 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:45:03.272609 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724165-7jnzr" event={"ID":"b38ac223-f206-4a0a-b81f-e1be0124b6f8","Type":"ContainerStarted","Data":"643772b2b168ae9cd3364ae046357977e680fde0ac7b3c0bccf6d16c61bdbc09"} Jul 07 18:45:03.293553 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:45:03.293510 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29724165-7jnzr" podStartSLOduration=0.959429969 podStartE2EDuration="3.29349512s" totalImagesPullingTime="2.334065151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:45:03.291042717 +0000 UTC m=+1344.421694743" watchObservedRunningTime="2026-07-07 18:45:03.29349512 +0000 UTC m=+1344.424147142" Jul 07 18:45:04.279624 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:45:04.279590 2580 generic.go:356] "Generic (PLEG): container finished" podID="b38ac223-f206-4a0a-b81f-e1be0124b6f8" containerID="643772b2b168ae9cd3364ae046357977e680fde0ac7b3c0bccf6d16c61bdbc09" exitCode=0 Jul 07 18:45:04.280023 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:45:04.279676 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724165-7jnzr" event={"ID":"b38ac223-f206-4a0a-b81f-e1be0124b6f8","Type":"ContainerDied","Data":"643772b2b168ae9cd3364ae046357977e680fde0ac7b3c0bccf6d16c61bdbc09"} Jul 07 18:45:05.413213 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:45:05.413191 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724165-7jnzr" Jul 07 18:45:05.532380 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:45:05.532356 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dp4ln\" (UniqueName: \"kubernetes.io/projected/b38ac223-f206-4a0a-b81f-e1be0124b6f8-kube-api-access-dp4ln\") pod \"b38ac223-f206-4a0a-b81f-e1be0124b6f8\" (UID: \"b38ac223-f206-4a0a-b81f-e1be0124b6f8\") " Jul 07 18:45:05.534495 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:45:05.534445 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b38ac223-f206-4a0a-b81f-e1be0124b6f8-kube-api-access-dp4ln" (OuterVolumeSpecName: "kube-api-access-dp4ln") pod "b38ac223-f206-4a0a-b81f-e1be0124b6f8" (UID: "b38ac223-f206-4a0a-b81f-e1be0124b6f8"). InnerVolumeSpecName "kube-api-access-dp4ln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:45:05.633478 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:45:05.633432 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dp4ln\" (UniqueName: \"kubernetes.io/projected/b38ac223-f206-4a0a-b81f-e1be0124b6f8-kube-api-access-dp4ln\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:45:06.292224 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:45:06.292188 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724165-7jnzr" event={"ID":"b38ac223-f206-4a0a-b81f-e1be0124b6f8","Type":"ContainerDied","Data":"16269977bcd3846da4d19d0d1b782d68f3ef551c3fe130c129d77d2005471759"} Jul 07 18:45:06.292224 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:45:06.292214 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724165-7jnzr" Jul 07 18:45:06.292435 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:45:06.292251 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="16269977bcd3846da4d19d0d1b782d68f3ef551c3fe130c129d77d2005471759" Jul 07 18:47:40.203296 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:47:40.203262 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/2.log" Jul 07 18:47:40.208148 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:47:40.208128 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-skkmr_b7335728-d739-4c3d-877b-c1d860112c1a/ovn-acl-logging/0.log" Jul 07 18:47:40.208532 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:47:40.208514 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/2.log" Jul 07 18:47:40.213209 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:47:40.213193 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-skkmr_b7335728-d739-4c3d-877b-c1d860112c1a/ovn-acl-logging/0.log" Jul 07 18:50:05.973061 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:05.973024 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp"] Jul 07 18:50:05.978040 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:05.976088 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b38ac223-f206-4a0a-b81f-e1be0124b6f8" containerName="cleanup" Jul 07 18:50:05.978040 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:05.976113 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b38ac223-f206-4a0a-b81f-e1be0124b6f8" containerName="cleanup" Jul 07 18:50:05.978040 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:05.976330 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b38ac223-f206-4a0a-b81f-e1be0124b6f8" containerName="cleanup" Jul 07 18:50:05.980467 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:05.980434 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:05.989483 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:05.989468 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f6d70e44-openshift-default-dockercfg-zx6j2\"" Jul 07 18:50:06.004212 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.004185 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp"] Jul 07 18:50:06.068951 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.068920 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/226f95b1-633c-41e2-b6fa-bebacf4957fc-istiod-ca-cert\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.069123 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.068972 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-podinfo\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.069123 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.068991 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-data\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.069123 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.069009 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-credential-socket\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.069123 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.069042 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-envoy\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.069123 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.069072 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbmxc\" (UniqueName: \"kubernetes.io/projected/226f95b1-633c-41e2-b6fa-bebacf4957fc-kube-api-access-jbmxc\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.069123 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.069095 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-workload-certs\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.069123 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.069109 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-token\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.069393 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.069132 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-workload-socket\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.170346 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.170311 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-envoy\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.170542 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.170357 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbmxc\" (UniqueName: \"kubernetes.io/projected/226f95b1-633c-41e2-b6fa-bebacf4957fc-kube-api-access-jbmxc\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.170542 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.170501 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-workload-certs\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.170542 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.170537 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-token\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.170745 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.170582 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-workload-socket\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.170796 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.170739 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/226f95b1-633c-41e2-b6fa-bebacf4957fc-istiod-ca-cert\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.170834 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.170822 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-podinfo\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.170878 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.170852 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-data\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.170917 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.170886 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-credential-socket\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.170917 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.170904 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-workload-certs\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.171011 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.170922 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-workload-socket\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.171189 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.171173 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-data\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.171236 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.171210 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-credential-socket\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.171450 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.171432 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/226f95b1-633c-41e2-b6fa-bebacf4957fc-istiod-ca-cert\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.172667 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.172646 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-envoy\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.173117 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.173099 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-podinfo\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.181279 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.181257 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-token\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.181508 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.181484 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbmxc\" (UniqueName: \"kubernetes.io/projected/226f95b1-633c-41e2-b6fa-bebacf4957fc-kube-api-access-jbmxc\") pod \"e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.290675 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.290646 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:06.454841 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.454817 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp"] Jul 07 18:50:06.458492 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:50:06.456642 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod226f95b1_633c_41e2_b6fa_bebacf4957fc.slice/crio-ee8fe9b026c67709d3c2b13a00c94d5ad208ccfcec781f6952860e549f66fd71 WatchSource:0}: Error finding container ee8fe9b026c67709d3c2b13a00c94d5ad208ccfcec781f6952860e549f66fd71: Status 404 returned error can't find the container with id ee8fe9b026c67709d3c2b13a00c94d5ad208ccfcec781f6952860e549f66fd71 Jul 07 18:50:06.461735 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.461700 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:50:06.461835 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.461768 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:50:06.461835 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.461799 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:50:06.933173 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.933123 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" event={"ID":"226f95b1-633c-41e2-b6fa-bebacf4957fc","Type":"ContainerStarted","Data":"3490d595e75be4a1b772be47727ec6bcf5c0578c125d3c7aa5677a4062c2526f"} Jul 07 18:50:06.933353 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.933196 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" event={"ID":"226f95b1-633c-41e2-b6fa-bebacf4957fc","Type":"ContainerStarted","Data":"ee8fe9b026c67709d3c2b13a00c94d5ad208ccfcec781f6952860e549f66fd71"} Jul 07 18:50:06.982475 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:06.982394 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" podStartSLOduration=1.982379487 podStartE2EDuration="1.982379487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:06.981506893 +0000 UTC m=+1648.112158919" watchObservedRunningTime="2026-07-07 18:50:06.982379487 +0000 UTC m=+1648.113031509" Jul 07 18:50:07.291760 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:07.291735 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:07.296718 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:07.296695 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:07.938780 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:07.938739 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:07.939615 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:07.939594 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:18.635297 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:18.635261 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp"] Jul 07 18:50:18.635743 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:18.635516 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" podUID="226f95b1-633c-41e2-b6fa-bebacf4957fc" containerName="istio-proxy" containerID="cri-o://3490d595e75be4a1b772be47727ec6bcf5c0578c125d3c7aa5677a4062c2526f" gracePeriod=30 Jul 07 18:50:19.891763 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:19.891737 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:20.009285 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.009254 2580 generic.go:356] "Generic (PLEG): container finished" podID="226f95b1-633c-41e2-b6fa-bebacf4957fc" containerID="3490d595e75be4a1b772be47727ec6bcf5c0578c125d3c7aa5677a4062c2526f" exitCode=0 Jul 07 18:50:20.009451 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.009310 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" Jul 07 18:50:20.009451 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.009325 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" event={"ID":"226f95b1-633c-41e2-b6fa-bebacf4957fc","Type":"ContainerDied","Data":"3490d595e75be4a1b772be47727ec6bcf5c0578c125d3c7aa5677a4062c2526f"} Jul 07 18:50:20.009451 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.009388 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp" event={"ID":"226f95b1-633c-41e2-b6fa-bebacf4957fc","Type":"ContainerDied","Data":"ee8fe9b026c67709d3c2b13a00c94d5ad208ccfcec781f6952860e549f66fd71"} Jul 07 18:50:20.009451 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.009409 2580 scope.go:117] "RemoveContainer" containerID="3490d595e75be4a1b772be47727ec6bcf5c0578c125d3c7aa5677a4062c2526f" Jul 07 18:50:20.015950 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.015927 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-workload-certs\") pod \"226f95b1-633c-41e2-b6fa-bebacf4957fc\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " Jul 07 18:50:20.016065 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.015974 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbmxc\" (UniqueName: \"kubernetes.io/projected/226f95b1-633c-41e2-b6fa-bebacf4957fc-kube-api-access-jbmxc\") pod \"226f95b1-633c-41e2-b6fa-bebacf4957fc\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " Jul 07 18:50:20.016065 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.016012 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/226f95b1-633c-41e2-b6fa-bebacf4957fc-istiod-ca-cert\") pod \"226f95b1-633c-41e2-b6fa-bebacf4957fc\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " Jul 07 18:50:20.016170 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.016065 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-token\") pod \"226f95b1-633c-41e2-b6fa-bebacf4957fc\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " Jul 07 18:50:20.016170 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.016118 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-credential-socket\") pod \"226f95b1-633c-41e2-b6fa-bebacf4957fc\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " Jul 07 18:50:20.016170 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.016148 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-podinfo\") pod \"226f95b1-633c-41e2-b6fa-bebacf4957fc\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " Jul 07 18:50:20.016331 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.016176 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-workload-socket\") pod \"226f95b1-633c-41e2-b6fa-bebacf4957fc\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " Jul 07 18:50:20.016331 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.016192 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "226f95b1-633c-41e2-b6fa-bebacf4957fc" (UID: "226f95b1-633c-41e2-b6fa-bebacf4957fc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:50:20.016331 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.016207 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-data\") pod \"226f95b1-633c-41e2-b6fa-bebacf4957fc\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " Jul 07 18:50:20.016331 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.016249 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-envoy\") pod \"226f95b1-633c-41e2-b6fa-bebacf4957fc\" (UID: \"226f95b1-633c-41e2-b6fa-bebacf4957fc\") " Jul 07 18:50:20.016557 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.016475 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/226f95b1-633c-41e2-b6fa-bebacf4957fc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "226f95b1-633c-41e2-b6fa-bebacf4957fc" (UID: "226f95b1-633c-41e2-b6fa-bebacf4957fc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:50:20.016807 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.016758 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "226f95b1-633c-41e2-b6fa-bebacf4957fc" (UID: "226f95b1-633c-41e2-b6fa-bebacf4957fc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:50:20.016972 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.016829 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "226f95b1-633c-41e2-b6fa-bebacf4957fc" (UID: "226f95b1-633c-41e2-b6fa-bebacf4957fc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:50:20.016972 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.016811 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-workload-certs\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:50:20.017133 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.016991 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/226f95b1-633c-41e2-b6fa-bebacf4957fc-istiod-ca-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:50:20.017133 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.017060 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-data" (OuterVolumeSpecName: "istio-data") pod "226f95b1-633c-41e2-b6fa-bebacf4957fc" (UID: "226f95b1-633c-41e2-b6fa-bebacf4957fc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:50:20.018624 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.018603 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "226f95b1-633c-41e2-b6fa-bebacf4957fc" (UID: "226f95b1-633c-41e2-b6fa-bebacf4957fc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:50:20.018722 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.018628 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-token" (OuterVolumeSpecName: "istio-token") pod "226f95b1-633c-41e2-b6fa-bebacf4957fc" (UID: "226f95b1-633c-41e2-b6fa-bebacf4957fc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:50:20.018775 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.018712 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "226f95b1-633c-41e2-b6fa-bebacf4957fc" (UID: "226f95b1-633c-41e2-b6fa-bebacf4957fc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 18:50:20.018775 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.018715 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/226f95b1-633c-41e2-b6fa-bebacf4957fc-kube-api-access-jbmxc" (OuterVolumeSpecName: "kube-api-access-jbmxc") pod "226f95b1-633c-41e2-b6fa-bebacf4957fc" (UID: "226f95b1-633c-41e2-b6fa-bebacf4957fc"). InnerVolumeSpecName "kube-api-access-jbmxc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:50:20.019233 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.019217 2580 scope.go:117] "RemoveContainer" containerID="3490d595e75be4a1b772be47727ec6bcf5c0578c125d3c7aa5677a4062c2526f" Jul 07 18:50:20.019533 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:50:20.019508 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3490d595e75be4a1b772be47727ec6bcf5c0578c125d3c7aa5677a4062c2526f\": container with ID starting with 3490d595e75be4a1b772be47727ec6bcf5c0578c125d3c7aa5677a4062c2526f not found: ID does not exist" containerID="3490d595e75be4a1b772be47727ec6bcf5c0578c125d3c7aa5677a4062c2526f" Jul 07 18:50:20.019604 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.019544 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3490d595e75be4a1b772be47727ec6bcf5c0578c125d3c7aa5677a4062c2526f"} err="failed to get container status \"3490d595e75be4a1b772be47727ec6bcf5c0578c125d3c7aa5677a4062c2526f\": rpc error: code = NotFound desc = could not find container \"3490d595e75be4a1b772be47727ec6bcf5c0578c125d3c7aa5677a4062c2526f\": container with ID starting with 3490d595e75be4a1b772be47727ec6bcf5c0578c125d3c7aa5677a4062c2526f not found: ID does not exist" Jul 07 18:50:20.118383 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.118348 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-podinfo\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:50:20.118383 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.118375 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-workload-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:50:20.118383 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.118386 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-data\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:50:20.118647 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.118394 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-envoy\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:50:20.118647 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.118403 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbmxc\" (UniqueName: \"kubernetes.io/projected/226f95b1-633c-41e2-b6fa-bebacf4957fc-kube-api-access-jbmxc\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:50:20.118647 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.118411 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/226f95b1-633c-41e2-b6fa-bebacf4957fc-istio-token\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:50:20.118647 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.118419 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/226f95b1-633c-41e2-b6fa-bebacf4957fc-credential-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:50:20.328352 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.328323 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp"] Jul 07 18:50:20.333385 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:20.333360 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f6d70e44-openshift-default-6994b5cf6c-d9nvp"] Jul 07 18:50:22.191612 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:50:22.191580 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="226f95b1-633c-41e2-b6fa-bebacf4957fc" path="/var/lib/kubelet/pods/226f95b1-633c-41e2-b6fa-bebacf4957fc/volumes" Jul 07 18:52:40.239750 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:52:40.239723 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/2.log" Jul 07 18:52:40.244358 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:52:40.244331 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-skkmr_b7335728-d739-4c3d-877b-c1d860112c1a/ovn-acl-logging/0.log" Jul 07 18:52:40.247868 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:52:40.247849 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/2.log" Jul 07 18:52:40.252670 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:52:40.252654 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-skkmr_b7335728-d739-4c3d-877b-c1d860112c1a/ovn-acl-logging/0.log" Jul 07 18:56:16.714204 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.714172 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x"] Jul 07 18:56:16.714685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.714612 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="226f95b1-633c-41e2-b6fa-bebacf4957fc" containerName="istio-proxy" Jul 07 18:56:16.714685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.714624 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="226f95b1-633c-41e2-b6fa-bebacf4957fc" containerName="istio-proxy" Jul 07 18:56:16.714685 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.714682 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="226f95b1-633c-41e2-b6fa-bebacf4957fc" containerName="istio-proxy" Jul 07 18:56:16.717662 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.717646 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.721446 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.721428 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-c5164d-openshift-default-dockercfg-247j9\"" Jul 07 18:56:16.732865 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.732843 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x"] Jul 07 18:56:16.836183 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.836148 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxphk\" (UniqueName: \"kubernetes.io/projected/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-kube-api-access-fxphk\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.836183 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.836188 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-workload-socket\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.836399 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.836211 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-token\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.836399 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.836296 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-envoy\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.836399 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.836329 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-podinfo\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.836399 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.836349 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-workload-certs\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.836567 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.836436 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-data\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.836567 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.836490 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istiod-ca-cert\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.836567 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.836517 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-credential-socket\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.937220 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.937183 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxphk\" (UniqueName: \"kubernetes.io/projected/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-kube-api-access-fxphk\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.937220 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.937224 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-workload-socket\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.937443 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.937399 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-token\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.937537 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.937471 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-envoy\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.937537 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.937516 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-podinfo\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.937642 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.937544 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-workload-certs\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.937703 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.937686 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-data\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.937758 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.937713 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istiod-ca-cert\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.937758 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.937688 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-workload-socket\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.937758 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.937750 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-credential-socket\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.937948 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.937868 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-workload-certs\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.937948 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.937919 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-data\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.938087 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.938067 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-credential-socket\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.938521 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.938499 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istiod-ca-cert\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.939817 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.939788 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-envoy\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.939954 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.939934 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-podinfo\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.946732 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.946712 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-token\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:16.946859 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:16.946837 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxphk\" (UniqueName: \"kubernetes.io/projected/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-kube-api-access-fxphk\") pod \"e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:17.028122 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:17.028084 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:17.218973 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:17.218946 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x"] Jul 07 18:56:17.220859 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:56:17.220830 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2b6bb5d_b27f_4258_a3e3_d66e2fd00f82.slice/crio-4031bab53d38bbe5ac5aeb0d52756b005c2c9415c8d11c7e8ecd67fe92060a02 WatchSource:0}: Error finding container 4031bab53d38bbe5ac5aeb0d52756b005c2c9415c8d11c7e8ecd67fe92060a02: Status 404 returned error can't find the container with id 4031bab53d38bbe5ac5aeb0d52756b005c2c9415c8d11c7e8ecd67fe92060a02 Jul 07 18:56:17.223125 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:17.223089 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:56:17.223221 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:17.223169 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:56:17.223221 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:17.223214 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:56:18.012891 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:18.012856 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" event={"ID":"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82","Type":"ContainerStarted","Data":"93471fa39142ca76c819edb2d2bb30985b9e627f5208d7edf87b4dfd82dbbc4c"} Jul 07 18:56:18.013299 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:18.012917 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" event={"ID":"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82","Type":"ContainerStarted","Data":"4031bab53d38bbe5ac5aeb0d52756b005c2c9415c8d11c7e8ecd67fe92060a02"} Jul 07 18:56:18.028638 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:18.028609 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:18.033408 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:18.033385 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:18.047613 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:18.047564 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" podStartSLOduration=2.047548756 podStartE2EDuration="2.047548756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:56:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:56:18.046335064 +0000 UTC m=+2019.176987090" watchObservedRunningTime="2026-07-07 18:56:18.047548756 +0000 UTC m=+2019.178200781" Jul 07 18:56:19.018314 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:19.018285 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:19.019277 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:19.019258 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:32.101630 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:32.101545 2580 generic.go:356] "Generic (PLEG): container finished" podID="d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" containerID="93471fa39142ca76c819edb2d2bb30985b9e627f5208d7edf87b4dfd82dbbc4c" exitCode=0 Jul 07 18:56:32.102029 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:32.101618 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" event={"ID":"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82","Type":"ContainerDied","Data":"93471fa39142ca76c819edb2d2bb30985b9e627f5208d7edf87b4dfd82dbbc4c"} Jul 07 18:56:32.102029 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:32.102019 2580 scope.go:117] "RemoveContainer" containerID="93471fa39142ca76c819edb2d2bb30985b9e627f5208d7edf87b4dfd82dbbc4c" Jul 07 18:56:32.103011 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:32.102985 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:56:32.103058 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:32.103047 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:56:32.103094 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:32.103082 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:56:33.110887 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:33.110850 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" event={"ID":"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82","Type":"ContainerStarted","Data":"7c7c0a59d8c1339a1f730fca3ea89659c0020fc5fdab8d9ffd7e87f681ce3891"} Jul 07 18:56:34.018359 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:34.018320 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:34.028885 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:34.028839 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:34.029883 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:34.029843 2580 patch_prober.go:28] interesting pod/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 07 18:56:34.030027 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:34.029906 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" podUID="d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 07 18:56:35.028848 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:35.028802 2580 patch_prober.go:28] interesting pod/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 07 18:56:35.029371 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:35.028870 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" podUID="d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 07 18:56:36.028942 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:36.028897 2580 patch_prober.go:28] interesting pod/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 07 18:56:36.029438 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:36.028965 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" podUID="d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 07 18:56:37.029485 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:37.029398 2580 patch_prober.go:28] interesting pod/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 07 18:56:37.030075 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:37.029498 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" podUID="d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 07 18:56:38.032977 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:38.032941 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:56:38.033951 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:56:38.033934 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:57:40.280592 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:57:40.280562 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/2.log" Jul 07 18:57:40.288522 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:57:40.288498 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-skkmr_b7335728-d739-4c3d-877b-c1d860112c1a/ovn-acl-logging/0.log" Jul 07 18:57:40.293005 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:57:40.292985 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/2.log" Jul 07 18:57:40.297818 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:57:40.297798 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-skkmr_b7335728-d739-4c3d-877b-c1d860112c1a/ovn-acl-logging/0.log" Jul 07 18:58:33.466007 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:33.465917 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x"] Jul 07 18:58:33.466526 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:33.466141 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" podUID="d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" containerName="istio-proxy" containerID="cri-o://7c7c0a59d8c1339a1f730fca3ea89659c0020fc5fdab8d9ffd7e87f681ce3891" gracePeriod=30 Jul 07 18:58:38.035441 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.035404 2580 patch_prober.go:28] interesting pod/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 18:58:38.035925 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.035492 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" podUID="d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 18:58:38.722026 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.722001 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:58:38.835887 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.835855 2580 generic.go:356] "Generic (PLEG): container finished" podID="d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" containerID="7c7c0a59d8c1339a1f730fca3ea89659c0020fc5fdab8d9ffd7e87f681ce3891" exitCode=0 Jul 07 18:58:38.836070 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.835902 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" Jul 07 18:58:38.836070 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.835914 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" event={"ID":"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82","Type":"ContainerDied","Data":"7c7c0a59d8c1339a1f730fca3ea89659c0020fc5fdab8d9ffd7e87f681ce3891"} Jul 07 18:58:38.836070 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.835955 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x" event={"ID":"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82","Type":"ContainerDied","Data":"4031bab53d38bbe5ac5aeb0d52756b005c2c9415c8d11c7e8ecd67fe92060a02"} Jul 07 18:58:38.836070 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.835976 2580 scope.go:117] "RemoveContainer" containerID="7c7c0a59d8c1339a1f730fca3ea89659c0020fc5fdab8d9ffd7e87f681ce3891" Jul 07 18:58:38.843241 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.843218 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-credential-socket\") pod \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " Jul 07 18:58:38.843354 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.843251 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-data\") pod \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " Jul 07 18:58:38.843354 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.843282 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istiod-ca-cert\") pod \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " Jul 07 18:58:38.843354 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.843313 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-envoy\") pod \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " Jul 07 18:58:38.843354 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.843338 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-token\") pod \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " Jul 07 18:58:38.843574 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.843370 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-workload-socket\") pod \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " Jul 07 18:58:38.843574 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.843437 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-workload-certs\") pod \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " Jul 07 18:58:38.843574 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.843484 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-podinfo\") pod \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " Jul 07 18:58:38.843574 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.843533 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxphk\" (UniqueName: \"kubernetes.io/projected/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-kube-api-access-fxphk\") pod \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\" (UID: \"d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82\") " Jul 07 18:58:38.843574 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.843544 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" (UID: "d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:58:38.843820 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.843705 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" (UID: "d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:58:38.844127 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.844009 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" (UID: "d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:58:38.844127 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.844090 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" (UID: "d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:58:38.844127 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.844105 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istiod-ca-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:58:38.844127 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.844125 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-credential-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:58:38.844384 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.844147 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-data" (OuterVolumeSpecName: "istio-data") pod "d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" (UID: "d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:58:38.845853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.845779 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-token" (OuterVolumeSpecName: "istio-token") pod "d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" (UID: "d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:58:38.845853 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.845832 2580 scope.go:117] "RemoveContainer" containerID="93471fa39142ca76c819edb2d2bb30985b9e627f5208d7edf87b4dfd82dbbc4c" Jul 07 18:58:38.846015 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.845885 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-kube-api-access-fxphk" (OuterVolumeSpecName: "kube-api-access-fxphk") pod "d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" (UID: "d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82"). InnerVolumeSpecName "kube-api-access-fxphk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:58:38.846015 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.845893 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" (UID: "d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:58:38.846293 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.846275 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" (UID: "d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 18:58:38.868289 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.868254 2580 scope.go:117] "RemoveContainer" containerID="7c7c0a59d8c1339a1f730fca3ea89659c0020fc5fdab8d9ffd7e87f681ce3891" Jul 07 18:58:38.868674 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:58:38.868645 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c7c0a59d8c1339a1f730fca3ea89659c0020fc5fdab8d9ffd7e87f681ce3891\": container with ID starting with 7c7c0a59d8c1339a1f730fca3ea89659c0020fc5fdab8d9ffd7e87f681ce3891 not found: ID does not exist" containerID="7c7c0a59d8c1339a1f730fca3ea89659c0020fc5fdab8d9ffd7e87f681ce3891" Jul 07 18:58:38.868776 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.868685 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c7c0a59d8c1339a1f730fca3ea89659c0020fc5fdab8d9ffd7e87f681ce3891"} err="failed to get container status \"7c7c0a59d8c1339a1f730fca3ea89659c0020fc5fdab8d9ffd7e87f681ce3891\": rpc error: code = NotFound desc = could not find container \"7c7c0a59d8c1339a1f730fca3ea89659c0020fc5fdab8d9ffd7e87f681ce3891\": container with ID starting with 7c7c0a59d8c1339a1f730fca3ea89659c0020fc5fdab8d9ffd7e87f681ce3891 not found: ID does not exist" Jul 07 18:58:38.868776 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.868710 2580 scope.go:117] "RemoveContainer" containerID="93471fa39142ca76c819edb2d2bb30985b9e627f5208d7edf87b4dfd82dbbc4c" Jul 07 18:58:38.869004 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:58:38.868983 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93471fa39142ca76c819edb2d2bb30985b9e627f5208d7edf87b4dfd82dbbc4c\": container with ID starting with 93471fa39142ca76c819edb2d2bb30985b9e627f5208d7edf87b4dfd82dbbc4c not found: ID does not exist" containerID="93471fa39142ca76c819edb2d2bb30985b9e627f5208d7edf87b4dfd82dbbc4c" Jul 07 18:58:38.869057 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.869010 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93471fa39142ca76c819edb2d2bb30985b9e627f5208d7edf87b4dfd82dbbc4c"} err="failed to get container status \"93471fa39142ca76c819edb2d2bb30985b9e627f5208d7edf87b4dfd82dbbc4c\": rpc error: code = NotFound desc = could not find container \"93471fa39142ca76c819edb2d2bb30985b9e627f5208d7edf87b4dfd82dbbc4c\": container with ID starting with 93471fa39142ca76c819edb2d2bb30985b9e627f5208d7edf87b4dfd82dbbc4c not found: ID does not exist" Jul 07 18:58:38.944964 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.944927 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-envoy\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:58:38.944964 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.944957 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-token\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:58:38.944964 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.944968 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-workload-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:58:38.945213 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.944977 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-workload-certs\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:58:38.945213 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.944985 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-podinfo\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:58:38.945213 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.944994 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxphk\" (UniqueName: \"kubernetes.io/projected/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-kube-api-access-fxphk\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:58:38.945213 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:38.945005 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82-istio-data\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:58:39.170289 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:39.170254 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x"] Jul 07 18:58:39.182844 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:39.182814 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-c5164d-openshift-default-c4788475c-rc47x"] Jul 07 18:58:40.195057 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:40.195011 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" path="/var/lib/kubelet/pods/d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82/volumes" Jul 07 18:58:42.994609 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:42.994568 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v"] Jul 07 18:58:42.994989 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:42.994968 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" containerName="istio-proxy" Jul 07 18:58:42.994989 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:42.994980 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" containerName="istio-proxy" Jul 07 18:58:42.994989 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:42.994988 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" containerName="istio-proxy" Jul 07 18:58:42.995098 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:42.994994 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" containerName="istio-proxy" Jul 07 18:58:42.995098 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:42.995060 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" containerName="istio-proxy" Jul 07 18:58:42.995098 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:42.995068 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2b6bb5d-b27f-4258-a3e3-d66e2fd00f82" containerName="istio-proxy" Jul 07 18:58:42.997968 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:42.997951 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.001574 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.001549 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-90d474-openshift-default-dockercfg-lhtd7\"" Jul 07 18:58:43.023904 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.023867 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v"] Jul 07 18:58:43.082174 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.082141 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-istio-data\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.082344 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.082188 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1598f283-ee8c-47cb-9825-8612fcd80021-istio-podinfo\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.082344 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.082276 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-istio-envoy\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.082344 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.082329 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-workload-socket\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.082478 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.082365 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1598f283-ee8c-47cb-9825-8612fcd80021-istiod-ca-cert\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.082478 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.082401 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-credential-socket\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.082478 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.082442 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48c5x\" (UniqueName: \"kubernetes.io/projected/1598f283-ee8c-47cb-9825-8612fcd80021-kube-api-access-48c5x\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.082478 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.082474 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-workload-certs\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.082612 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.082534 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1598f283-ee8c-47cb-9825-8612fcd80021-istio-token\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.183010 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.182978 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-istio-data\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.183197 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.183030 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1598f283-ee8c-47cb-9825-8612fcd80021-istio-podinfo\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.183197 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.183061 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-istio-envoy\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.183197 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.183093 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-workload-socket\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.183197 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.183115 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1598f283-ee8c-47cb-9825-8612fcd80021-istiod-ca-cert\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.183197 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.183134 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-credential-socket\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.183197 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.183163 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48c5x\" (UniqueName: \"kubernetes.io/projected/1598f283-ee8c-47cb-9825-8612fcd80021-kube-api-access-48c5x\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.183567 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.183436 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-istio-data\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.183567 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.183513 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-workload-certs\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.183567 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.183516 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-workload-socket\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.183725 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.183568 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1598f283-ee8c-47cb-9825-8612fcd80021-istio-token\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.183725 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.183649 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-credential-socket\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.183837 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.183764 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-workload-certs\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.183960 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.183933 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1598f283-ee8c-47cb-9825-8612fcd80021-istiod-ca-cert\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.185595 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.185574 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-istio-envoy\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.185745 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.185729 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1598f283-ee8c-47cb-9825-8612fcd80021-istio-podinfo\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.197434 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.197412 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1598f283-ee8c-47cb-9825-8612fcd80021-istio-token\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.197735 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.197710 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48c5x\" (UniqueName: \"kubernetes.io/projected/1598f283-ee8c-47cb-9825-8612fcd80021-kube-api-access-48c5x\") pod \"e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.308612 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.308529 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:43.463036 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.463011 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v"] Jul 07 18:58:43.463752 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:58:43.463728 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1598f283_ee8c_47cb_9825_8612fcd80021.slice/crio-ed9a6535815dfb8ae248f4e50c29f506c03f05ee341bb60eca90ec2c1579791e WatchSource:0}: Error finding container ed9a6535815dfb8ae248f4e50c29f506c03f05ee341bb60eca90ec2c1579791e: Status 404 returned error can't find the container with id ed9a6535815dfb8ae248f4e50c29f506c03f05ee341bb60eca90ec2c1579791e Jul 07 18:58:43.465922 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.465892 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:58:43.465993 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.465955 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:58:43.465993 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.465983 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:58:43.866847 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.866817 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" event={"ID":"1598f283-ee8c-47cb-9825-8612fcd80021","Type":"ContainerStarted","Data":"827685f18f29e5149f669f82baf8e4a1774d81d8ee45ef6c8c8f57033e8fbc1f"} Jul 07 18:58:43.867041 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:43.866868 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" event={"ID":"1598f283-ee8c-47cb-9825-8612fcd80021","Type":"ContainerStarted","Data":"ed9a6535815dfb8ae248f4e50c29f506c03f05ee341bb60eca90ec2c1579791e"} Jul 07 18:58:44.309258 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:44.309219 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:44.314048 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:44.314024 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:44.370757 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:44.370705 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" podStartSLOduration=2.370687067 podStartE2EDuration="2.370687067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:58:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:58:43.924616263 +0000 UTC m=+2165.055268285" watchObservedRunningTime="2026-07-07 18:58:44.370687067 +0000 UTC m=+2165.501339090" Jul 07 18:58:44.872812 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:44.872780 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:58:44.873877 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:58:44.873861 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:59:00.913637 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:00.913591 2580 patch_prober.go:28] interesting pod/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 07 18:59:00.914123 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:00.913668 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" podUID="1598f283-ee8c-47cb-9825-8612fcd80021" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 07 18:59:01.981347 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:01.981317 2580 generic.go:356] "Generic (PLEG): container finished" podID="1598f283-ee8c-47cb-9825-8612fcd80021" containerID="827685f18f29e5149f669f82baf8e4a1774d81d8ee45ef6c8c8f57033e8fbc1f" exitCode=0 Jul 07 18:59:01.981813 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:01.981391 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" event={"ID":"1598f283-ee8c-47cb-9825-8612fcd80021","Type":"ContainerDied","Data":"827685f18f29e5149f669f82baf8e4a1774d81d8ee45ef6c8c8f57033e8fbc1f"} Jul 07 18:59:01.981935 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:01.981919 2580 scope.go:117] "RemoveContainer" containerID="827685f18f29e5149f669f82baf8e4a1774d81d8ee45ef6c8c8f57033e8fbc1f" Jul 07 18:59:01.983012 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:01.982986 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:59:01.983076 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:01.983054 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:59:01.983110 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:01.983086 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:59:02.989341 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:02.989311 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" event={"ID":"1598f283-ee8c-47cb-9825-8612fcd80021","Type":"ContainerStarted","Data":"2427043aaa4bf679a78b80819ada7f2afa0a95bc310970ef6df9262ab196045d"} Jul 07 18:59:03.309139 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:03.309061 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:59:03.309291 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:03.309235 2580 patch_prober.go:28] interesting pod/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 07 18:59:03.309291 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:03.309277 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" podUID="1598f283-ee8c-47cb-9825-8612fcd80021" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 07 18:59:04.309467 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:04.309423 2580 patch_prober.go:28] interesting pod/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 07 18:59:04.309964 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:04.309539 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" podUID="1598f283-ee8c-47cb-9825-8612fcd80021" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 07 18:59:05.309579 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:05.309540 2580 patch_prober.go:28] interesting pod/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 07 18:59:05.310044 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:05.309620 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" podUID="1598f283-ee8c-47cb-9825-8612fcd80021" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 07 18:59:06.309854 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:06.309819 2580 patch_prober.go:28] interesting pod/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 07 18:59:06.310239 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:06.309877 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" podUID="1598f283-ee8c-47cb-9825-8612fcd80021" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 07 18:59:07.313107 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:07.313078 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:59:07.313502 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:07.313408 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:59:07.314265 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:07.314248 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:59:14.813991 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:14.813953 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v"] Jul 07 18:59:14.814373 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:14.814174 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" podUID="1598f283-ee8c-47cb-9825-8612fcd80021" containerName="istio-proxy" containerID="cri-o://2427043aaa4bf679a78b80819ada7f2afa0a95bc310970ef6df9262ab196045d" gracePeriod=30 Jul 07 18:59:20.072196 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.072172 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:59:20.092725 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.092654 2580 generic.go:356] "Generic (PLEG): container finished" podID="1598f283-ee8c-47cb-9825-8612fcd80021" containerID="2427043aaa4bf679a78b80819ada7f2afa0a95bc310970ef6df9262ab196045d" exitCode=0 Jul 07 18:59:20.092725 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.092700 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" Jul 07 18:59:20.092909 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.092735 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" event={"ID":"1598f283-ee8c-47cb-9825-8612fcd80021","Type":"ContainerDied","Data":"2427043aaa4bf679a78b80819ada7f2afa0a95bc310970ef6df9262ab196045d"} Jul 07 18:59:20.092909 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.092790 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v" event={"ID":"1598f283-ee8c-47cb-9825-8612fcd80021","Type":"ContainerDied","Data":"ed9a6535815dfb8ae248f4e50c29f506c03f05ee341bb60eca90ec2c1579791e"} Jul 07 18:59:20.092909 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.092817 2580 scope.go:117] "RemoveContainer" containerID="2427043aaa4bf679a78b80819ada7f2afa0a95bc310970ef6df9262ab196045d" Jul 07 18:59:20.102400 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.102381 2580 scope.go:117] "RemoveContainer" containerID="827685f18f29e5149f669f82baf8e4a1774d81d8ee45ef6c8c8f57033e8fbc1f" Jul 07 18:59:20.111828 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.111809 2580 scope.go:117] "RemoveContainer" containerID="2427043aaa4bf679a78b80819ada7f2afa0a95bc310970ef6df9262ab196045d" Jul 07 18:59:20.112086 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:59:20.112064 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2427043aaa4bf679a78b80819ada7f2afa0a95bc310970ef6df9262ab196045d\": container with ID starting with 2427043aaa4bf679a78b80819ada7f2afa0a95bc310970ef6df9262ab196045d not found: ID does not exist" containerID="2427043aaa4bf679a78b80819ada7f2afa0a95bc310970ef6df9262ab196045d" Jul 07 18:59:20.112132 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.112097 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2427043aaa4bf679a78b80819ada7f2afa0a95bc310970ef6df9262ab196045d"} err="failed to get container status \"2427043aaa4bf679a78b80819ada7f2afa0a95bc310970ef6df9262ab196045d\": rpc error: code = NotFound desc = could not find container \"2427043aaa4bf679a78b80819ada7f2afa0a95bc310970ef6df9262ab196045d\": container with ID starting with 2427043aaa4bf679a78b80819ada7f2afa0a95bc310970ef6df9262ab196045d not found: ID does not exist" Jul 07 18:59:20.112132 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.112114 2580 scope.go:117] "RemoveContainer" containerID="827685f18f29e5149f669f82baf8e4a1774d81d8ee45ef6c8c8f57033e8fbc1f" Jul 07 18:59:20.112343 ip-10-0-141-187 kubenswrapper[2580]: E0707 18:59:20.112329 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"827685f18f29e5149f669f82baf8e4a1774d81d8ee45ef6c8c8f57033e8fbc1f\": container with ID starting with 827685f18f29e5149f669f82baf8e4a1774d81d8ee45ef6c8c8f57033e8fbc1f not found: ID does not exist" containerID="827685f18f29e5149f669f82baf8e4a1774d81d8ee45ef6c8c8f57033e8fbc1f" Jul 07 18:59:20.112401 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.112346 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"827685f18f29e5149f669f82baf8e4a1774d81d8ee45ef6c8c8f57033e8fbc1f"} err="failed to get container status \"827685f18f29e5149f669f82baf8e4a1774d81d8ee45ef6c8c8f57033e8fbc1f\": rpc error: code = NotFound desc = could not find container \"827685f18f29e5149f669f82baf8e4a1774d81d8ee45ef6c8c8f57033e8fbc1f\": container with ID starting with 827685f18f29e5149f669f82baf8e4a1774d81d8ee45ef6c8c8f57033e8fbc1f not found: ID does not exist" Jul 07 18:59:20.151209 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.151175 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1598f283-ee8c-47cb-9825-8612fcd80021-istiod-ca-cert\") pod \"1598f283-ee8c-47cb-9825-8612fcd80021\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " Jul 07 18:59:20.151209 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.151214 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-istio-envoy\") pod \"1598f283-ee8c-47cb-9825-8612fcd80021\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " Jul 07 18:59:20.151405 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.151238 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1598f283-ee8c-47cb-9825-8612fcd80021-istio-podinfo\") pod \"1598f283-ee8c-47cb-9825-8612fcd80021\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " Jul 07 18:59:20.151405 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.151270 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48c5x\" (UniqueName: \"kubernetes.io/projected/1598f283-ee8c-47cb-9825-8612fcd80021-kube-api-access-48c5x\") pod \"1598f283-ee8c-47cb-9825-8612fcd80021\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " Jul 07 18:59:20.151405 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.151312 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-workload-socket\") pod \"1598f283-ee8c-47cb-9825-8612fcd80021\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " Jul 07 18:59:20.151405 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.151350 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-workload-certs\") pod \"1598f283-ee8c-47cb-9825-8612fcd80021\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " Jul 07 18:59:20.151713 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.151414 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-istio-data\") pod \"1598f283-ee8c-47cb-9825-8612fcd80021\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " Jul 07 18:59:20.151713 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.151449 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-credential-socket\") pod \"1598f283-ee8c-47cb-9825-8612fcd80021\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " Jul 07 18:59:20.151713 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.151531 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1598f283-ee8c-47cb-9825-8612fcd80021-istio-token\") pod \"1598f283-ee8c-47cb-9825-8612fcd80021\" (UID: \"1598f283-ee8c-47cb-9825-8612fcd80021\") " Jul 07 18:59:20.151713 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.151670 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1598f283-ee8c-47cb-9825-8612fcd80021" (UID: "1598f283-ee8c-47cb-9825-8612fcd80021"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:59:20.151713 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.151685 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1598f283-ee8c-47cb-9825-8612fcd80021" (UID: "1598f283-ee8c-47cb-9825-8612fcd80021"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:59:20.151951 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.151697 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1598f283-ee8c-47cb-9825-8612fcd80021-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1598f283-ee8c-47cb-9825-8612fcd80021" (UID: "1598f283-ee8c-47cb-9825-8612fcd80021"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 18:59:20.151951 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.151887 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1598f283-ee8c-47cb-9825-8612fcd80021" (UID: "1598f283-ee8c-47cb-9825-8612fcd80021"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:59:20.152060 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.151968 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-credential-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:59:20.152060 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.151989 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1598f283-ee8c-47cb-9825-8612fcd80021-istiod-ca-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:59:20.152060 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.152004 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-workload-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:59:20.152060 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.152017 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-workload-certs\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:59:20.152641 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.152616 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-istio-data" (OuterVolumeSpecName: "istio-data") pod "1598f283-ee8c-47cb-9825-8612fcd80021" (UID: "1598f283-ee8c-47cb-9825-8612fcd80021"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:59:20.153586 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.153559 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1598f283-ee8c-47cb-9825-8612fcd80021-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1598f283-ee8c-47cb-9825-8612fcd80021" (UID: "1598f283-ee8c-47cb-9825-8612fcd80021"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 18:59:20.153862 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.153833 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1598f283-ee8c-47cb-9825-8612fcd80021-istio-token" (OuterVolumeSpecName: "istio-token") pod "1598f283-ee8c-47cb-9825-8612fcd80021" (UID: "1598f283-ee8c-47cb-9825-8612fcd80021"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:59:20.153968 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.153912 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1598f283-ee8c-47cb-9825-8612fcd80021" (UID: "1598f283-ee8c-47cb-9825-8612fcd80021"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 18:59:20.153968 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.153915 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1598f283-ee8c-47cb-9825-8612fcd80021-kube-api-access-48c5x" (OuterVolumeSpecName: "kube-api-access-48c5x") pod "1598f283-ee8c-47cb-9825-8612fcd80021" (UID: "1598f283-ee8c-47cb-9825-8612fcd80021"). InnerVolumeSpecName "kube-api-access-48c5x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:59:20.252653 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.252625 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1598f283-ee8c-47cb-9825-8612fcd80021-istio-podinfo\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:59:20.252653 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.252649 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48c5x\" (UniqueName: \"kubernetes.io/projected/1598f283-ee8c-47cb-9825-8612fcd80021-kube-api-access-48c5x\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:59:20.252653 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.252659 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-istio-data\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:59:20.252873 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.252667 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1598f283-ee8c-47cb-9825-8612fcd80021-istio-token\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:59:20.252873 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.252674 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1598f283-ee8c-47cb-9825-8612fcd80021-istio-envoy\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 18:59:20.416726 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.416644 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v"] Jul 07 18:59:20.420268 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:20.420242 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-90d474-openshift-default-6ffdf54d4f-txt5v"] Jul 07 18:59:22.191858 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:22.191820 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1598f283-ee8c-47cb-9825-8612fcd80021" path="/var/lib/kubelet/pods/1598f283-ee8c-47cb-9825-8612fcd80021/volumes" Jul 07 18:59:24.064385 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.064342 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h"] Jul 07 18:59:24.064940 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.064920 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1598f283-ee8c-47cb-9825-8612fcd80021" containerName="istio-proxy" Jul 07 18:59:24.065023 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.064943 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1598f283-ee8c-47cb-9825-8612fcd80021" containerName="istio-proxy" Jul 07 18:59:24.065097 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.065085 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1598f283-ee8c-47cb-9825-8612fcd80021" containerName="istio-proxy" Jul 07 18:59:24.065159 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.065102 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1598f283-ee8c-47cb-9825-8612fcd80021" containerName="istio-proxy" Jul 07 18:59:24.068275 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.068252 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.070972 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.070944 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-e7285b-openshift-default-dockercfg-5drvs\"" Jul 07 18:59:24.084643 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.084621 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h"] Jul 07 18:59:24.191655 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.191616 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-workload-certs\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.191842 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.191674 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w968\" (UniqueName: \"kubernetes.io/projected/24b8d8a2-d800-4f77-afda-74744c288928-kube-api-access-5w968\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.191842 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.191803 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-istio-envoy\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.191936 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.191851 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-workload-socket\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.191936 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.191876 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24b8d8a2-d800-4f77-afda-74744c288928-istio-token\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.191936 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.191900 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24b8d8a2-d800-4f77-afda-74744c288928-istio-podinfo\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.192084 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.191933 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-istio-data\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.192084 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.192022 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24b8d8a2-d800-4f77-afda-74744c288928-istiod-ca-cert\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.192180 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.192088 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-credential-socket\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.293235 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.293202 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-credential-socket\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.293430 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.293245 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-workload-certs\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.293430 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.293269 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w968\" (UniqueName: \"kubernetes.io/projected/24b8d8a2-d800-4f77-afda-74744c288928-kube-api-access-5w968\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.293582 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.293500 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-istio-envoy\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.293640 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.293581 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-workload-socket\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.293640 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.293618 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24b8d8a2-d800-4f77-afda-74744c288928-istio-token\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.293753 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.293651 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24b8d8a2-d800-4f77-afda-74744c288928-istio-podinfo\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.293753 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.293689 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-istio-data\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.293753 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.293725 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24b8d8a2-d800-4f77-afda-74744c288928-istiod-ca-cert\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.293753 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.293728 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-workload-certs\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.293962 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.293902 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-workload-socket\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.294102 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.294076 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-istio-data\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.294276 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.294163 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-credential-socket\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.294507 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.294484 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24b8d8a2-d800-4f77-afda-74744c288928-istiod-ca-cert\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.296360 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.296332 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-istio-envoy\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.296790 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.296770 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24b8d8a2-d800-4f77-afda-74744c288928-istio-podinfo\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.315632 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.315563 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24b8d8a2-d800-4f77-afda-74744c288928-istio-token\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.315632 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.315572 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w968\" (UniqueName: \"kubernetes.io/projected/24b8d8a2-d800-4f77-afda-74744c288928-kube-api-access-5w968\") pod \"e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.378309 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.378277 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:24.517078 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.517050 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h"] Jul 07 18:59:24.518335 ip-10-0-141-187 kubenswrapper[2580]: W0707 18:59:24.518303 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b8d8a2_d800_4f77_afda_74744c288928.slice/crio-510ca6bfd1e67f3301beaa27bcd8740d80cbe8ff795585fe3b60ee781a643109 WatchSource:0}: Error finding container 510ca6bfd1e67f3301beaa27bcd8740d80cbe8ff795585fe3b60ee781a643109: Status 404 returned error can't find the container with id 510ca6bfd1e67f3301beaa27bcd8740d80cbe8ff795585fe3b60ee781a643109 Jul 07 18:59:24.520531 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.520498 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:59:24.520602 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.520574 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:59:24.520637 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:24.520602 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:59:25.128887 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:25.128850 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" event={"ID":"24b8d8a2-d800-4f77-afda-74744c288928","Type":"ContainerStarted","Data":"67085523609d983da0866f1281dffe394214b6e3c7798e485019a348bdcf9f69"} Jul 07 18:59:25.129400 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:25.128911 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" event={"ID":"24b8d8a2-d800-4f77-afda-74744c288928","Type":"ContainerStarted","Data":"510ca6bfd1e67f3301beaa27bcd8740d80cbe8ff795585fe3b60ee781a643109"} Jul 07 18:59:25.154981 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:25.154912 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" podStartSLOduration=1.154890435 podStartE2EDuration="1.154890435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:59:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:59:25.154420256 +0000 UTC m=+2206.285072279" watchObservedRunningTime="2026-07-07 18:59:25.154890435 +0000 UTC m=+2206.285542458" Jul 07 18:59:25.378496 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:25.378435 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:25.384815 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:25.384744 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:26.134703 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:26.134672 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:26.135574 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:26.135554 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:39.210276 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:39.210244 2580 generic.go:356] "Generic (PLEG): container finished" podID="24b8d8a2-d800-4f77-afda-74744c288928" containerID="67085523609d983da0866f1281dffe394214b6e3c7798e485019a348bdcf9f69" exitCode=0 Jul 07 18:59:39.210737 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:39.210285 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" event={"ID":"24b8d8a2-d800-4f77-afda-74744c288928","Type":"ContainerDied","Data":"67085523609d983da0866f1281dffe394214b6e3c7798e485019a348bdcf9f69"} Jul 07 18:59:39.210737 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:39.210654 2580 scope.go:117] "RemoveContainer" containerID="67085523609d983da0866f1281dffe394214b6e3c7798e485019a348bdcf9f69" Jul 07 18:59:39.211675 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:39.211643 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:59:39.211800 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:39.211725 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:59:39.211800 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:39.211787 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 07 18:59:40.218302 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:40.218267 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" event={"ID":"24b8d8a2-d800-4f77-afda-74744c288928","Type":"ContainerStarted","Data":"3a2112af52a2353168f5a0410af228a7bd94023849922946b21ccf9e539cd053"} Jul 07 18:59:40.378592 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:40.378561 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:40.379768 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:40.379744 2580 patch_prober.go:28] interesting pod/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 07 18:59:40.379864 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:40.379807 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" podUID="24b8d8a2-d800-4f77-afda-74744c288928" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 07 18:59:41.134763 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:41.134714 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:41.379666 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:41.379629 2580 patch_prober.go:28] interesting pod/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 07 18:59:41.380067 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:41.379686 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" podUID="24b8d8a2-d800-4f77-afda-74744c288928" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 07 18:59:42.379059 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:42.379030 2580 patch_prober.go:28] interesting pod/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 07 18:59:42.379233 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:42.379086 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" podUID="24b8d8a2-d800-4f77-afda-74744c288928" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 07 18:59:43.379088 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:43.379051 2580 patch_prober.go:28] interesting pod/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 07 18:59:43.379505 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:43.379105 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" podUID="24b8d8a2-d800-4f77-afda-74744c288928" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 07 18:59:44.382532 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:44.382506 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 18:59:44.383606 ip-10-0-141-187 kubenswrapper[2580]: I0707 18:59:44.383587 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 19:00:00.160521 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.160484 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-e7285b-29724180-gfwvp"] Jul 07 19:00:00.160974 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.160944 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1598f283-ee8c-47cb-9825-8612fcd80021" containerName="istio-proxy" Jul 07 19:00:00.160974 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.160968 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1598f283-ee8c-47cb-9825-8612fcd80021" containerName="istio-proxy" Jul 07 19:00:00.163346 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.163328 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-e7285b-29724180-gfwvp" Jul 07 19:00:00.163997 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.163978 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29724180-psxpf"] Jul 07 19:00:00.166296 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.166276 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724180-psxpf" Jul 07 19:00:00.166740 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.166721 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-4v97g\"" Jul 07 19:00:00.168858 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.168836 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-972159-29724180-4z7rz"] Jul 07 19:00:00.171374 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.171354 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-972159-29724180-4z7rz" Jul 07 19:00:00.180873 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.180854 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-e7285b-29724180-gfwvp"] Jul 07 19:00:00.184533 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.184510 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724180-psxpf"] Jul 07 19:00:00.196370 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.196348 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-972159-29724180-4z7rz"] Jul 07 19:00:00.222842 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.222817 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7kns\" (UniqueName: \"kubernetes.io/projected/994b4048-1673-4a75-bc1c-c56668a0f3fe-kube-api-access-p7kns\") pod \"maas-api-key-cleanup-e2e-shared-b-e7285b-29724180-gfwvp\" (UID: \"994b4048-1673-4a75-bc1c-c56668a0f3fe\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-e7285b-29724180-gfwvp" Jul 07 19:00:00.324042 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.323960 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmhl6\" (UniqueName: \"kubernetes.io/projected/c0b1cfd2-38d4-4260-bbf3-7e35d1797a4c-kube-api-access-nmhl6\") pod \"maas-api-key-cleanup-29724180-psxpf\" (UID: \"c0b1cfd2-38d4-4260-bbf3-7e35d1797a4c\") " pod="opendatahub/maas-api-key-cleanup-29724180-psxpf" Jul 07 19:00:00.324208 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.324102 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7kns\" (UniqueName: \"kubernetes.io/projected/994b4048-1673-4a75-bc1c-c56668a0f3fe-kube-api-access-p7kns\") pod \"maas-api-key-cleanup-e2e-shared-b-e7285b-29724180-gfwvp\" (UID: \"994b4048-1673-4a75-bc1c-c56668a0f3fe\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-e7285b-29724180-gfwvp" Jul 07 19:00:00.324375 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.324356 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b59jw\" (UniqueName: \"kubernetes.io/projected/0e4730ab-a648-4a09-919b-3bd732a6e68f-kube-api-access-b59jw\") pod \"maas-api-key-cleanup-e2e-shared-a-972159-29724180-4z7rz\" (UID: \"0e4730ab-a648-4a09-919b-3bd732a6e68f\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-972159-29724180-4z7rz" Jul 07 19:00:00.334071 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.334046 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7kns\" (UniqueName: \"kubernetes.io/projected/994b4048-1673-4a75-bc1c-c56668a0f3fe-kube-api-access-p7kns\") pod \"maas-api-key-cleanup-e2e-shared-b-e7285b-29724180-gfwvp\" (UID: \"994b4048-1673-4a75-bc1c-c56668a0f3fe\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-e7285b-29724180-gfwvp" Jul 07 19:00:00.425396 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.425307 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b59jw\" (UniqueName: \"kubernetes.io/projected/0e4730ab-a648-4a09-919b-3bd732a6e68f-kube-api-access-b59jw\") pod \"maas-api-key-cleanup-e2e-shared-a-972159-29724180-4z7rz\" (UID: \"0e4730ab-a648-4a09-919b-3bd732a6e68f\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-972159-29724180-4z7rz" Jul 07 19:00:00.425396 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.425374 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmhl6\" (UniqueName: \"kubernetes.io/projected/c0b1cfd2-38d4-4260-bbf3-7e35d1797a4c-kube-api-access-nmhl6\") pod \"maas-api-key-cleanup-29724180-psxpf\" (UID: \"c0b1cfd2-38d4-4260-bbf3-7e35d1797a4c\") " pod="opendatahub/maas-api-key-cleanup-29724180-psxpf" Jul 07 19:00:00.435039 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.435009 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmhl6\" (UniqueName: \"kubernetes.io/projected/c0b1cfd2-38d4-4260-bbf3-7e35d1797a4c-kube-api-access-nmhl6\") pod \"maas-api-key-cleanup-29724180-psxpf\" (UID: \"c0b1cfd2-38d4-4260-bbf3-7e35d1797a4c\") " pod="opendatahub/maas-api-key-cleanup-29724180-psxpf" Jul 07 19:00:00.435153 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.435123 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b59jw\" (UniqueName: \"kubernetes.io/projected/0e4730ab-a648-4a09-919b-3bd732a6e68f-kube-api-access-b59jw\") pod \"maas-api-key-cleanup-e2e-shared-a-972159-29724180-4z7rz\" (UID: \"0e4730ab-a648-4a09-919b-3bd732a6e68f\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-972159-29724180-4z7rz" Jul 07 19:00:00.474068 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.474039 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-e7285b-29724180-gfwvp" Jul 07 19:00:00.484597 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.484577 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724180-psxpf" Jul 07 19:00:00.494294 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.492997 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-972159-29724180-4z7rz" Jul 07 19:00:00.641892 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.641864 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-e7285b-29724180-gfwvp"] Jul 07 19:00:00.643336 ip-10-0-141-187 kubenswrapper[2580]: W0707 19:00:00.643310 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod994b4048_1673_4a75_bc1c_c56668a0f3fe.slice/crio-2faba3ba2b0bfe2c4f3c9442c6ac57a6f5251061f036c5389b2013cf2896d8a4 WatchSource:0}: Error finding container 2faba3ba2b0bfe2c4f3c9442c6ac57a6f5251061f036c5389b2013cf2896d8a4: Status 404 returned error can't find the container with id 2faba3ba2b0bfe2c4f3c9442c6ac57a6f5251061f036c5389b2013cf2896d8a4 Jul 07 19:00:00.867580 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.867554 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-972159-29724180-4z7rz"] Jul 07 19:00:00.869055 ip-10-0-141-187 kubenswrapper[2580]: W0707 19:00:00.869026 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e4730ab_a648_4a09_919b_3bd732a6e68f.slice/crio-27591d40edd2e8d6ce6f0b50e90fac038282350644f5be454f949ce22ccd9faf WatchSource:0}: Error finding container 27591d40edd2e8d6ce6f0b50e90fac038282350644f5be454f949ce22ccd9faf: Status 404 returned error can't find the container with id 27591d40edd2e8d6ce6f0b50e90fac038282350644f5be454f949ce22ccd9faf Jul 07 19:00:00.872512 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:00.872489 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724180-psxpf"] Jul 07 19:00:00.873579 ip-10-0-141-187 kubenswrapper[2580]: W0707 19:00:00.873557 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b1cfd2_38d4_4260_bbf3_7e35d1797a4c.slice/crio-3fa08eb51d5330e275e91321cc61bdc2768fdcdb03661c29b8746de95d1b76ad WatchSource:0}: Error finding container 3fa08eb51d5330e275e91321cc61bdc2768fdcdb03661c29b8746de95d1b76ad: Status 404 returned error can't find the container with id 3fa08eb51d5330e275e91321cc61bdc2768fdcdb03661c29b8746de95d1b76ad Jul 07 19:00:01.341634 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:01.341593 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724180-psxpf" event={"ID":"c0b1cfd2-38d4-4260-bbf3-7e35d1797a4c","Type":"ContainerStarted","Data":"a0e0f6a8c8ea38831c50e8160e5dfb2fa90895043679d375d19b1785ce6b1574"} Jul 07 19:00:01.342048 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:01.341679 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724180-psxpf" event={"ID":"c0b1cfd2-38d4-4260-bbf3-7e35d1797a4c","Type":"ContainerStarted","Data":"3fa08eb51d5330e275e91321cc61bdc2768fdcdb03661c29b8746de95d1b76ad"} Jul 07 19:00:01.343340 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:01.343313 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-e7285b-29724180-gfwvp" event={"ID":"994b4048-1673-4a75-bc1c-c56668a0f3fe","Type":"ContainerStarted","Data":"3b4dfd8fa5316685ef95bc8ca35c483385372c48803c7b9826f9bdba278d7892"} Jul 07 19:00:01.343447 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:01.343360 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-e7285b-29724180-gfwvp" event={"ID":"994b4048-1673-4a75-bc1c-c56668a0f3fe","Type":"ContainerStarted","Data":"2faba3ba2b0bfe2c4f3c9442c6ac57a6f5251061f036c5389b2013cf2896d8a4"} Jul 07 19:00:01.344845 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:01.344821 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-972159-29724180-4z7rz" event={"ID":"0e4730ab-a648-4a09-919b-3bd732a6e68f","Type":"ContainerStarted","Data":"ad53a5aae549eb63fe51b37fb9e41fb285d739ccd71323d9c9e45b95b91d7b37"} Jul 07 19:00:01.344948 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:01.344859 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-972159-29724180-4z7rz" event={"ID":"0e4730ab-a648-4a09-919b-3bd732a6e68f","Type":"ContainerStarted","Data":"27591d40edd2e8d6ce6f0b50e90fac038282350644f5be454f949ce22ccd9faf"} Jul 07 19:00:01.368407 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:01.368360 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29724180-psxpf" podStartSLOduration=1.3683480829999999 podStartE2EDuration="1.368348083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:00:01.36532975 +0000 UTC m=+2242.495981791" watchObservedRunningTime="2026-07-07 19:00:01.368348083 +0000 UTC m=+2242.499000150" Jul 07 19:00:01.384316 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:01.384265 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-e7285b-29724180-gfwvp" podStartSLOduration=1.3842499529999999 podStartE2EDuration="1.384249953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:00:01.383324397 +0000 UTC m=+2242.513976420" watchObservedRunningTime="2026-07-07 19:00:01.384249953 +0000 UTC m=+2242.514901978" Jul 07 19:00:01.402046 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:01.402005 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-972159-29724180-4z7rz" podStartSLOduration=1.40199207 podStartE2EDuration="1.40199207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:00:01.401284412 +0000 UTC m=+2242.531936436" watchObservedRunningTime="2026-07-07 19:00:01.40199207 +0000 UTC m=+2242.532644116" Jul 07 19:00:02.352112 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:02.352080 2580 generic.go:356] "Generic (PLEG): container finished" podID="c0b1cfd2-38d4-4260-bbf3-7e35d1797a4c" containerID="a0e0f6a8c8ea38831c50e8160e5dfb2fa90895043679d375d19b1785ce6b1574" exitCode=0 Jul 07 19:00:02.352565 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:02.352167 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724180-psxpf" event={"ID":"c0b1cfd2-38d4-4260-bbf3-7e35d1797a4c","Type":"ContainerDied","Data":"a0e0f6a8c8ea38831c50e8160e5dfb2fa90895043679d375d19b1785ce6b1574"} Jul 07 19:00:02.353984 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:02.353959 2580 generic.go:356] "Generic (PLEG): container finished" podID="994b4048-1673-4a75-bc1c-c56668a0f3fe" containerID="3b4dfd8fa5316685ef95bc8ca35c483385372c48803c7b9826f9bdba278d7892" exitCode=0 Jul 07 19:00:02.354105 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:02.354011 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-e7285b-29724180-gfwvp" event={"ID":"994b4048-1673-4a75-bc1c-c56668a0f3fe","Type":"ContainerDied","Data":"3b4dfd8fa5316685ef95bc8ca35c483385372c48803c7b9826f9bdba278d7892"} Jul 07 19:00:02.355595 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:02.355574 2580 generic.go:356] "Generic (PLEG): container finished" podID="0e4730ab-a648-4a09-919b-3bd732a6e68f" containerID="ad53a5aae549eb63fe51b37fb9e41fb285d739ccd71323d9c9e45b95b91d7b37" exitCode=0 Jul 07 19:00:02.355702 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:02.355656 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-972159-29724180-4z7rz" event={"ID":"0e4730ab-a648-4a09-919b-3bd732a6e68f","Type":"ContainerDied","Data":"ad53a5aae549eb63fe51b37fb9e41fb285d739ccd71323d9c9e45b95b91d7b37"} Jul 07 19:00:03.507838 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:03.507811 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-e7285b-29724180-gfwvp" Jul 07 19:00:03.543631 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:03.543604 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724180-psxpf" Jul 07 19:00:03.547634 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:03.547615 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-972159-29724180-4z7rz" Jul 07 19:00:03.657637 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:03.657549 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7kns\" (UniqueName: \"kubernetes.io/projected/994b4048-1673-4a75-bc1c-c56668a0f3fe-kube-api-access-p7kns\") pod \"994b4048-1673-4a75-bc1c-c56668a0f3fe\" (UID: \"994b4048-1673-4a75-bc1c-c56668a0f3fe\") " Jul 07 19:00:03.657637 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:03.657603 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b59jw\" (UniqueName: \"kubernetes.io/projected/0e4730ab-a648-4a09-919b-3bd732a6e68f-kube-api-access-b59jw\") pod \"0e4730ab-a648-4a09-919b-3bd732a6e68f\" (UID: \"0e4730ab-a648-4a09-919b-3bd732a6e68f\") " Jul 07 19:00:03.657854 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:03.657695 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmhl6\" (UniqueName: \"kubernetes.io/projected/c0b1cfd2-38d4-4260-bbf3-7e35d1797a4c-kube-api-access-nmhl6\") pod \"c0b1cfd2-38d4-4260-bbf3-7e35d1797a4c\" (UID: \"c0b1cfd2-38d4-4260-bbf3-7e35d1797a4c\") " Jul 07 19:00:03.659852 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:03.659827 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0b1cfd2-38d4-4260-bbf3-7e35d1797a4c-kube-api-access-nmhl6" (OuterVolumeSpecName: "kube-api-access-nmhl6") pod "c0b1cfd2-38d4-4260-bbf3-7e35d1797a4c" (UID: "c0b1cfd2-38d4-4260-bbf3-7e35d1797a4c"). InnerVolumeSpecName "kube-api-access-nmhl6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:00:03.659979 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:03.659867 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e4730ab-a648-4a09-919b-3bd732a6e68f-kube-api-access-b59jw" (OuterVolumeSpecName: "kube-api-access-b59jw") pod "0e4730ab-a648-4a09-919b-3bd732a6e68f" (UID: "0e4730ab-a648-4a09-919b-3bd732a6e68f"). InnerVolumeSpecName "kube-api-access-b59jw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:00:03.659979 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:03.659886 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/994b4048-1673-4a75-bc1c-c56668a0f3fe-kube-api-access-p7kns" (OuterVolumeSpecName: "kube-api-access-p7kns") pod "994b4048-1673-4a75-bc1c-c56668a0f3fe" (UID: "994b4048-1673-4a75-bc1c-c56668a0f3fe"). InnerVolumeSpecName "kube-api-access-p7kns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:00:03.759411 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:03.759381 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7kns\" (UniqueName: \"kubernetes.io/projected/994b4048-1673-4a75-bc1c-c56668a0f3fe-kube-api-access-p7kns\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 19:00:03.759411 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:03.759405 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b59jw\" (UniqueName: \"kubernetes.io/projected/0e4730ab-a648-4a09-919b-3bd732a6e68f-kube-api-access-b59jw\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 19:00:03.759411 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:03.759417 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmhl6\" (UniqueName: \"kubernetes.io/projected/c0b1cfd2-38d4-4260-bbf3-7e35d1797a4c-kube-api-access-nmhl6\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 19:00:04.367798 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:04.367765 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-972159-29724180-4z7rz" Jul 07 19:00:04.367966 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:04.367798 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-972159-29724180-4z7rz" event={"ID":"0e4730ab-a648-4a09-919b-3bd732a6e68f","Type":"ContainerDied","Data":"27591d40edd2e8d6ce6f0b50e90fac038282350644f5be454f949ce22ccd9faf"} Jul 07 19:00:04.367966 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:04.367843 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27591d40edd2e8d6ce6f0b50e90fac038282350644f5be454f949ce22ccd9faf" Jul 07 19:00:04.369126 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:04.369105 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724180-psxpf" Jul 07 19:00:04.369281 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:04.369108 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724180-psxpf" event={"ID":"c0b1cfd2-38d4-4260-bbf3-7e35d1797a4c","Type":"ContainerDied","Data":"3fa08eb51d5330e275e91321cc61bdc2768fdcdb03661c29b8746de95d1b76ad"} Jul 07 19:00:04.369281 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:04.369221 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3fa08eb51d5330e275e91321cc61bdc2768fdcdb03661c29b8746de95d1b76ad" Jul 07 19:00:04.370584 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:04.370561 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-e7285b-29724180-gfwvp" event={"ID":"994b4048-1673-4a75-bc1c-c56668a0f3fe","Type":"ContainerDied","Data":"2faba3ba2b0bfe2c4f3c9442c6ac57a6f5251061f036c5389b2013cf2896d8a4"} Jul 07 19:00:04.370699 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:04.370596 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2faba3ba2b0bfe2c4f3c9442c6ac57a6f5251061f036c5389b2013cf2896d8a4" Jul 07 19:00:04.370699 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:00:04.370571 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-e7285b-29724180-gfwvp" Jul 07 19:02:40.322683 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:02:40.322654 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/2.log" Jul 07 19:02:40.327436 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:02:40.327416 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-skkmr_b7335728-d739-4c3d-877b-c1d860112c1a/ovn-acl-logging/0.log" Jul 07 19:02:40.339616 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:02:40.339594 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/2.log" Jul 07 19:02:40.344266 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:02:40.344248 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-skkmr_b7335728-d739-4c3d-877b-c1d860112c1a/ovn-acl-logging/0.log" Jul 07 19:04:44.016138 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:04:44.016102 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-972159-29724180-4z7rz"] Jul 07 19:04:44.028308 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:04:44.028282 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-972159-29724180-4z7rz"] Jul 07 19:04:44.191975 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:04:44.191941 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e4730ab-a648-4a09-919b-3bd732a6e68f" path="/var/lib/kubelet/pods/0e4730ab-a648-4a09-919b-3bd732a6e68f/volumes" Jul 07 19:05:27.233016 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:27.232977 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-e7285b-29724180-gfwvp"] Jul 07 19:05:27.238931 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:27.238906 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-e7285b-29724180-gfwvp"] Jul 07 19:05:28.191574 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:28.191533 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="994b4048-1673-4a75-bc1c-c56668a0f3fe" path="/var/lib/kubelet/pods/994b4048-1673-4a75-bc1c-c56668a0f3fe/volumes" Jul 07 19:05:34.193127 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:34.193097 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h"] Jul 07 19:05:34.193557 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:34.193304 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" podUID="24b8d8a2-d800-4f77-afda-74744c288928" containerName="istio-proxy" containerID="cri-o://3a2112af52a2353168f5a0410af228a7bd94023849922946b21ccf9e539cd053" gracePeriod=30 Jul 07 19:05:39.446204 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.446176 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 19:05:39.543794 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.543761 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w968\" (UniqueName: \"kubernetes.io/projected/24b8d8a2-d800-4f77-afda-74744c288928-kube-api-access-5w968\") pod \"24b8d8a2-d800-4f77-afda-74744c288928\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " Jul 07 19:05:39.543794 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.543806 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24b8d8a2-d800-4f77-afda-74744c288928-istiod-ca-cert\") pod \"24b8d8a2-d800-4f77-afda-74744c288928\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " Jul 07 19:05:39.544080 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.543834 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-credential-socket\") pod \"24b8d8a2-d800-4f77-afda-74744c288928\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " Jul 07 19:05:39.544080 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.543891 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-istio-envoy\") pod \"24b8d8a2-d800-4f77-afda-74744c288928\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " Jul 07 19:05:39.544080 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.543944 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24b8d8a2-d800-4f77-afda-74744c288928-istio-podinfo\") pod \"24b8d8a2-d800-4f77-afda-74744c288928\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " Jul 07 19:05:39.544080 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.543969 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-workload-socket\") pod \"24b8d8a2-d800-4f77-afda-74744c288928\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " Jul 07 19:05:39.544080 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.543996 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24b8d8a2-d800-4f77-afda-74744c288928-istio-token\") pod \"24b8d8a2-d800-4f77-afda-74744c288928\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " Jul 07 19:05:39.544080 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.544028 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-istio-data\") pod \"24b8d8a2-d800-4f77-afda-74744c288928\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " Jul 07 19:05:39.544388 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.544119 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-workload-certs\") pod \"24b8d8a2-d800-4f77-afda-74744c288928\" (UID: \"24b8d8a2-d800-4f77-afda-74744c288928\") " Jul 07 19:05:39.544388 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.544136 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "24b8d8a2-d800-4f77-afda-74744c288928" (UID: "24b8d8a2-d800-4f77-afda-74744c288928"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:05:39.544388 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.544282 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24b8d8a2-d800-4f77-afda-74744c288928-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "24b8d8a2-d800-4f77-afda-74744c288928" (UID: "24b8d8a2-d800-4f77-afda-74744c288928"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:05:39.544573 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.544504 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "24b8d8a2-d800-4f77-afda-74744c288928" (UID: "24b8d8a2-d800-4f77-afda-74744c288928"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:05:39.544573 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.544562 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24b8d8a2-d800-4f77-afda-74744c288928-istiod-ca-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 19:05:39.544672 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.544587 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-credential-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 19:05:39.545039 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.545013 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-istio-data" (OuterVolumeSpecName: "istio-data") pod "24b8d8a2-d800-4f77-afda-74744c288928" (UID: "24b8d8a2-d800-4f77-afda-74744c288928"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:05:39.545110 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.545090 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "24b8d8a2-d800-4f77-afda-74744c288928" (UID: "24b8d8a2-d800-4f77-afda-74744c288928"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:05:39.546194 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.546169 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "24b8d8a2-d800-4f77-afda-74744c288928" (UID: "24b8d8a2-d800-4f77-afda-74744c288928"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:05:39.546299 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.546196 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/24b8d8a2-d800-4f77-afda-74744c288928-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "24b8d8a2-d800-4f77-afda-74744c288928" (UID: "24b8d8a2-d800-4f77-afda-74744c288928"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 19:05:39.546525 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.546509 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24b8d8a2-d800-4f77-afda-74744c288928-istio-token" (OuterVolumeSpecName: "istio-token") pod "24b8d8a2-d800-4f77-afda-74744c288928" (UID: "24b8d8a2-d800-4f77-afda-74744c288928"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:05:39.546600 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.546528 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24b8d8a2-d800-4f77-afda-74744c288928-kube-api-access-5w968" (OuterVolumeSpecName: "kube-api-access-5w968") pod "24b8d8a2-d800-4f77-afda-74744c288928" (UID: "24b8d8a2-d800-4f77-afda-74744c288928"). InnerVolumeSpecName "kube-api-access-5w968". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:05:39.645219 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.645162 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-istio-data\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 19:05:39.645219 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.645213 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-workload-certs\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 19:05:39.645219 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.645224 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w968\" (UniqueName: \"kubernetes.io/projected/24b8d8a2-d800-4f77-afda-74744c288928-kube-api-access-5w968\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 19:05:39.645219 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.645234 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-istio-envoy\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 19:05:39.645545 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.645244 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24b8d8a2-d800-4f77-afda-74744c288928-istio-podinfo\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 19:05:39.645545 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.645252 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24b8d8a2-d800-4f77-afda-74744c288928-workload-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 19:05:39.645545 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:39.645260 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24b8d8a2-d800-4f77-afda-74744c288928-istio-token\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\"" Jul 07 19:05:40.289058 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:40.289024 2580 generic.go:356] "Generic (PLEG): container finished" podID="24b8d8a2-d800-4f77-afda-74744c288928" containerID="3a2112af52a2353168f5a0410af228a7bd94023849922946b21ccf9e539cd053" exitCode=0 Jul 07 19:05:40.289236 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:40.289068 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" Jul 07 19:05:40.289236 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:40.289103 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" event={"ID":"24b8d8a2-d800-4f77-afda-74744c288928","Type":"ContainerDied","Data":"3a2112af52a2353168f5a0410af228a7bd94023849922946b21ccf9e539cd053"} Jul 07 19:05:40.289236 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:40.289162 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h" event={"ID":"24b8d8a2-d800-4f77-afda-74744c288928","Type":"ContainerDied","Data":"510ca6bfd1e67f3301beaa27bcd8740d80cbe8ff795585fe3b60ee781a643109"} Jul 07 19:05:40.289236 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:40.289186 2580 scope.go:117] "RemoveContainer" containerID="3a2112af52a2353168f5a0410af228a7bd94023849922946b21ccf9e539cd053" Jul 07 19:05:40.298606 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:40.298587 2580 scope.go:117] "RemoveContainer" containerID="67085523609d983da0866f1281dffe394214b6e3c7798e485019a348bdcf9f69" Jul 07 19:05:40.307656 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:40.307384 2580 scope.go:117] "RemoveContainer" containerID="3a2112af52a2353168f5a0410af228a7bd94023849922946b21ccf9e539cd053" Jul 07 19:05:40.307728 ip-10-0-141-187 kubenswrapper[2580]: E0707 19:05:40.307702 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a2112af52a2353168f5a0410af228a7bd94023849922946b21ccf9e539cd053\": container with ID starting with 3a2112af52a2353168f5a0410af228a7bd94023849922946b21ccf9e539cd053 not found: ID does not exist" containerID="3a2112af52a2353168f5a0410af228a7bd94023849922946b21ccf9e539cd053" Jul 07 19:05:40.307773 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:40.307728 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a2112af52a2353168f5a0410af228a7bd94023849922946b21ccf9e539cd053"} err="failed to get container status \"3a2112af52a2353168f5a0410af228a7bd94023849922946b21ccf9e539cd053\": rpc error: code = NotFound desc = could not find container \"3a2112af52a2353168f5a0410af228a7bd94023849922946b21ccf9e539cd053\": container with ID starting with 3a2112af52a2353168f5a0410af228a7bd94023849922946b21ccf9e539cd053 not found: ID does not exist" Jul 07 19:05:40.307773 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:40.307746 2580 scope.go:117] "RemoveContainer" containerID="67085523609d983da0866f1281dffe394214b6e3c7798e485019a348bdcf9f69" Jul 07 19:05:40.307977 ip-10-0-141-187 kubenswrapper[2580]: E0707 19:05:40.307960 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67085523609d983da0866f1281dffe394214b6e3c7798e485019a348bdcf9f69\": container with ID starting with 67085523609d983da0866f1281dffe394214b6e3c7798e485019a348bdcf9f69 not found: ID does not exist" containerID="67085523609d983da0866f1281dffe394214b6e3c7798e485019a348bdcf9f69" Jul 07 19:05:40.308031 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:40.307982 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67085523609d983da0866f1281dffe394214b6e3c7798e485019a348bdcf9f69"} err="failed to get container status \"67085523609d983da0866f1281dffe394214b6e3c7798e485019a348bdcf9f69\": rpc error: code = NotFound desc = could not find container \"67085523609d983da0866f1281dffe394214b6e3c7798e485019a348bdcf9f69\": container with ID starting with 67085523609d983da0866f1281dffe394214b6e3c7798e485019a348bdcf9f69 not found: ID does not exist" Jul 07 19:05:40.308913 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:40.308895 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h"] Jul 07 19:05:40.313662 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:40.313640 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-e7285b-openshift-default-68987497f9-gng9h"] Jul 07 19:05:41.181556 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:41.181530 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724165-7jnzr_b38ac223-f206-4a0a-b81f-e1be0124b6f8/cleanup/0.log" Jul 07 19:05:41.295107 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:41.295078 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724180-psxpf_c0b1cfd2-38d4-4260-bbf3-7e35d1797a4c/cleanup/0.log" Jul 07 19:05:42.084938 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:42.084906 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7595c859c8-zsrvf_1491e747-7243-4e09-b668-2e9ae29bd515/copy-manifests/0.log" Jul 07 19:05:42.092334 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:42.092308 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7595c859c8-zsrvf_1491e747-7243-4e09-b668-2e9ae29bd515/manager/0.log" Jul 07 19:05:42.191812 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:42.191779 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24b8d8a2-d800-4f77-afda-74744c288928" path="/var/lib/kubelet/pods/24b8d8a2-d800-4f77-afda-74744c288928/volumes" Jul 07 19:05:42.211599 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:42.211558 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-pl6hp_41919352-adf0-4836-9497-a89718f54bde/postgres/0.log" Jul 07 19:05:43.046919 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:43.046891 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk_c77b0fb7-91cd-4a06-8953-abe6b26f672b/util/0.log" Jul 07 19:05:43.054193 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:43.054169 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk_c77b0fb7-91cd-4a06-8953-abe6b26f672b/pull/0.log" Jul 07 19:05:43.060832 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:43.060808 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk_c77b0fb7-91cd-4a06-8953-abe6b26f672b/extract/0.log" Jul 07 19:05:43.182051 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:43.182024 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs_94989ca4-1abb-4930-9f08-49946987d363/pull/0.log" Jul 07 19:05:43.193612 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:43.193582 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs_94989ca4-1abb-4930-9f08-49946987d363/extract/0.log" Jul 07 19:05:43.200671 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:43.200644 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs_94989ca4-1abb-4930-9f08-49946987d363/util/0.log" Jul 07 19:05:43.318153 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:43.318070 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm_9f43c18f-bea7-43b8-94af-1aa0b7d79930/util/0.log" Jul 07 19:05:43.325332 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:43.325306 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm_9f43c18f-bea7-43b8-94af-1aa0b7d79930/pull/0.log" Jul 07 19:05:43.332365 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:43.332343 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm_9f43c18f-bea7-43b8-94af-1aa0b7d79930/extract/0.log" Jul 07 19:05:43.449108 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:43.449079 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n_6ea6da50-29b2-4b9b-ad99-73a77b297822/extract/0.log" Jul 07 19:05:43.456339 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:43.456316 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n_6ea6da50-29b2-4b9b-ad99-73a77b297822/util/0.log" Jul 07 19:05:43.463130 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:43.463106 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n_6ea6da50-29b2-4b9b-ad99-73a77b297822/pull/0.log" Jul 07 19:05:44.823433 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:44.823400 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xrtm5_a89bd6a3-489e-4cf9-9260-ec7a80649035/istio-proxy/0.log" Jul 07 19:05:44.941562 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:44.941527 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hccw7_eea9a5c1-5b85-4583-af77-58e889a3b4da/discovery/0.log" Jul 07 19:05:45.435507 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:45.435474 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-j8zkr_7bd0579e-ef68-47bb-a79f-dfc1665dd1cb/payload-pre-processing/0.log" Jul 07 19:05:45.699683 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:45.699601 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67c8dfcf49-w9wrf_d442645e-7222-46af-9914-bb615255b0d5/router/0.log" Jul 07 19:05:46.298337 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:46.298309 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-xrzd7_9e3fcecf-b495-41be-ab95-a63208a94b29/main/0.log" Jul 07 19:05:54.703852 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:54.703818 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-njfbx_f090aaca-9b3a-449a-b2c4-2ccfbf5db417/global-pull-secret-syncer/0.log" Jul 07 19:05:54.896739 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:54.896709 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rxcml_829d17b8-8a45-4d04-af61-95b53794b8a1/konnectivity-agent/0.log" Jul 07 19:05:54.981049 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:54.981019 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-187.ec2.internal_b469ca5e754e40f9721a7a95476e077f/haproxy/0.log" Jul 07 19:05:59.319529 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:59.319483 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk_c77b0fb7-91cd-4a06-8953-abe6b26f672b/extract/0.log" Jul 07 19:05:59.346444 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:59.346410 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk_c77b0fb7-91cd-4a06-8953-abe6b26f672b/util/0.log" Jul 07 19:05:59.372095 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:59.372066 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z2snk_c77b0fb7-91cd-4a06-8953-abe6b26f672b/pull/0.log" Jul 07 19:05:59.411013 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:59.410985 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs_94989ca4-1abb-4930-9f08-49946987d363/extract/0.log" Jul 07 19:05:59.443080 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:59.443054 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs_94989ca4-1abb-4930-9f08-49946987d363/util/0.log" Jul 07 19:05:59.473901 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:59.473873 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n26zs_94989ca4-1abb-4930-9f08-49946987d363/pull/0.log" Jul 07 19:05:59.514824 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:59.514799 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm_9f43c18f-bea7-43b8-94af-1aa0b7d79930/extract/0.log" Jul 07 19:05:59.544678 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:59.544654 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm_9f43c18f-bea7-43b8-94af-1aa0b7d79930/util/0.log" Jul 07 19:05:59.574526 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:59.574426 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736gmhm_9f43c18f-bea7-43b8-94af-1aa0b7d79930/pull/0.log" Jul 07 19:05:59.619731 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:59.619707 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n_6ea6da50-29b2-4b9b-ad99-73a77b297822/extract/0.log" Jul 07 19:05:59.663397 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:59.663370 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n_6ea6da50-29b2-4b9b-ad99-73a77b297822/util/0.log" Jul 07 19:05:59.700706 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:05:59.700675 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1d4l9n_6ea6da50-29b2-4b9b-ad99-73a77b297822/pull/0.log" Jul 07 19:06:02.374648 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:02.374581 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b977a65f-624c-48a3-a330-a0665d92237e/alertmanager/0.log" Jul 07 19:06:02.402200 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:02.402173 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b977a65f-624c-48a3-a330-a0665d92237e/config-reloader/0.log" Jul 07 19:06:02.429974 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:02.429949 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b977a65f-624c-48a3-a330-a0665d92237e/kube-rbac-proxy-web/0.log" Jul 07 19:06:02.457384 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:02.457341 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b977a65f-624c-48a3-a330-a0665d92237e/kube-rbac-proxy/0.log" Jul 07 19:06:02.484193 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:02.484175 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b977a65f-624c-48a3-a330-a0665d92237e/kube-rbac-proxy-metric/0.log" Jul 07 19:06:02.512333 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:02.512311 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b977a65f-624c-48a3-a330-a0665d92237e/prom-label-proxy/0.log" Jul 07 19:06:02.538776 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:02.538757 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b977a65f-624c-48a3-a330-a0665d92237e/init-config-reloader/0.log" Jul 07 19:06:02.580916 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:02.580892 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-bbc47_965e4f40-8930-40a0-9ba0-b075c40d5a0d/cluster-monitoring-operator/0.log" Jul 07 19:06:02.693931 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:02.693864 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5bfb47d9b4-q54np_174e26f4-6d04-471c-9c43-14fcf2477ce7/metrics-server/0.log" Jul 07 19:06:02.768249 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:02.768223 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fwmfm_b4434b20-ebc6-4f42-b4c8-0799b44eb4bb/node-exporter/0.log" Jul 07 19:06:02.794299 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:02.794276 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fwmfm_b4434b20-ebc6-4f42-b4c8-0799b44eb4bb/kube-rbac-proxy/0.log" Jul 07 19:06:02.822783 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:02.822759 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fwmfm_b4434b20-ebc6-4f42-b4c8-0799b44eb4bb/init-textfile/0.log" Jul 07 19:06:03.026627 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:03.026593 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-kcvpf_53423e2a-4b4a-4536-a4f9-7fb58b014a23/kube-rbac-proxy-main/0.log" Jul 07 19:06:03.053498 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:03.053450 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-kcvpf_53423e2a-4b4a-4536-a4f9-7fb58b014a23/kube-rbac-proxy-self/0.log" Jul 07 19:06:03.078360 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:03.078333 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-kcvpf_53423e2a-4b4a-4536-a4f9-7fb58b014a23/openshift-state-metrics/0.log" Jul 07 19:06:03.457663 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:03.457635 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5499b9657c-v6hhl_a4490aa2-d093-48e7-a255-d41c638bbffe/telemeter-client/0.log" Jul 07 19:06:03.484586 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:03.484564 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5499b9657c-v6hhl_a4490aa2-d093-48e7-a255-d41c638bbffe/reload/0.log" Jul 07 19:06:03.511688 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:03.511664 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5499b9657c-v6hhl_a4490aa2-d093-48e7-a255-d41c638bbffe/kube-rbac-proxy/0.log" Jul 07 19:06:03.545692 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:03.545669 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78dcc646dd-qfcfd_98f3f7b3-5659-426d-a36b-917abed54f90/thanos-query/0.log" Jul 07 19:06:03.570577 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:03.570496 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78dcc646dd-qfcfd_98f3f7b3-5659-426d-a36b-917abed54f90/kube-rbac-proxy-web/0.log" Jul 07 19:06:03.596724 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:03.596695 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78dcc646dd-qfcfd_98f3f7b3-5659-426d-a36b-917abed54f90/kube-rbac-proxy/0.log" Jul 07 19:06:03.623135 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:03.623108 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78dcc646dd-qfcfd_98f3f7b3-5659-426d-a36b-917abed54f90/prom-label-proxy/0.log" Jul 07 19:06:03.649097 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:03.649071 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78dcc646dd-qfcfd_98f3f7b3-5659-426d-a36b-917abed54f90/kube-rbac-proxy-rules/0.log" Jul 07 19:06:03.674169 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:03.674148 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-78dcc646dd-qfcfd_98f3f7b3-5659-426d-a36b-917abed54f90/kube-rbac-proxy-metrics/0.log" Jul 07 19:06:04.830651 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:04.830615 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-fhgs8_5cd963e2-7b23-4a61-a73d-cbf757e7ea02/networking-console-plugin/0.log" Jul 07 19:06:04.989498 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:04.989449 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn"] Jul 07 19:06:04.989876 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:04.989861 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24b8d8a2-d800-4f77-afda-74744c288928" containerName="istio-proxy" Jul 07 19:06:04.989977 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:04.989878 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="24b8d8a2-d800-4f77-afda-74744c288928" containerName="istio-proxy" Jul 07 19:06:04.989977 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:04.989892 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0b1cfd2-38d4-4260-bbf3-7e35d1797a4c" containerName="cleanup" Jul 07 19:06:04.989977 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:04.989897 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0b1cfd2-38d4-4260-bbf3-7e35d1797a4c" containerName="cleanup" Jul 07 19:06:04.989977 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:04.989913 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="994b4048-1673-4a75-bc1c-c56668a0f3fe" containerName="cleanup" Jul 07 19:06:04.989977 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:04.989919 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="994b4048-1673-4a75-bc1c-c56668a0f3fe" containerName="cleanup" Jul 07 19:06:04.989977 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:04.989931 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e4730ab-a648-4a09-919b-3bd732a6e68f" containerName="cleanup" Jul 07 19:06:04.989977 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:04.989936 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e4730ab-a648-4a09-919b-3bd732a6e68f" containerName="cleanup" Jul 07 19:06:04.990226 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:04.989996 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e4730ab-a648-4a09-919b-3bd732a6e68f" containerName="cleanup" Jul 07 19:06:04.990226 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:04.990005 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="994b4048-1673-4a75-bc1c-c56668a0f3fe" containerName="cleanup" Jul 07 19:06:04.990226 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:04.990011 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="24b8d8a2-d800-4f77-afda-74744c288928" containerName="istio-proxy" Jul 07 19:06:04.990226 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:04.990017 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="24b8d8a2-d800-4f77-afda-74744c288928" containerName="istio-proxy" Jul 07 19:06:04.990226 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:04.990022 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0b1cfd2-38d4-4260-bbf3-7e35d1797a4c" containerName="cleanup" Jul 07 19:06:04.993100 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:04.993080 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn" Jul 07 19:06:04.996633 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:04.996607 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fzth9\"/\"default-dockercfg-fmmcn\"" Jul 07 19:06:04.996761 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:04.996743 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fzth9\"/\"openshift-service-ca.crt\"" Jul 07 19:06:04.997653 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:04.997638 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fzth9\"/\"kube-root-ca.crt\"" Jul 07 19:06:05.010307 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:05.010282 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn"] Jul 07 19:06:05.084631 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:05.084536 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75fkt\" (UniqueName: \"kubernetes.io/projected/fb03da42-cc54-443d-b5ed-a9d719c2c852-kube-api-access-75fkt\") pod \"perf-node-gather-daemonset-qdcgn\" (UID: \"fb03da42-cc54-443d-b5ed-a9d719c2c852\") " pod="openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn" Jul 07 19:06:05.084631 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:05.084598 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fb03da42-cc54-443d-b5ed-a9d719c2c852-proc\") pod \"perf-node-gather-daemonset-qdcgn\" (UID: \"fb03da42-cc54-443d-b5ed-a9d719c2c852\") " pod="openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn" Jul 07 19:06:05.084827 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:05.084642 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fb03da42-cc54-443d-b5ed-a9d719c2c852-podres\") pod \"perf-node-gather-daemonset-qdcgn\" (UID: \"fb03da42-cc54-443d-b5ed-a9d719c2c852\") " pod="openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn" Jul 07 19:06:05.084827 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:05.084700 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb03da42-cc54-443d-b5ed-a9d719c2c852-sys\") pod \"perf-node-gather-daemonset-qdcgn\" (UID: \"fb03da42-cc54-443d-b5ed-a9d719c2c852\") " pod="openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn" Jul 07 19:06:05.084827 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:05.084762 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb03da42-cc54-443d-b5ed-a9d719c2c852-lib-modules\") pod \"perf-node-gather-daemonset-qdcgn\" (UID: \"fb03da42-cc54-443d-b5ed-a9d719c2c852\") " pod="openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn" Jul 07 19:06:05.185891 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:05.185846 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fb03da42-cc54-443d-b5ed-a9d719c2c852-proc\") pod \"perf-node-gather-daemonset-qdcgn\" (UID: \"fb03da42-cc54-443d-b5ed-a9d719c2c852\") " pod="openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn" Jul 07 19:06:05.185891 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:05.185889 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fb03da42-cc54-443d-b5ed-a9d719c2c852-podres\") pod \"perf-node-gather-daemonset-qdcgn\" (UID: \"fb03da42-cc54-443d-b5ed-a9d719c2c852\") " pod="openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn" Jul 07 19:06:05.186132 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:05.185927 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb03da42-cc54-443d-b5ed-a9d719c2c852-sys\") pod \"perf-node-gather-daemonset-qdcgn\" (UID: \"fb03da42-cc54-443d-b5ed-a9d719c2c852\") " pod="openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn" Jul 07 19:06:05.186132 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:05.185958 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fb03da42-cc54-443d-b5ed-a9d719c2c852-proc\") pod \"perf-node-gather-daemonset-qdcgn\" (UID: \"fb03da42-cc54-443d-b5ed-a9d719c2c852\") " pod="openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn" Jul 07 19:06:05.186132 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:05.185981 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb03da42-cc54-443d-b5ed-a9d719c2c852-lib-modules\") pod \"perf-node-gather-daemonset-qdcgn\" (UID: \"fb03da42-cc54-443d-b5ed-a9d719c2c852\") " pod="openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn" Jul 07 19:06:05.186132 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:05.186081 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fb03da42-cc54-443d-b5ed-a9d719c2c852-podres\") pod \"perf-node-gather-daemonset-qdcgn\" (UID: \"fb03da42-cc54-443d-b5ed-a9d719c2c852\") " pod="openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn" Jul 07 19:06:05.186132 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:05.186094 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75fkt\" (UniqueName: \"kubernetes.io/projected/fb03da42-cc54-443d-b5ed-a9d719c2c852-kube-api-access-75fkt\") pod \"perf-node-gather-daemonset-qdcgn\" (UID: \"fb03da42-cc54-443d-b5ed-a9d719c2c852\") " pod="openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn" Jul 07 19:06:05.186132 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:05.186084 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb03da42-cc54-443d-b5ed-a9d719c2c852-sys\") pod \"perf-node-gather-daemonset-qdcgn\" (UID: \"fb03da42-cc54-443d-b5ed-a9d719c2c852\") " pod="openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn" Jul 07 19:06:05.186427 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:05.186173 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb03da42-cc54-443d-b5ed-a9d719c2c852-lib-modules\") pod \"perf-node-gather-daemonset-qdcgn\" (UID: \"fb03da42-cc54-443d-b5ed-a9d719c2c852\") " pod="openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn" Jul 07 19:06:05.206955 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:05.206929 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75fkt\" (UniqueName: \"kubernetes.io/projected/fb03da42-cc54-443d-b5ed-a9d719c2c852-kube-api-access-75fkt\") pod \"perf-node-gather-daemonset-qdcgn\" (UID: \"fb03da42-cc54-443d-b5ed-a9d719c2c852\") " pod="openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn" Jul 07 19:06:05.302519 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:05.302492 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn" Jul 07 19:06:05.432474 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:05.432434 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn"] Jul 07 19:06:05.434344 ip-10-0-141-187 kubenswrapper[2580]: W0707 19:06:05.434317 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfb03da42_cc54_443d_b5ed_a9d719c2c852.slice/crio-cc74c7b8d4975b9a140de292ccbddf554e30a5e45c876aba550b8561243f832c WatchSource:0}: Error finding container cc74c7b8d4975b9a140de292ccbddf554e30a5e45c876aba550b8561243f832c: Status 404 returned error can't find the container with id cc74c7b8d4975b9a140de292ccbddf554e30a5e45c876aba550b8561243f832c Jul 07 19:06:05.604446 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:05.604361 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/2.log" Jul 07 19:06:05.608350 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:05.608326 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c8qbd_f4b3e4d6-d81a-4a6b-8e38-4aeb71fa4bc7/console-operator/3.log" Jul 07 19:06:06.439713 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:06.439678 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn" event={"ID":"fb03da42-cc54-443d-b5ed-a9d719c2c852","Type":"ContainerStarted","Data":"a2ece6e199df00d9abcfc9fb90e85bd1dc5772f1bd77b226e73c7a341f41a847"} Jul 07 19:06:06.440105 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:06.439729 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn" event={"ID":"fb03da42-cc54-443d-b5ed-a9d719c2c852","Type":"ContainerStarted","Data":"cc74c7b8d4975b9a140de292ccbddf554e30a5e45c876aba550b8561243f832c"} Jul 07 19:06:06.440105 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:06.439784 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn" Jul 07 19:06:06.459424 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:06.459374 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn" podStartSLOduration=2.459360227 podStartE2EDuration="2.459360227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:06:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:06:06.456804495 +0000 UTC m=+2607.587456529" watchObservedRunningTime="2026-07-07 19:06:06.459360227 +0000 UTC m=+2607.590012305" Jul 07 19:06:06.756481 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:06.756411 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-zcjct_e19ae2f0-2899-434d-bc06-dd4a3dabd4fc/volume-data-source-validator/0.log" Jul 07 19:06:07.834954 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:07.834914 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-42kxz_a2602fe9-e2fe-47bb-88b7-cab17f6659f3/dns/0.log" Jul 07 19:06:07.862383 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:07.862356 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-42kxz_a2602fe9-e2fe-47bb-88b7-cab17f6659f3/kube-rbac-proxy/0.log" Jul 07 19:06:08.025191 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:08.025161 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lzcsf_f95b113a-076d-4c7d-ac0b-24de4955b5c2/dns-node-resolver/0.log" Jul 07 19:06:08.671594 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:08.671568 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rgkvn_51f0ab4e-9faa-4aa6-a6bf-5c7e3f69cd13/node-ca/0.log" Jul 07 19:06:09.727643 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:09.727615 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xrtm5_a89bd6a3-489e-4cf9-9260-ec7a80649035/istio-proxy/0.log" Jul 07 19:06:09.851579 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:09.851532 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hccw7_eea9a5c1-5b85-4583-af77-58e889a3b4da/discovery/0.log" Jul 07 19:06:10.016602 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:10.016566 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-j8zkr_7bd0579e-ef68-47bb-a79f-dfc1665dd1cb/payload-pre-processing/0.log" Jul 07 19:06:10.116408 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:10.116349 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67c8dfcf49-w9wrf_d442645e-7222-46af-9914-bb615255b0d5/router/0.log" Jul 07 19:06:10.869736 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:10.869707 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-grchh_cdd04634-6641-4959-b079-f96dc848fbda/serve-healthcheck-canary/0.log" Jul 07 19:06:11.458434 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:11.458404 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-g9hm4_3c6efb43-250b-4db1-bd62-e87d1ee11077/insights-operator/0.log" Jul 07 19:06:11.459037 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:11.459020 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-g9hm4_3c6efb43-250b-4db1-bd62-e87d1ee11077/insights-operator/1.log" Jul 07 19:06:11.557366 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:11.557335 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nlrr4_71a0ffb2-a8fc-4bd3-abc3-b56cd594349f/kube-rbac-proxy/0.log" Jul 07 19:06:11.584037 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:11.584013 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nlrr4_71a0ffb2-a8fc-4bd3-abc3-b56cd594349f/exporter/0.log" Jul 07 19:06:11.609699 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:11.609675 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nlrr4_71a0ffb2-a8fc-4bd3-abc3-b56cd594349f/extractor/0.log" Jul 07 19:06:12.455946 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:12.455921 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fzth9/perf-node-gather-daemonset-qdcgn" Jul 07 19:06:14.248286 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:14.248257 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724165-7jnzr_b38ac223-f206-4a0a-b81f-e1be0124b6f8/cleanup/0.log" Jul 07 19:06:14.274481 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:14.274442 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724180-psxpf_c0b1cfd2-38d4-4260-bbf3-7e35d1797a4c/cleanup/0.log" Jul 07 19:06:14.782322 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:14.782290 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7595c859c8-zsrvf_1491e747-7243-4e09-b668-2e9ae29bd515/manager/0.log" Jul 07 19:06:14.807774 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:14.807753 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7595c859c8-zsrvf_1491e747-7243-4e09-b668-2e9ae29bd515/copy-manifests/0.log" Jul 07 19:06:14.837256 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:14.837220 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-pl6hp_41919352-adf0-4836-9497-a89718f54bde/postgres/0.log" Jul 07 19:06:15.566014 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:15.565982 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xrtm5_a89bd6a3-489e-4cf9-9260-ec7a80649035/istio-proxy/0.log" Jul 07 19:06:15.671532 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:15.671425 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hccw7_eea9a5c1-5b85-4583-af77-58e889a3b4da/discovery/0.log" Jul 07 19:06:15.799210 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:15.799179 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-j8zkr_7bd0579e-ef68-47bb-a79f-dfc1665dd1cb/payload-pre-processing/0.log" Jul 07 19:06:15.888306 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:15.888280 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67c8dfcf49-w9wrf_d442645e-7222-46af-9914-bb615255b0d5/router/0.log" Jul 07 19:06:16.516129 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:16.516103 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-749c476b6d-q2dbx_86b38e18-085b-4c2f-81e7-f2993c64aa50/manager/0.log" Jul 07 19:06:16.548494 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:16.548468 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-fbc26_0e81400e-817c-4e04-92aa-3f3c2056ba09/openshift-lws-operator/0.log" Jul 07 19:06:17.130953 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:17.130927 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xrtm5_a89bd6a3-489e-4cf9-9260-ec7a80649035/istio-proxy/0.log" Jul 07 19:06:17.231517 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:17.231486 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hccw7_eea9a5c1-5b85-4583-af77-58e889a3b4da/discovery/0.log" Jul 07 19:06:17.356806 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:17.356775 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-j8zkr_7bd0579e-ef68-47bb-a79f-dfc1665dd1cb/payload-pre-processing/0.log" Jul 07 19:06:17.453935 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:17.453862 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67c8dfcf49-w9wrf_d442645e-7222-46af-9914-bb615255b0d5/router/0.log" Jul 07 19:06:22.077278 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:22.077246 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-vtgpm_b8491d42-ab30-44db-a098-d51bb210dbeb/kube-storage-version-migrator-operator/1.log" Jul 07 19:06:22.078231 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:22.078211 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-vtgpm_b8491d42-ab30-44db-a098-d51bb210dbeb/kube-storage-version-migrator-operator/0.log" Jul 07 19:06:23.643356 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:23.643325 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ftjp9_b72940a4-d68a-4aa5-83ee-375e8bae5918/kube-multus-additional-cni-plugins/0.log" Jul 07 19:06:23.667550 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:23.667519 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ftjp9_b72940a4-d68a-4aa5-83ee-375e8bae5918/egress-router-binary-copy/0.log" Jul 07 19:06:23.693393 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:23.693361 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ftjp9_b72940a4-d68a-4aa5-83ee-375e8bae5918/cni-plugins/0.log" Jul 07 19:06:23.721950 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:23.721923 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ftjp9_b72940a4-d68a-4aa5-83ee-375e8bae5918/bond-cni-plugin/0.log" Jul 07 19:06:23.751277 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:23.751252 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ftjp9_b72940a4-d68a-4aa5-83ee-375e8bae5918/routeoverride-cni/0.log" Jul 07 19:06:23.776901 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:23.776877 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ftjp9_b72940a4-d68a-4aa5-83ee-375e8bae5918/whereabouts-cni-bincopy/0.log" Jul 07 19:06:23.807551 ip-10-0-141-187 kubenswrapper[2580]: I0707 19:06:23.807522 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ftjp9_b72940a4-d68a-4aa5-83ee-375e8bae5918/whereabouts-cni/0.log"