Jul 05 00:07:05.337992 ip-10-0-142-188 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 05 00:07:05.338003 ip-10-0-142-188 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 05 00:07:05.338010 ip-10-0-142-188 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 05 00:07:05.338212 ip-10-0-142-188 systemd[1]: Failed to start Kubernetes Kubelet. Jul 05 00:07:15.535019 ip-10-0-142-188 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 05 00:07:15.535038 ip-10-0-142-188 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot afdf7ea790a048f88ae3af9c14977eef -- Jul 05 00:08:48.066655 ip-10-0-142-188 systemd[1]: Starting Kubernetes Kubelet... Jul 05 00:08:48.571477 ip-10-0-142-188 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 00:08:48.571477 ip-10-0-142-188 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 05 00:08:48.571477 ip-10-0-142-188 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 00:08:48.571477 ip-10-0-142-188 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 05 00:08:48.571477 ip-10-0-142-188 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 00:08:48.571477 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.553397 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 05 00:08:48.571477 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557331 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 00:08:48.571477 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557340 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 00:08:48.571477 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557344 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 00:08:48.571477 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557347 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 00:08:48.571477 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557350 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 00:08:48.571477 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557354 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 00:08:48.571477 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557356 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 00:08:48.571477 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557359 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 00:08:48.586067 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557362 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 00:08:48.586067 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557365 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 00:08:48.586067 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557367 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 00:08:48.586067 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557370 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 00:08:48.586067 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557372 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 00:08:48.586067 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557375 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 00:08:48.586067 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557390 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 00:08:48.586067 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557393 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 00:08:48.586067 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557395 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 00:08:48.586067 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557398 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 00:08:48.586067 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557401 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 00:08:48.586067 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557403 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 00:08:48.586067 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557406 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 00:08:48.586067 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557408 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 00:08:48.586067 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557418 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 00:08:48.586067 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557421 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 00:08:48.586067 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557424 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 00:08:48.586067 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557428 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 00:08:48.586067 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557430 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 00:08:48.586067 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557433 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 00:08:48.588663 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557436 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 00:08:48.588663 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557438 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 00:08:48.588663 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557441 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 00:08:48.588663 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557444 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 00:08:48.588663 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557446 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 00:08:48.588663 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557449 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 00:08:48.588663 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557451 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 00:08:48.588663 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557454 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 00:08:48.588663 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557456 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 00:08:48.588663 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557459 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 00:08:48.588663 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557462 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 00:08:48.588663 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557464 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 00:08:48.588663 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557467 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 00:08:48.588663 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557471 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 00:08:48.588663 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557475 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 00:08:48.588663 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557478 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 00:08:48.588663 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557481 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 00:08:48.588663 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557483 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 00:08:48.588663 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557486 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 00:08:48.588663 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557488 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 00:08:48.607094 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557491 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 00:08:48.607094 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557493 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 00:08:48.607094 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557496 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 00:08:48.607094 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557499 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 00:08:48.607094 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557501 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 00:08:48.607094 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557504 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 00:08:48.607094 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557507 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 00:08:48.607094 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557510 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 00:08:48.607094 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557513 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 00:08:48.607094 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557515 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 00:08:48.607094 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557518 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 00:08:48.607094 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557521 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 00:08:48.607094 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557523 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 00:08:48.607094 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557526 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 00:08:48.607094 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557529 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 00:08:48.607094 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557533 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 00:08:48.607094 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557535 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 00:08:48.607094 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557538 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 00:08:48.607094 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557541 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 00:08:48.609404 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557543 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 00:08:48.609404 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557546 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 00:08:48.609404 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557548 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 00:08:48.609404 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557550 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 00:08:48.609404 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557553 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 00:08:48.609404 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557556 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 00:08:48.609404 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557558 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 00:08:48.609404 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557561 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 00:08:48.609404 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557564 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 00:08:48.609404 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557567 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 00:08:48.609404 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557569 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 00:08:48.609404 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557572 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 00:08:48.609404 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557574 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 00:08:48.609404 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557577 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 00:08:48.609404 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557580 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 05 00:08:48.609404 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557583 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 00:08:48.609404 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557585 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 00:08:48.609404 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557588 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 00:08:48.609404 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557591 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 00:08:48.609404 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557594 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 00:08:48.673521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557596 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 00:08:48.673521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557599 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 00:08:48.673521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557602 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 00:08:48.673521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557605 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 00:08:48.673521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557609 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 00:08:48.673521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557612 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 00:08:48.673521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557615 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 00:08:48.673521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557619 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 00:08:48.673521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557623 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 00:08:48.673521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557626 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 00:08:48.673521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557629 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 00:08:48.673521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.557632 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 00:08:48.673521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558295 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 00:08:48.673521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558301 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 00:08:48.673521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558304 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 00:08:48.673521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558307 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 00:08:48.673521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558311 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 00:08:48.673521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558315 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 00:08:48.630113 ip-10-0-142-188 systemd[1]: Started Kubernetes Kubelet. Jul 05 00:08:48.675947 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558318 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 00:08:48.675947 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558322 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 00:08:48.675947 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558325 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 00:08:48.675947 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558329 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 00:08:48.675947 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558333 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 00:08:48.675947 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558336 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 00:08:48.675947 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558339 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 00:08:48.675947 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558342 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 00:08:48.675947 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558345 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 00:08:48.675947 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558348 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 00:08:48.675947 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558351 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 00:08:48.675947 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558353 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 00:08:48.675947 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558356 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 00:08:48.675947 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558358 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 00:08:48.675947 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558360 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 00:08:48.675947 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558363 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 00:08:48.675947 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558365 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 00:08:48.675947 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558368 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 00:08:48.675947 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558370 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 00:08:48.675947 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558373 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 00:08:48.854182 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558375 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 00:08:48.854182 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558398 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 00:08:48.854182 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558404 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 00:08:48.854182 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558409 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 00:08:48.854182 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558412 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 00:08:48.854182 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558415 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 00:08:48.854182 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558418 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 00:08:48.854182 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558423 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 00:08:48.854182 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558426 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 00:08:48.854182 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558429 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 00:08:48.854182 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558432 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 00:08:48.854182 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558435 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 00:08:48.854182 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558438 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 00:08:48.854182 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558441 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 00:08:48.854182 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558444 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 00:08:48.854182 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558447 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 00:08:48.854182 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558449 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 00:08:48.854182 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558452 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 00:08:48.854182 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558454 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 00:08:48.855365 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558457 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 00:08:48.855365 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558460 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 05 00:08:48.855365 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558464 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 00:08:48.855365 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558467 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 00:08:48.855365 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558470 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 00:08:48.855365 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558472 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 00:08:48.855365 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558476 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 00:08:48.855365 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558478 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 00:08:48.855365 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558481 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 00:08:48.855365 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558484 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 00:08:48.855365 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558487 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 00:08:48.855365 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558489 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 00:08:48.855365 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558492 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 00:08:48.855365 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558494 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 00:08:48.855365 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558497 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 00:08:48.855365 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558499 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 00:08:48.855365 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558502 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 00:08:48.855365 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558504 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 00:08:48.855365 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558507 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 00:08:48.855365 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558510 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 00:08:48.857850 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558512 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 00:08:48.857850 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558515 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 00:08:48.857850 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558517 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 00:08:48.857850 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558520 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 00:08:48.857850 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558522 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 00:08:48.857850 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558525 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 00:08:48.857850 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558527 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 00:08:48.857850 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558529 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 00:08:48.857850 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558532 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 00:08:48.857850 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558534 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 00:08:48.857850 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558537 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 00:08:48.857850 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558539 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 00:08:48.857850 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558542 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 00:08:48.857850 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558545 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 00:08:48.857850 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558547 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 00:08:48.857850 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558551 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 00:08:48.857850 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558553 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 00:08:48.857850 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558556 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 00:08:48.857850 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558558 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 00:08:48.867780 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558561 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 00:08:48.867780 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558564 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 00:08:48.867780 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558567 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 00:08:48.867780 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558569 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 00:08:48.867780 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558572 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 00:08:48.867780 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558574 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 00:08:48.867780 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558577 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 00:08:48.867780 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558579 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 00:08:48.867780 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558582 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 00:08:48.867780 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558584 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 00:08:48.867780 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558587 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 00:08:48.867780 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558590 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 00:08:48.867780 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558592 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 00:08:48.867780 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558595 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 00:08:48.867780 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558597 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 00:08:48.867780 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558967 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 00:08:48.867780 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558972 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 00:08:48.867780 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558977 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 00:08:48.867780 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558980 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 00:08:48.868810 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558984 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 00:08:48.868810 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558987 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 00:08:48.868810 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558989 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 00:08:48.868810 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558992 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 00:08:48.868810 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558995 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 00:08:48.868810 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.558998 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 00:08:48.868810 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559002 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 00:08:48.868810 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559005 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 00:08:48.868810 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559008 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 00:08:48.868810 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559011 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 00:08:48.868810 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559014 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 00:08:48.868810 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559017 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 00:08:48.868810 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559020 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 00:08:48.868810 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559023 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 00:08:48.868810 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559025 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 00:08:48.868810 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559028 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 00:08:48.868810 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559030 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 00:08:48.868810 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559033 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 00:08:48.868810 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559035 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 00:08:48.868810 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559038 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 00:08:48.869871 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559040 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 00:08:48.869871 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559043 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 00:08:48.869871 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559045 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 00:08:48.869871 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559048 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 00:08:48.869871 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559050 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 00:08:48.869871 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559053 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 00:08:48.869871 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559056 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 00:08:48.869871 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559059 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 00:08:48.869871 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559061 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 00:08:48.869871 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559064 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 00:08:48.869871 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559066 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 00:08:48.869871 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559069 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 00:08:48.869871 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559071 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 00:08:48.869871 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559074 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 00:08:48.869871 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559078 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 00:08:48.869871 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559081 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 00:08:48.869871 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559084 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 00:08:48.869871 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559087 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 00:08:48.869871 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559091 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 00:08:48.869871 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559093 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 00:08:48.872238 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559096 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 00:08:48.872238 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559098 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 00:08:48.872238 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559104 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 00:08:48.872238 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559106 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 00:08:48.872238 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559109 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 00:08:48.872238 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559111 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 00:08:48.872238 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559113 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 00:08:48.872238 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559116 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 00:08:48.872238 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559119 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 00:08:48.872238 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559123 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 00:08:48.872238 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559126 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 05 00:08:48.872238 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559128 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 00:08:48.872238 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559131 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 00:08:48.872238 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559133 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 00:08:48.872238 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559136 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 00:08:48.872238 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559138 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 00:08:48.872238 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559141 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 00:08:48.872238 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559144 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 00:08:48.872238 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559147 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 00:08:48.872238 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559150 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 00:08:48.873298 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559154 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 00:08:48.873298 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559157 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 00:08:48.873298 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559160 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 00:08:48.873298 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559162 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 00:08:48.873298 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559165 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 00:08:48.873298 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559167 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 00:08:48.873298 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559170 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 00:08:48.873298 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559172 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 00:08:48.873298 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559175 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 00:08:48.873298 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559177 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 00:08:48.873298 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559181 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 00:08:48.873298 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559184 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 00:08:48.873298 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559187 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 00:08:48.873298 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559189 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 00:08:48.873298 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559192 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 00:08:48.873298 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559199 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 00:08:48.873298 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559201 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 00:08:48.873298 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559204 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 00:08:48.873298 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559207 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 00:08:48.873298 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559210 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 00:08:48.874340 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559212 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 00:08:48.874340 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559216 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 00:08:48.874340 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559219 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 00:08:48.874340 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559221 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 00:08:48.874340 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559224 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 00:08:48.874340 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559226 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 00:08:48.874340 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559229 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 00:08:48.874340 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559231 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 00:08:48.874340 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559234 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 00:08:48.874340 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559236 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 00:08:48.874340 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559239 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 00:08:48.874340 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559241 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 00:08:48.874340 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559244 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 00:08:48.874340 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559246 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 00:08:48.874340 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559248 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 00:08:48.874340 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559313 2561 flags.go:64] FLAG: --address="0.0.0.0" Jul 05 00:08:48.874340 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559319 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 05 00:08:48.874340 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559325 2561 flags.go:64] FLAG: --anonymous-auth="true" Jul 05 00:08:48.874340 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559330 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 05 00:08:48.874340 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559333 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 05 00:08:48.874340 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559336 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559340 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559345 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559348 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559352 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559355 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559358 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559361 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559365 2561 flags.go:64] FLAG: --cgroup-root="" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559368 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559370 2561 flags.go:64] FLAG: --client-ca-file="" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559373 2561 flags.go:64] FLAG: --cloud-provider="external" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559389 2561 flags.go:64] FLAG: --cluster-dns="[]" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559395 2561 flags.go:64] FLAG: --cluster-domain="" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559398 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559401 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559404 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559407 2561 flags.go:64] FLAG: --container-log-max-files="5" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559411 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559414 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559417 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559420 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559423 2561 flags.go:64] FLAG: --contention-profiling="false" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559425 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 05 00:08:48.877665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559428 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559431 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559434 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559438 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559441 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559443 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559446 2561 flags.go:64] FLAG: --enable-load-reader="false" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559449 2561 flags.go:64] FLAG: --enable-server="true" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559452 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559456 2561 flags.go:64] FLAG: --event-burst="100" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559463 2561 flags.go:64] FLAG: --event-qps="50" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559466 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559469 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559471 2561 flags.go:64] FLAG: --eviction-hard="" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559475 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559478 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559481 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559484 2561 flags.go:64] FLAG: --eviction-soft="" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559487 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559490 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559492 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559496 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559499 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559502 2561 flags.go:64] FLAG: --fail-swap-on="true" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559505 2561 flags.go:64] FLAG: --feature-gates="" Jul 05 00:08:48.879145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559509 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559512 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559515 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559518 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559521 2561 flags.go:64] FLAG: --healthz-port="10248" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559524 2561 flags.go:64] FLAG: --help="false" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559526 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-142-188.ec2.internal" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559529 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559532 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559535 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559538 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559541 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559544 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559547 2561 flags.go:64] FLAG: --image-service-endpoint="" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559549 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559552 2561 flags.go:64] FLAG: --kube-api-burst="100" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559555 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559559 2561 flags.go:64] FLAG: --kube-api-qps="50" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559562 2561 flags.go:64] FLAG: --kube-reserved="" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559565 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559568 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559571 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559573 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559576 2561 flags.go:64] FLAG: --lock-file="" Jul 05 00:08:48.881993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559579 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559582 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559585 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559591 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559595 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559597 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559600 2561 flags.go:64] FLAG: --logging-format="text" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559603 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559606 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559609 2561 flags.go:64] FLAG: --manifest-url="" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559611 2561 flags.go:64] FLAG: --manifest-url-header="" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559615 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559618 2561 flags.go:64] FLAG: --max-open-files="1000000" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559622 2561 flags.go:64] FLAG: --max-pods="110" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559625 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559628 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559631 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559633 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559636 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559639 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559642 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559648 2561 flags.go:64] FLAG: --node-status-max-images="50" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559651 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559654 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jul 05 00:08:48.883462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559657 2561 flags.go:64] FLAG: --pod-cidr="" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559662 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559667 2561 flags.go:64] FLAG: --pod-manifest-path="" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559670 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559673 2561 flags.go:64] FLAG: --pods-per-core="0" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559676 2561 flags.go:64] FLAG: --port="10250" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559679 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559681 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02c00624051e3d949" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559684 2561 flags.go:64] FLAG: --qos-reserved="" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559687 2561 flags.go:64] FLAG: --read-only-port="10255" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559691 2561 flags.go:64] FLAG: --register-node="true" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559693 2561 flags.go:64] FLAG: --register-with-taints="" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559698 2561 flags.go:64] FLAG: --registry-burst="10" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559701 2561 flags.go:64] FLAG: --registry-qps="5" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559704 2561 flags.go:64] FLAG: --reserved-cpus="" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559707 2561 flags.go:64] FLAG: --reserved-memory="" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559710 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559713 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559716 2561 flags.go:64] FLAG: --rotate-certificates="false" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559718 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559721 2561 flags.go:64] FLAG: --runonce="false" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559724 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559727 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559730 2561 flags.go:64] FLAG: --seccomp-default="false" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559733 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 05 00:08:48.885855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559735 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559738 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559741 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559744 2561 flags.go:64] FLAG: --storage-driver-password="root" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559747 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559750 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559753 2561 flags.go:64] FLAG: --storage-driver-user="root" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559755 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559758 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559762 2561 flags.go:64] FLAG: --system-cgroups="" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559765 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559770 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559773 2561 flags.go:64] FLAG: --tls-cert-file="" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559775 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559779 2561 flags.go:64] FLAG: --tls-min-version="" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559782 2561 flags.go:64] FLAG: --tls-private-key-file="" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559784 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559787 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559790 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559795 2561 flags.go:64] FLAG: --v="2" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559799 2561 flags.go:64] FLAG: --version="false" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559802 2561 flags.go:64] FLAG: --vmodule="" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559806 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.559809 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559913 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 00:08:48.887354 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559918 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 00:08:48.888426 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559922 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 00:08:48.888426 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559925 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 00:08:48.888426 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559928 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 00:08:48.888426 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559931 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 00:08:48.888426 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559934 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 00:08:48.888426 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559937 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 00:08:48.888426 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559939 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 00:08:48.888426 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559942 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 00:08:48.888426 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559944 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 00:08:48.888426 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559947 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 00:08:48.888426 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559949 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 00:08:48.888426 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559952 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 00:08:48.888426 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559954 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 00:08:48.888426 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559957 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 00:08:48.888426 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559959 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 00:08:48.888426 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559965 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 00:08:48.888426 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559968 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 00:08:48.888426 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559971 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 00:08:48.888426 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559974 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 00:08:48.889470 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559977 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 00:08:48.889470 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559979 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 00:08:48.889470 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559982 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 00:08:48.889470 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559984 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 00:08:48.889470 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559987 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 00:08:48.889470 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559989 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 00:08:48.889470 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559996 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 00:08:48.889470 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.559999 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 00:08:48.889470 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560002 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 00:08:48.889470 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560004 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 00:08:48.889470 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560006 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 00:08:48.889470 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560009 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 00:08:48.889470 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560011 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 00:08:48.889470 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560014 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 00:08:48.889470 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560017 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 00:08:48.889470 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560019 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 00:08:48.889470 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560022 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 00:08:48.889470 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560024 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 00:08:48.889470 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560027 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 00:08:48.890494 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560029 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 00:08:48.890494 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560032 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 00:08:48.890494 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560034 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 00:08:48.890494 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560037 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 00:08:48.890494 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560039 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 00:08:48.890494 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560042 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 00:08:48.890494 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560044 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 00:08:48.890494 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560047 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 00:08:48.890494 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560049 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 00:08:48.890494 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560054 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 00:08:48.890494 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560056 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 00:08:48.890494 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560059 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 00:08:48.890494 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560061 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 00:08:48.890494 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560064 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 00:08:48.890494 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560067 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 00:08:48.890494 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560069 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 00:08:48.890494 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560072 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 00:08:48.890494 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560074 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 00:08:48.890494 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560077 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 00:08:48.890494 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560080 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 00:08:48.891521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560083 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 00:08:48.891521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560086 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 00:08:48.891521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560089 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 00:08:48.891521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560091 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 00:08:48.891521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560094 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 00:08:48.891521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560096 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 00:08:48.891521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560099 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 00:08:48.891521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560101 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 00:08:48.891521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560104 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 00:08:48.891521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560106 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 00:08:48.891521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560109 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 00:08:48.891521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560111 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 00:08:48.891521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560114 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 00:08:48.891521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560116 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 00:08:48.891521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560119 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 00:08:48.891521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560121 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 00:08:48.891521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560124 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 00:08:48.891521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560127 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 05 00:08:48.891521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560129 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 00:08:48.891521 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560131 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 00:08:48.892553 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560135 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 00:08:48.892553 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560140 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 00:08:48.892553 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560142 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 00:08:48.892553 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560145 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 00:08:48.892553 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560148 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 00:08:48.892553 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560151 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 00:08:48.892553 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560154 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 00:08:48.892553 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560157 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 00:08:48.892553 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560159 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 00:08:48.892553 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560162 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 00:08:48.892553 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560164 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 00:08:48.892553 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560168 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 00:08:48.892553 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560171 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 00:08:48.892553 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560174 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 00:08:48.892553 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560176 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 00:08:48.892553 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560179 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 00:08:48.892553 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560181 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 00:08:48.892553 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560184 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 00:08:48.892553 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.560186 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 00:08:48.893570 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.560191 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 00:08:48.893570 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.571112 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 05 00:08:48.893570 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.571125 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 05 00:08:48.893570 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.571138 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 05 00:08:48.893570 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.571146 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 05 00:08:48.893570 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571206 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 00:08:48.893570 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571210 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 00:08:48.893570 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571214 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 00:08:48.893570 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571217 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 00:08:48.893570 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571220 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 00:08:48.893570 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571222 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 00:08:48.893570 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571225 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 00:08:48.893570 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571228 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 00:08:48.893570 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571230 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 00:08:48.893570 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571233 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 00:08:48.894543 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571235 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 00:08:48.894543 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571238 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 00:08:48.894543 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571241 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 00:08:48.894543 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571243 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 00:08:48.894543 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571245 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 00:08:48.894543 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571248 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 00:08:48.894543 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571251 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 00:08:48.894543 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571254 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 00:08:48.894543 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571256 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 00:08:48.894543 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571258 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 00:08:48.894543 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571261 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 00:08:48.894543 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571266 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 00:08:48.894543 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571269 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 05 00:08:48.894543 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571272 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 00:08:48.894543 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571276 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 00:08:48.894543 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571279 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 00:08:48.894543 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571282 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 00:08:48.894543 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571287 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 00:08:48.894543 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571290 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 00:08:48.895563 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571293 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 00:08:48.895563 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571296 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 00:08:48.895563 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571298 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 00:08:48.895563 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571305 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 00:08:48.895563 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571309 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 00:08:48.895563 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571312 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 00:08:48.895563 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571315 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 00:08:48.895563 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571319 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 00:08:48.895563 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571322 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 00:08:48.895563 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571325 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 00:08:48.895563 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571327 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 00:08:48.895563 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571330 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 00:08:48.895563 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571333 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 00:08:48.895563 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571335 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 00:08:48.895563 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571338 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 00:08:48.895563 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571341 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 00:08:48.895563 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571345 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 00:08:48.895563 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571348 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 00:08:48.895563 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571350 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 00:08:48.896588 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571353 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 00:08:48.896588 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571356 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 00:08:48.896588 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571359 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 00:08:48.896588 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571361 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 00:08:48.896588 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571364 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 00:08:48.896588 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571367 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 00:08:48.896588 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571370 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 00:08:48.896588 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571372 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 00:08:48.896588 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571374 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 00:08:48.896588 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571399 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 00:08:48.896588 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571403 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 00:08:48.896588 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571405 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 00:08:48.896588 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571408 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 00:08:48.896588 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571410 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 00:08:48.896588 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571413 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 00:08:48.896588 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571416 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 00:08:48.896588 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571420 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 00:08:48.896588 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571423 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 00:08:48.896588 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571426 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 00:08:48.896588 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571428 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 00:08:48.897608 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571431 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 00:08:48.897608 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571433 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 00:08:48.897608 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571436 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 00:08:48.897608 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571438 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 00:08:48.897608 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571441 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 00:08:48.897608 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571444 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 00:08:48.897608 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571446 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 00:08:48.897608 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571449 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 00:08:48.897608 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571451 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 00:08:48.897608 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571455 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 00:08:48.897608 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571458 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 00:08:48.897608 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571460 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 00:08:48.897608 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571463 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 00:08:48.897608 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571468 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 00:08:48.897608 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571470 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 00:08:48.897608 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571473 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 00:08:48.897608 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571475 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 00:08:48.897608 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571478 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 00:08:48.897608 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571481 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 00:08:48.897608 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571484 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 00:08:48.899976 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571487 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 00:08:48.899976 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571490 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 00:08:48.899976 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571492 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 00:08:48.899976 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571495 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 00:08:48.899976 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571498 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 00:08:48.899976 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571500 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 00:08:48.899976 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571503 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 00:08:48.899976 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571505 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 00:08:48.899976 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571509 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 00:08:48.899976 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571512 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 00:08:48.899976 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571515 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 00:08:48.899976 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.571519 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 00:08:48.899976 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571625 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 00:08:48.899976 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571630 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 00:08:48.899976 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571633 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 00:08:48.900959 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571636 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 00:08:48.900959 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571639 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 00:08:48.900959 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571641 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 00:08:48.900959 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571644 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 00:08:48.900959 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571646 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 00:08:48.900959 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571649 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 00:08:48.900959 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571653 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 00:08:48.900959 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571656 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 00:08:48.900959 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571658 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 00:08:48.900959 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571661 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 00:08:48.900959 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571663 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 00:08:48.900959 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571666 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 00:08:48.900959 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571668 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 00:08:48.900959 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571671 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 00:08:48.900959 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571674 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 00:08:48.900959 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571676 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 00:08:48.900959 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571679 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 00:08:48.900959 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571682 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 00:08:48.900959 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571684 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 00:08:48.900959 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571687 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 00:08:49.000910 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571690 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 00:08:49.000910 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571693 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 00:08:49.000910 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571695 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 00:08:49.000910 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571699 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 00:08:49.000910 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571702 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 00:08:49.000910 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571705 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 00:08:49.000910 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571709 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 00:08:49.000910 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571712 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 00:08:49.000910 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571715 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 00:08:49.000910 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571717 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 00:08:49.000910 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571720 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 00:08:49.000910 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571724 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 00:08:49.000910 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571727 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 00:08:49.000910 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571729 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 05 00:08:49.000910 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571732 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 00:08:49.000910 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571735 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 00:08:49.000910 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571737 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 00:08:49.000910 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571739 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 00:08:49.000910 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571743 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 00:08:49.001915 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571746 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 00:08:49.001915 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571748 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 00:08:49.001915 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571751 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 00:08:49.001915 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571753 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 00:08:49.001915 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571756 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 00:08:49.001915 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571759 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 00:08:49.001915 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571761 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 00:08:49.001915 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571764 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 00:08:49.001915 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571766 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 00:08:49.001915 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571769 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 00:08:49.001915 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571771 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 00:08:49.001915 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571774 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 00:08:49.001915 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571777 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 00:08:49.001915 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571779 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 00:08:49.001915 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571782 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 00:08:49.001915 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571784 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 00:08:49.001915 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571787 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 00:08:49.001915 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571789 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 00:08:49.001915 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571792 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 00:08:49.001915 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571796 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 00:08:49.003831 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571800 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 00:08:49.003831 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571803 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 00:08:49.003831 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571806 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 00:08:49.003831 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571808 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 00:08:49.003831 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571811 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 00:08:49.003831 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571814 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 00:08:49.003831 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571817 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 00:08:49.003831 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571819 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 00:08:49.003831 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571822 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 00:08:49.003831 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571824 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 00:08:49.003831 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571827 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 00:08:49.003831 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571832 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 00:08:49.003831 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571835 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 00:08:49.003831 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571837 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 00:08:49.003831 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571839 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 00:08:49.003831 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571842 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 00:08:49.003831 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571844 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 00:08:49.003831 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571847 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 00:08:49.003831 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571849 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 00:08:49.003831 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571852 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 00:08:49.004870 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571854 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 00:08:49.004870 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571857 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 00:08:49.004870 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571859 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 00:08:49.004870 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571862 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 00:08:49.004870 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571864 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 00:08:49.004870 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571867 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 00:08:49.004870 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571869 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 00:08:49.004870 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571872 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 00:08:49.004870 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571874 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 00:08:49.004870 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571877 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 00:08:49.004870 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571879 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 00:08:49.004870 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571883 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 00:08:49.004870 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571885 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 00:08:49.004870 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571888 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 00:08:49.004870 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571890 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 00:08:49.004870 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571892 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 00:08:49.004870 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:48.571895 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 00:08:49.005899 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.571900 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 00:08:49.005899 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.571991 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jul 05 00:08:49.005899 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.574050 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 05 00:08:49.005899 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.575607 2561 server.go:1019] "Starting client certificate rotation" Jul 05 00:08:49.005899 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.575705 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 05 00:08:49.005899 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.575747 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 05 00:08:49.005899 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.578546 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 05 00:08:49.005899 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.583729 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 05 00:08:49.005899 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.594711 2561 log.go:25] "Validated CRI v1 runtime API" Jul 05 00:08:49.005899 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.597111 2561 log.go:25] "Validated CRI v1 image API" Jul 05 00:08:49.005899 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.598596 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 05 00:08:49.005899 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.601170 2561 fs.go:135] Filesystem UUIDs: map[397a9b35-5aea-4735-a9b9-f2c130886a8a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9264193b-cc07-48ac-b6c1-1b4d688b999a:/dev/nvme0n1p4] Jul 05 00:08:49.006451 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.601193 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 05 00:08:49.006906 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.605301 2561 manager.go:216] Machine: {Timestamp:2026-07-05 00:08:48.604838489 +0000 UTC m=+0.381269347 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101611 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24b69437219c0b3a7daa8e02775886 SystemUUID:ec24b694-3721-9c0b-3a7d-aa8e02775886 BootID:afdf7ea7-90a0-48f8-8ae3-af9c14977eef Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:da:f9:bd:e5:17 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:da:f9:bd:e5:17 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:ce:09:81:19:01 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 05 00:08:49.006906 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.605412 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 05 00:08:49.006906 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.605497 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 05 00:08:49.006906 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.608874 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 05 00:08:49.006906 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.608896 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-188.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 05 00:08:49.006906 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.609763 2561 topology_manager.go:138] "Creating topology manager with none policy" Jul 05 00:08:49.006906 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.609773 2561 container_manager_linux.go:309] "Creating device plugin manager" Jul 05 00:08:49.006906 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.609781 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.609791 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.610066 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.611666 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.616113 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.616226 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.616258 2561 kubelet.go:486] "Attempting to sync node with API server" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.616273 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.616287 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.616297 2561 kubelet.go:398] "Adding apiserver pod source" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.616305 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.616664 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.616678 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.619103 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.621534 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.621560 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.623669 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.623683 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.623690 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.623697 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.623711 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.623719 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.623727 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.623732 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.623750 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.623756 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.623770 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.623775 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.623795 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.623800 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.629312 2561 server.go:1268] "Started kubelet" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.631687 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.631732 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.631806 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.633134 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-188.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:48.633647 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-188.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.634507 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:48.635797 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.636131 2561 server.go:310] "Adding debug handlers to kubelet server" Jul 05 00:08:49.008747 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:48.640669 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.643489 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.643843 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:48.644770 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-188.ec2.internal\" not found" Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.645503 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.645518 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.645637 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.645819 2561 reconstruct.go:97] "Volume reconstruction finished" Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.645834 2561 reconciler.go:29] "Reconciler: start to sync state" Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.646345 2561 factory.go:153] Registering CRI-O factory Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.646359 2561 factory.go:223] Registration of the crio container factory successfully Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.646421 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.646431 2561 factory.go:55] Registering systemd factory Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.646439 2561 factory.go:223] Registration of the systemd container factory successfully Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.646458 2561 factory.go:103] Registering Raw factory Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.646470 2561 manager.go:1196] Started watching for new ooms in manager Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.646796 2561 manager.go:349] Starting recovery of all containers Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:48.649779 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-188.ec2.internal.18bf3c2a04ae3911 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-188.ec2.internal,UID:ip-10-0-142-188.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-188.ec2.internal,},FirstTimestamp:2026-07-05 00:08:48.626825489 +0000 UTC m=+0.403256348,LastTimestamp:2026-07-05 00:08:48.626825489 +0000 UTC m=+0.403256348,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-188.ec2.internal,}" Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:48.651011 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-188.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:48.651093 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.655953 2561 manager.go:354] Recovery completed Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.663358 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.666157 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6lntp" Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.666180 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6lntp" Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.668164 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasSufficientMemory" Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.668192 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.668203 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasSufficientPID" Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.668710 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.668721 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.668725 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.668737 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.669425 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasSufficientMemory" Jul 05 00:08:49.010356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.669452 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.669463 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasSufficientPID" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:48.670627 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-188.ec2.internal.18bf3c2a07252fb3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-188.ec2.internal,UID:ip-10-0-142-188.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-188.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-188.ec2.internal,},FirstTimestamp:2026-07-05 00:08:48.668176307 +0000 UTC m=+0.444607168,LastTimestamp:2026-07-05 00:08:48.668176307 +0000 UTC m=+0.444607168,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-188.ec2.internal,}" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.670798 2561 policy_none.go:49] "None policy: Start" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.670815 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.670828 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.672797 2561 policy_none.go:47] "Start" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:48.673780 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-188.ec2.internal.18bf3c2a0725810a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-188.ec2.internal,UID:ip-10-0-142-188.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-188.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-188.ec2.internal,},FirstTimestamp:2026-07-05 00:08:48.66819713 +0000 UTC m=+0.444627989,LastTimestamp:2026-07-05 00:08:48.66819713 +0000 UTC m=+0.444627989,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-188.ec2.internal,}" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.702957 2561 manager.go:337] "Starting Device Plugin manager" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:48.702986 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.702998 2561 server.go:87] "Starting device plugin registration server" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.703202 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.703213 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.703323 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.703396 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.703404 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:48.703822 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:48.703880 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-188.ec2.internal\" not found" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.717882 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.719002 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.719042 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.719065 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:48.719101 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.721070 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.804703 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.805567 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasSufficientMemory" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.805592 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 00:08:49.011884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.805605 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasSufficientPID" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.805628 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-188.ec2.internal" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.814209 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-188.ec2.internal" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:48.814228 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-188.ec2.internal\": node \"ip-10-0-142-188.ec2.internal\" not found" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.819158 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-188.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-188.ec2.internal"] Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.819220 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.819918 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasSufficientMemory" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.819944 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.819953 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasSufficientPID" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.822102 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.822233 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-188.ec2.internal" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.822261 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.822725 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasSufficientMemory" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.822750 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.822757 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasSufficientMemory" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.822775 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.822785 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasSufficientPID" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.822760 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasSufficientPID" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.824912 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-188.ec2.internal" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.824941 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.825539 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasSufficientMemory" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.825567 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.825579 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasSufficientPID" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:48.838050 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-188.ec2.internal\" not found" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.847360 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d89021ce33a5b1f6d6abbda92c13ccc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-188.ec2.internal\" (UID: \"7d89021ce33a5b1f6d6abbda92c13ccc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-188.ec2.internal" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.847571 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d89021ce33a5b1f6d6abbda92c13ccc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-188.ec2.internal\" (UID: \"7d89021ce33a5b1f6d6abbda92c13ccc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-188.ec2.internal" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.847603 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d98373d2705b464e11a31bbc31f03dd-config\") pod \"kube-apiserver-proxy-ip-10-0-142-188.ec2.internal\" (UID: \"4d98373d2705b464e11a31bbc31f03dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-188.ec2.internal" Jul 05 00:08:49.013404 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:48.938466 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-188.ec2.internal\" not found" Jul 05 00:08:49.015816 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.947756 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d89021ce33a5b1f6d6abbda92c13ccc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-188.ec2.internal\" (UID: \"7d89021ce33a5b1f6d6abbda92c13ccc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-188.ec2.internal" Jul 05 00:08:49.015816 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.947780 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d98373d2705b464e11a31bbc31f03dd-config\") pod \"kube-apiserver-proxy-ip-10-0-142-188.ec2.internal\" (UID: \"4d98373d2705b464e11a31bbc31f03dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-188.ec2.internal" Jul 05 00:08:49.015816 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.947796 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d89021ce33a5b1f6d6abbda92c13ccc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-188.ec2.internal\" (UID: \"7d89021ce33a5b1f6d6abbda92c13ccc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-188.ec2.internal" Jul 05 00:08:49.015816 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.947843 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7d89021ce33a5b1f6d6abbda92c13ccc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-188.ec2.internal\" (UID: \"7d89021ce33a5b1f6d6abbda92c13ccc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-188.ec2.internal" Jul 05 00:08:49.015816 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.947852 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d89021ce33a5b1f6d6abbda92c13ccc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-188.ec2.internal\" (UID: \"7d89021ce33a5b1f6d6abbda92c13ccc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-188.ec2.internal" Jul 05 00:08:49.015816 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:48.947879 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d98373d2705b464e11a31bbc31f03dd-config\") pod \"kube-apiserver-proxy-ip-10-0-142-188.ec2.internal\" (UID: \"4d98373d2705b464e11a31bbc31f03dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-188.ec2.internal" Jul 05 00:08:49.124093 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:49.038883 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-188.ec2.internal\" not found" Jul 05 00:08:49.124093 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:49.081159 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-188.ec2.internal\" not found" node="ip-10-0-142-188.ec2.internal" Jul 05 00:08:49.124093 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:49.083802 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-188.ec2.internal" Jul 05 00:08:49.124093 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:49.085587 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-188.ec2.internal\" not found" node="ip-10-0-142-188.ec2.internal" Jul 05 00:08:49.124093 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:49.089186 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-188.ec2.internal" Jul 05 00:08:49.139725 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:49.139046 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-188.ec2.internal\" not found" Jul 05 00:08:49.247465 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:49.239472 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-188.ec2.internal\" not found" Jul 05 00:08:49.375722 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:49.339967 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-188.ec2.internal\" not found" Jul 05 00:08:49.495628 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:49.440479 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-188.ec2.internal\" not found" Jul 05 00:08:50.675566 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:49.523645 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 00:08:50.675566 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:49.540871 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-188.ec2.internal\" not found" Jul 05 00:08:50.675566 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:50.626698 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 05 00:08:50.675566 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:50.626829 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 05 00:08:50.675566 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:50.626846 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 05 00:08:50.790893 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:50.692779 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-188.ec2.internal\" not found" Jul 05 00:08:50.790893 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:50.724292 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-04 00:03:49 +0000 UTC" deadline="2027-12-25 05:49:22.654659313 +0000 UTC" Jul 05 00:08:50.790893 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:50.724318 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12917h40m31.930343844s" Jul 05 00:08:50.897784 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:50.792161 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 00:08:50.897784 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:50.793573 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-188.ec2.internal\" not found" Jul 05 00:08:50.897784 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:50.894056 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-188.ec2.internal\" not found" Jul 05 00:08:50.948294 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:50.948248 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasSufficientMemory" Jul 05 00:08:50.948294 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:50.948283 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 00:08:50.948433 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:50.948297 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeHasSufficientPID" Jul 05 00:08:50.995191 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:50.995159 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-188.ec2.internal\" not found" Jul 05 00:08:51.095623 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:51.095589 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-188.ec2.internal\" not found" Jul 05 00:08:51.120241 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:51.120210 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d98373d2705b464e11a31bbc31f03dd.slice/crio-bce5294e0ef61e224df25a4f564da151ec2b38eb26a0cd3d3d1e1d281e83640c WatchSource:0}: Error finding container bce5294e0ef61e224df25a4f564da151ec2b38eb26a0cd3d3d1e1d281e83640c: Status 404 returned error can't find the container with id bce5294e0ef61e224df25a4f564da151ec2b38eb26a0cd3d3d1e1d281e83640c Jul 05 00:08:51.124475 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.124463 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 00:08:51.157852 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.157829 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 00:08:51.196137 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:51.196106 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-188.ec2.internal\" not found" Jul 05 00:08:51.240049 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.239986 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 00:08:51.297190 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.297157 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-188.ec2.internal" Jul 05 00:08:51.300056 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:51.300036 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d89021ce33a5b1f6d6abbda92c13ccc.slice/crio-74cd16d1ec3d688ab636536f858dcb8853f69766f02997a4b95810d2758ca1ee WatchSource:0}: Error finding container 74cd16d1ec3d688ab636536f858dcb8853f69766f02997a4b95810d2758ca1ee: Status 404 returned error can't find the container with id 74cd16d1ec3d688ab636536f858dcb8853f69766f02997a4b95810d2758ca1ee Jul 05 00:08:51.310465 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.310449 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 05 00:08:51.311709 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.311691 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-188.ec2.internal" Jul 05 00:08:51.319080 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.319064 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 05 00:08:51.669063 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.668984 2561 apiserver.go:52] "Watching apiserver" Jul 05 00:08:51.675221 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.675188 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 05 00:08:51.675515 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.675495 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-dxsxs","kube-system/konnectivity-agent-qp7vx","kube-system/kube-apiserver-proxy-ip-10-0-142-188.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-188.ec2.internal","openshift-multus/network-metrics-daemon-tlll9","openshift-network-diagnostics/network-check-target-t4ppn","openshift-network-operator/iptables-alerter-zrxdw","openshift-ovn-kubernetes/ovnkube-node-t2zpd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz","openshift-cluster-node-tuning-operator/tuned-62fb7","openshift-dns/node-resolver-m6rgl","openshift-image-registry/node-ca-lz9th","openshift-multus/multus-additional-cni-plugins-99xdd","openshift-multus/multus-zr9vn"] Jul 05 00:08:51.678217 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.678200 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.680299 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.680284 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qp7vx" Jul 05 00:08:51.680509 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.680492 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 05 00:08:51.681078 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.681061 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 05 00:08:51.681188 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.681091 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 05 00:08:51.681188 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.681107 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 05 00:08:51.681288 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.681262 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zkpmw\"" Jul 05 00:08:51.681288 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.681276 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 05 00:08:51.681288 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.681286 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 05 00:08:51.682672 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.682654 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.682982 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.682850 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 05 00:08:51.682982 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.682860 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ht57q\"" Jul 05 00:08:51.682982 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.682921 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 05 00:08:51.685273 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.684895 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.685273 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.684939 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 05 00:08:51.686073 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.686058 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 05 00:08:51.686152 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.686098 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 05 00:08:51.686152 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.686111 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 05 00:08:51.686257 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.686098 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c7flq\"" Jul 05 00:08:51.687413 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.687397 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:08:51.687490 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:51.687463 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlll9" podUID="107f4ca7-7252-4983-9468-ba558c9e9e58" Jul 05 00:08:51.688362 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.688342 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 05 00:08:51.688466 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.688367 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 05 00:08:51.688466 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.688403 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m9nfv\"" Jul 05 00:08:51.689609 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.689593 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m6rgl" Jul 05 00:08:51.691964 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.691948 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.692053 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.692005 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 05 00:08:51.692174 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.692155 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mlzqh\"" Jul 05 00:08:51.692373 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.692357 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 05 00:08:51.694141 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.694122 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zrxdw" Jul 05 00:08:51.695190 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.695024 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 05 00:08:51.695190 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.695128 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7l7bt\"" Jul 05 00:08:51.697531 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.696960 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 05 00:08:51.697531 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.697479 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" Jul 05 00:08:51.697685 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.697549 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-czjkq\"" Jul 05 00:08:51.697685 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.697571 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 05 00:08:51.697685 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.697578 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 05 00:08:51.698018 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.697988 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 05 00:08:51.698729 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.698714 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 05 00:08:51.700097 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.700080 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 05 00:08:51.700367 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.700352 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-r6c8s\"" Jul 05 00:08:51.700440 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.700350 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 05 00:08:51.700440 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.700354 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 05 00:08:51.700640 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.700627 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:08:51.700698 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:51.700684 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxsxs" podUID="d3f73c87-0938-4904-8db7-e28345166dd1" Jul 05 00:08:51.702980 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.702963 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:08:51.703074 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:51.703020 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4ppn" podUID="f2c0c53b-05d0-4dce-844b-95ce6cff9a0f" Jul 05 00:08:51.705195 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.705179 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lz9th" Jul 05 00:08:51.706209 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706190 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-os-release\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.706289 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706224 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-host-var-lib-cni-bin\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.706289 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706248 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-host-var-lib-cni-multus\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.706289 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706272 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-etc-openvswitch\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.706419 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706305 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-node-log\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.706419 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706330 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-etc-kubernetes\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.706419 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706353 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-var-lib-kubelet\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.706419 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706368 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/41b995eb-3ced-434b-86d9-a4095f68577a-socket-dir\") pod \"aws-ebs-csi-driver-node-zdwbz\" (UID: \"41b995eb-3ced-434b-86d9-a4095f68577a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" Jul 05 00:08:51.706419 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706388 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/41b995eb-3ced-434b-86d9-a4095f68577a-etc-selinux\") pod \"aws-ebs-csi-driver-node-zdwbz\" (UID: \"41b995eb-3ced-434b-86d9-a4095f68577a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" Jul 05 00:08:51.706419 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706408 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-multus-cni-dir\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.706616 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706432 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-host-run-netns\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.706616 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706455 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-host-cni-bin\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.706616 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706498 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/25833488-5ae4-4ff9-8eaf-cc1107922763-env-overrides\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.706616 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706530 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/25833488-5ae4-4ff9-8eaf-cc1107922763-ovn-node-metrics-cert\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.706616 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706558 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97rfm\" (UniqueName: \"kubernetes.io/projected/0d61705e-33be-4264-85b4-8edce04fffbd-kube-api-access-97rfm\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.706616 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706584 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-lib-modules\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.706616 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706606 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-tmp\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.706843 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706630 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-multus-socket-dir-parent\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.706843 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706653 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-host-run-netns\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.706843 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706674 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d61705e-33be-4264-85b4-8edce04fffbd-system-cni-dir\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.706843 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706695 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d61705e-33be-4264-85b4-8edce04fffbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.706843 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706712 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f25f798-bb34-44b4-83e2-19ab8622e667-agent-certs\") pod \"konnectivity-agent-qp7vx\" (UID: \"7f25f798-bb34-44b4-83e2-19ab8622e667\") " pod="kube-system/konnectivity-agent-qp7vx" Jul 05 00:08:51.706843 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706726 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-run-systemd\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.706843 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706746 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-host-cni-netd\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.706843 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706769 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-etc-modprobe-d\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.706843 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706790 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-etc-systemd\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.706843 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706836 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxhrs\" (UniqueName: \"kubernetes.io/projected/027126e8-e72a-47f9-9edd-19eee423b6b0-kube-api-access-cxhrs\") pod \"iptables-alerter-zrxdw\" (UID: \"027126e8-e72a-47f9-9edd-19eee423b6b0\") " pod="openshift-network-operator/iptables-alerter-zrxdw" Jul 05 00:08:51.707191 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706871 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/41b995eb-3ced-434b-86d9-a4095f68577a-sys-fs\") pod \"aws-ebs-csi-driver-node-zdwbz\" (UID: \"41b995eb-3ced-434b-86d9-a4095f68577a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" Jul 05 00:08:51.707191 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706895 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-host-run-k8s-cni-cncf-io\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.707191 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706918 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/962c613c-ccfc-4bdd-aded-f0978bc0b8ab-tmp-dir\") pod \"node-resolver-m6rgl\" (UID: \"962c613c-ccfc-4bdd-aded-f0978bc0b8ab\") " pod="openshift-dns/node-resolver-m6rgl" Jul 05 00:08:51.707191 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706940 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6slpb\" (UniqueName: \"kubernetes.io/projected/962c613c-ccfc-4bdd-aded-f0978bc0b8ab-kube-api-access-6slpb\") pod \"node-resolver-m6rgl\" (UID: \"962c613c-ccfc-4bdd-aded-f0978bc0b8ab\") " pod="openshift-dns/node-resolver-m6rgl" Jul 05 00:08:51.707191 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706954 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/027126e8-e72a-47f9-9edd-19eee423b6b0-host-slash\") pod \"iptables-alerter-zrxdw\" (UID: \"027126e8-e72a-47f9-9edd-19eee423b6b0\") " pod="openshift-network-operator/iptables-alerter-zrxdw" Jul 05 00:08:51.707191 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706972 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-var-lib-openvswitch\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.707191 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.706991 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d761a174-9f01-4bb2-aa2d-76a540929c2d-cni-binary-copy\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.707191 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707011 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-host-var-lib-kubelet\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.707191 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707026 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-log-socket\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.707191 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707040 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d61705e-33be-4264-85b4-8edce04fffbd-cnibin\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.707191 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707059 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/41b995eb-3ced-434b-86d9-a4095f68577a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zdwbz\" (UID: \"41b995eb-3ced-434b-86d9-a4095f68577a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" Jul 05 00:08:51.707191 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707074 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/41b995eb-3ced-434b-86d9-a4095f68577a-registration-dir\") pod \"aws-ebs-csi-driver-node-zdwbz\" (UID: \"41b995eb-3ced-434b-86d9-a4095f68577a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" Jul 05 00:08:51.707191 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707089 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d61705e-33be-4264-85b4-8edce04fffbd-os-release\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.707191 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707106 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/962c613c-ccfc-4bdd-aded-f0978bc0b8ab-hosts-file\") pod \"node-resolver-m6rgl\" (UID: \"962c613c-ccfc-4bdd-aded-f0978bc0b8ab\") " pod="openshift-dns/node-resolver-m6rgl" Jul 05 00:08:51.707700 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707131 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-multus-conf-dir\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.707700 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707161 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-systemd-units\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.707700 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707178 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-host-run-ovn-kubernetes\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.707700 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707190 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 05 00:08:51.707700 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707200 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-host-run-multus-certs\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.707700 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707214 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-run-openvswitch\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.707700 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707229 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dvxk\" (UniqueName: \"kubernetes.io/projected/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-kube-api-access-2dvxk\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.707700 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707242 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-hostroot\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.707700 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707258 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbw6l\" (UniqueName: \"kubernetes.io/projected/d761a174-9f01-4bb2-aa2d-76a540929c2d-kube-api-access-gbw6l\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.707700 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707272 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lqcj\" (UniqueName: \"kubernetes.io/projected/107f4ca7-7252-4983-9468-ba558c9e9e58-kube-api-access-8lqcj\") pod \"network-metrics-daemon-tlll9\" (UID: \"107f4ca7-7252-4983-9468-ba558c9e9e58\") " pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:08:51.707700 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707284 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-run\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.707700 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707298 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd7xp\" (UniqueName: \"kubernetes.io/projected/41b995eb-3ced-434b-86d9-a4095f68577a-kube-api-access-xd7xp\") pod \"aws-ebs-csi-driver-node-zdwbz\" (UID: \"41b995eb-3ced-434b-86d9-a4095f68577a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" Jul 05 00:08:51.707700 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707310 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-cnibin\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.707700 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707323 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/25833488-5ae4-4ff9-8eaf-cc1107922763-ovnkube-config\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.708304 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707351 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0d61705e-33be-4264-85b4-8edce04fffbd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.708304 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707370 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-etc-tuned\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.708304 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707383 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f25f798-bb34-44b4-83e2-19ab8622e667-konnectivity-ca\") pod \"konnectivity-agent-qp7vx\" (UID: \"7f25f798-bb34-44b4-83e2-19ab8622e667\") " pod="kube-system/konnectivity-agent-qp7vx" Jul 05 00:08:51.708304 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707402 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-system-cni-dir\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.708304 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707427 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-host-slash\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.708304 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707451 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d761a174-9f01-4bb2-aa2d-76a540929c2d-multus-daemon-config\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.708304 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707472 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs\") pod \"network-metrics-daemon-tlll9\" (UID: \"107f4ca7-7252-4983-9468-ba558c9e9e58\") " pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:08:51.708304 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707495 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0d61705e-33be-4264-85b4-8edce04fffbd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.708304 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707519 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-etc-sysconfig\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.708304 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707541 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-etc-sysctl-d\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.708304 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707568 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-etc-sysctl-conf\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.708304 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707577 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z47bv\"" Jul 05 00:08:51.708304 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707589 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-host\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.708304 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707618 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/41b995eb-3ced-434b-86d9-a4095f68577a-device-dir\") pod \"aws-ebs-csi-driver-node-zdwbz\" (UID: \"41b995eb-3ced-434b-86d9-a4095f68577a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" Jul 05 00:08:51.708895 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707644 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-host-kubelet\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.708895 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707671 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 05 00:08:51.708895 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707669 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-run-ovn\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.708895 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707721 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.708895 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707748 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-sys\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.708895 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707775 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/027126e8-e72a-47f9-9edd-19eee423b6b0-iptables-alerter-script\") pod \"iptables-alerter-zrxdw\" (UID: \"027126e8-e72a-47f9-9edd-19eee423b6b0\") " pod="openshift-network-operator/iptables-alerter-zrxdw" Jul 05 00:08:51.708895 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707816 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-etc-kubernetes\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.708895 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707840 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/25833488-5ae4-4ff9-8eaf-cc1107922763-ovnkube-script-lib\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.708895 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707879 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnlkc\" (UniqueName: \"kubernetes.io/projected/25833488-5ae4-4ff9-8eaf-cc1107922763-kube-api-access-rnlkc\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.708895 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707908 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d61705e-33be-4264-85b4-8edce04fffbd-cni-binary-copy\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.708895 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.707950 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 05 00:08:51.710554 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.710537 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 05 00:08:51.759674 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.759653 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4n58t" Jul 05 00:08:51.771403 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.771372 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4n58t" Jul 05 00:08:51.775501 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.775457 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-188.ec2.internal" event={"ID":"7d89021ce33a5b1f6d6abbda92c13ccc","Type":"ContainerStarted","Data":"74cd16d1ec3d688ab636536f858dcb8853f69766f02997a4b95810d2758ca1ee"} Jul 05 00:08:51.776713 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.776684 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-188.ec2.internal" event={"ID":"4d98373d2705b464e11a31bbc31f03dd","Type":"ContainerStarted","Data":"bce5294e0ef61e224df25a4f564da151ec2b38eb26a0cd3d3d1e1d281e83640c"} Jul 05 00:08:51.797983 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.797968 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 05 00:08:51.808156 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808129 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzfgv\" (UniqueName: \"kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv\") pod \"network-check-target-t4ppn\" (UID: \"f2c0c53b-05d0-4dce-844b-95ce6cff9a0f\") " pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:08:51.808247 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808166 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-lib-modules\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.808247 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808186 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-tmp\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.808247 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808211 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-multus-socket-dir-parent\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.808247 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808233 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-host-run-netns\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.808434 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808251 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d61705e-33be-4264-85b4-8edce04fffbd-system-cni-dir\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.808434 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808266 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d61705e-33be-4264-85b4-8edce04fffbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.808434 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808280 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f25f798-bb34-44b4-83e2-19ab8622e667-agent-certs\") pod \"konnectivity-agent-qp7vx\" (UID: \"7f25f798-bb34-44b4-83e2-19ab8622e667\") " pod="kube-system/konnectivity-agent-qp7vx" Jul 05 00:08:51.808434 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808293 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-run-systemd\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.808434 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808308 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-host-cni-netd\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.808434 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808324 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-etc-modprobe-d\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.808434 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808353 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-etc-systemd\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.808434 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808351 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d61705e-33be-4264-85b4-8edce04fffbd-system-cni-dir\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.808434 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808373 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxhrs\" (UniqueName: \"kubernetes.io/projected/027126e8-e72a-47f9-9edd-19eee423b6b0-kube-api-access-cxhrs\") pod \"iptables-alerter-zrxdw\" (UID: \"027126e8-e72a-47f9-9edd-19eee423b6b0\") " pod="openshift-network-operator/iptables-alerter-zrxdw" Jul 05 00:08:51.808434 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808395 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/41b995eb-3ced-434b-86d9-a4095f68577a-sys-fs\") pod \"aws-ebs-csi-driver-node-zdwbz\" (UID: \"41b995eb-3ced-434b-86d9-a4095f68577a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" Jul 05 00:08:51.808434 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808414 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-host-run-netns\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.808434 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808416 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-host-run-k8s-cni-cncf-io\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.808986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808457 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3f73c87-0938-4904-8db7-e28345166dd1-kubelet-config\") pod \"global-pull-secret-syncer-dxsxs\" (UID: \"d3f73c87-0938-4904-8db7-e28345166dd1\") " pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:08:51.808986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808486 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/962c613c-ccfc-4bdd-aded-f0978bc0b8ab-tmp-dir\") pod \"node-resolver-m6rgl\" (UID: \"962c613c-ccfc-4bdd-aded-f0978bc0b8ab\") " pod="openshift-dns/node-resolver-m6rgl" Jul 05 00:08:51.808986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808505 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6slpb\" (UniqueName: \"kubernetes.io/projected/962c613c-ccfc-4bdd-aded-f0978bc0b8ab-kube-api-access-6slpb\") pod \"node-resolver-m6rgl\" (UID: \"962c613c-ccfc-4bdd-aded-f0978bc0b8ab\") " pod="openshift-dns/node-resolver-m6rgl" Jul 05 00:08:51.808986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808507 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d61705e-33be-4264-85b4-8edce04fffbd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.808986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808522 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/027126e8-e72a-47f9-9edd-19eee423b6b0-host-slash\") pod \"iptables-alerter-zrxdw\" (UID: \"027126e8-e72a-47f9-9edd-19eee423b6b0\") " pod="openshift-network-operator/iptables-alerter-zrxdw" Jul 05 00:08:51.808986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808544 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/027126e8-e72a-47f9-9edd-19eee423b6b0-host-slash\") pod \"iptables-alerter-zrxdw\" (UID: \"027126e8-e72a-47f9-9edd-19eee423b6b0\") " pod="openshift-network-operator/iptables-alerter-zrxdw" Jul 05 00:08:51.808986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808542 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-etc-modprobe-d\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.808986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808557 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-var-lib-openvswitch\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.808986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808526 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 05 00:08:51.808986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808599 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-var-lib-openvswitch\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.808986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808633 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-host-run-k8s-cni-cncf-io\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.808986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808660 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-multus-socket-dir-parent\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.808986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808675 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-run-systemd\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.808986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808722 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-host-cni-netd\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.808986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808745 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-etc-systemd\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.809533 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808822 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/41b995eb-3ced-434b-86d9-a4095f68577a-sys-fs\") pod \"aws-ebs-csi-driver-node-zdwbz\" (UID: \"41b995eb-3ced-434b-86d9-a4095f68577a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" Jul 05 00:08:51.809533 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808828 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret\") pod \"global-pull-secret-syncer-dxsxs\" (UID: \"d3f73c87-0938-4904-8db7-e28345166dd1\") " pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:08:51.809533 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808836 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/962c613c-ccfc-4bdd-aded-f0978bc0b8ab-tmp-dir\") pod \"node-resolver-m6rgl\" (UID: \"962c613c-ccfc-4bdd-aded-f0978bc0b8ab\") " pod="openshift-dns/node-resolver-m6rgl" Jul 05 00:08:51.809533 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808876 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d761a174-9f01-4bb2-aa2d-76a540929c2d-cni-binary-copy\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.809533 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808902 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-host-var-lib-kubelet\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.809533 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808915 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-lib-modules\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.809533 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808925 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-log-socket\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.809533 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808957 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-host-var-lib-kubelet\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.809533 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808948 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d61705e-33be-4264-85b4-8edce04fffbd-cnibin\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.809533 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808985 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-log-socket\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.809533 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.808992 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a9a304be-a49e-4a1a-983e-7ade1cc7ea10-serviceca\") pod \"node-ca-lz9th\" (UID: \"a9a304be-a49e-4a1a-983e-7ade1cc7ea10\") " pod="openshift-image-registry/node-ca-lz9th" Jul 05 00:08:51.809533 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809016 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/41b995eb-3ced-434b-86d9-a4095f68577a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zdwbz\" (UID: \"41b995eb-3ced-434b-86d9-a4095f68577a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" Jul 05 00:08:51.809533 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809030 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d61705e-33be-4264-85b4-8edce04fffbd-cnibin\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.809533 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809040 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/41b995eb-3ced-434b-86d9-a4095f68577a-registration-dir\") pod \"aws-ebs-csi-driver-node-zdwbz\" (UID: \"41b995eb-3ced-434b-86d9-a4095f68577a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" Jul 05 00:08:51.810147 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809064 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d61705e-33be-4264-85b4-8edce04fffbd-os-release\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.810147 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809084 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/41b995eb-3ced-434b-86d9-a4095f68577a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zdwbz\" (UID: \"41b995eb-3ced-434b-86d9-a4095f68577a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" Jul 05 00:08:51.810147 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809087 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/962c613c-ccfc-4bdd-aded-f0978bc0b8ab-hosts-file\") pod \"node-resolver-m6rgl\" (UID: \"962c613c-ccfc-4bdd-aded-f0978bc0b8ab\") " pod="openshift-dns/node-resolver-m6rgl" Jul 05 00:08:51.810147 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809121 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-multus-conf-dir\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.810147 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809136 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/962c613c-ccfc-4bdd-aded-f0978bc0b8ab-hosts-file\") pod \"node-resolver-m6rgl\" (UID: \"962c613c-ccfc-4bdd-aded-f0978bc0b8ab\") " pod="openshift-dns/node-resolver-m6rgl" Jul 05 00:08:51.810147 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809145 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-systemd-units\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.810147 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809151 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/41b995eb-3ced-434b-86d9-a4095f68577a-registration-dir\") pod \"aws-ebs-csi-driver-node-zdwbz\" (UID: \"41b995eb-3ced-434b-86d9-a4095f68577a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" Jul 05 00:08:51.810147 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809179 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-host-run-ovn-kubernetes\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.810147 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809184 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-multus-conf-dir\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.810147 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809195 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d61705e-33be-4264-85b4-8edce04fffbd-os-release\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.810147 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809206 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-host-run-multus-certs\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.810147 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809221 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-systemd-units\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.810147 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809234 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-host-run-ovn-kubernetes\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.810147 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809234 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-run-openvswitch\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.810147 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809257 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-host-run-multus-certs\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.810844 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809264 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-run-openvswitch\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.810844 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809265 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3f73c87-0938-4904-8db7-e28345166dd1-dbus\") pod \"global-pull-secret-syncer-dxsxs\" (UID: \"d3f73c87-0938-4904-8db7-e28345166dd1\") " pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:08:51.810844 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809299 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dvxk\" (UniqueName: \"kubernetes.io/projected/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-kube-api-access-2dvxk\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.810844 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-hostroot\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.810844 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809376 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbw6l\" (UniqueName: \"kubernetes.io/projected/d761a174-9f01-4bb2-aa2d-76a540929c2d-kube-api-access-gbw6l\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.810844 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809401 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lqcj\" (UniqueName: \"kubernetes.io/projected/107f4ca7-7252-4983-9468-ba558c9e9e58-kube-api-access-8lqcj\") pod \"network-metrics-daemon-tlll9\" (UID: \"107f4ca7-7252-4983-9468-ba558c9e9e58\") " pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:08:51.810844 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809423 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-run\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.810844 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809431 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-hostroot\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.810844 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809445 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd7xp\" (UniqueName: \"kubernetes.io/projected/41b995eb-3ced-434b-86d9-a4095f68577a-kube-api-access-xd7xp\") pod \"aws-ebs-csi-driver-node-zdwbz\" (UID: \"41b995eb-3ced-434b-86d9-a4095f68577a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" Jul 05 00:08:51.810844 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809468 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-cnibin\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.810844 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/25833488-5ae4-4ff9-8eaf-cc1107922763-ovnkube-config\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.810844 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809516 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-run\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.810844 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809516 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0d61705e-33be-4264-85b4-8edce04fffbd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.810844 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809553 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-etc-tuned\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.810844 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809562 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d761a174-9f01-4bb2-aa2d-76a540929c2d-cni-binary-copy\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.811531 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809576 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f25f798-bb34-44b4-83e2-19ab8622e667-konnectivity-ca\") pod \"konnectivity-agent-qp7vx\" (UID: \"7f25f798-bb34-44b4-83e2-19ab8622e667\") " pod="kube-system/konnectivity-agent-qp7vx" Jul 05 00:08:51.811531 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809604 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-system-cni-dir\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.811531 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809646 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-host-slash\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.811531 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809673 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d761a174-9f01-4bb2-aa2d-76a540929c2d-multus-daemon-config\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.811531 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809670 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-cnibin\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.811531 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809705 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-host-slash\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.811531 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809729 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs\") pod \"network-metrics-daemon-tlll9\" (UID: \"107f4ca7-7252-4983-9468-ba558c9e9e58\") " pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:08:51.811531 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809759 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-system-cni-dir\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.811531 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809816 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0d61705e-33be-4264-85b4-8edce04fffbd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.811531 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809845 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-etc-sysconfig\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.811531 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809869 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-etc-sysctl-d\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.811531 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809938 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-etc-sysctl-conf\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.811531 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809965 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-host\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.811531 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.809987 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/41b995eb-3ced-434b-86d9-a4095f68577a-device-dir\") pod \"aws-ebs-csi-driver-node-zdwbz\" (UID: \"41b995eb-3ced-434b-86d9-a4095f68577a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" Jul 05 00:08:51.811531 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810010 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-host-kubelet\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.812225 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810033 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-run-ovn\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.812225 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810065 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.812225 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810090 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0d61705e-33be-4264-85b4-8edce04fffbd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.812225 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810137 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-sys\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.812225 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810163 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/027126e8-e72a-47f9-9edd-19eee423b6b0-iptables-alerter-script\") pod \"iptables-alerter-zrxdw\" (UID: \"027126e8-e72a-47f9-9edd-19eee423b6b0\") " pod="openshift-network-operator/iptables-alerter-zrxdw" Jul 05 00:08:51.812225 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:51.810180 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 00:08:51.812225 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810186 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-etc-kubernetes\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.812225 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810211 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/25833488-5ae4-4ff9-8eaf-cc1107922763-ovnkube-script-lib\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.812225 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810230 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d761a174-9f01-4bb2-aa2d-76a540929c2d-multus-daemon-config\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.812225 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810236 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnlkc\" (UniqueName: \"kubernetes.io/projected/25833488-5ae4-4ff9-8eaf-cc1107922763-kube-api-access-rnlkc\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.812225 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810285 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-host\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.812225 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:51.810293 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs podName:107f4ca7-7252-4983-9468-ba558c9e9e58 nodeName:}" failed. No retries permitted until 2026-07-05 00:08:52.310254227 +0000 UTC m=+3.035270278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs") pod "network-metrics-daemon-tlll9" (UID: "107f4ca7-7252-4983-9468-ba558c9e9e58") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 00:08:51.812225 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810312 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d61705e-33be-4264-85b4-8edce04fffbd-cni-binary-copy\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.812225 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810335 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/41b995eb-3ced-434b-86d9-a4095f68577a-device-dir\") pod \"aws-ebs-csi-driver-node-zdwbz\" (UID: \"41b995eb-3ced-434b-86d9-a4095f68577a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" Jul 05 00:08:51.812910 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810340 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a9a304be-a49e-4a1a-983e-7ade1cc7ea10-host\") pod \"node-ca-lz9th\" (UID: \"a9a304be-a49e-4a1a-983e-7ade1cc7ea10\") " pod="openshift-image-registry/node-ca-lz9th" Jul 05 00:08:51.812910 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810392 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-host-kubelet\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.812910 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810397 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-run-ovn\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.812910 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810401 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-etc-kubernetes\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.812910 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810438 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/25833488-5ae4-4ff9-8eaf-cc1107922763-ovnkube-config\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.812910 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810464 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.812910 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810445 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-sys\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.812910 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810514 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-etc-sysctl-d\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.812910 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810519 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-etc-sysconfig\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.812910 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810602 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-os-release\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.812910 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810629 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-host-var-lib-cni-bin\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.812910 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810652 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-host-var-lib-cni-multus\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.812910 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810697 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-etc-sysctl-conf\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.812910 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810701 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-etc-openvswitch\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.812910 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810726 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-node-log\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.813463 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810749 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-etc-kubernetes\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.813463 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810773 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-var-lib-kubelet\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.813463 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810821 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/41b995eb-3ced-434b-86d9-a4095f68577a-socket-dir\") pod \"aws-ebs-csi-driver-node-zdwbz\" (UID: \"41b995eb-3ced-434b-86d9-a4095f68577a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" Jul 05 00:08:51.813463 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810884 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/41b995eb-3ced-434b-86d9-a4095f68577a-etc-selinux\") pod \"aws-ebs-csi-driver-node-zdwbz\" (UID: \"41b995eb-3ced-434b-86d9-a4095f68577a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" Jul 05 00:08:51.813463 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810909 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-multus-cni-dir\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.813463 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810935 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-host-run-netns\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.813463 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810960 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-host-cni-bin\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.813463 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810986 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5nn5\" (UniqueName: \"kubernetes.io/projected/a9a304be-a49e-4a1a-983e-7ade1cc7ea10-kube-api-access-v5nn5\") pod \"node-ca-lz9th\" (UID: \"a9a304be-a49e-4a1a-983e-7ade1cc7ea10\") " pod="openshift-image-registry/node-ca-lz9th" Jul 05 00:08:51.813463 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810995 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-host-var-lib-cni-bin\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.813463 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.811015 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/25833488-5ae4-4ff9-8eaf-cc1107922763-env-overrides\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.813463 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.811021 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-host-var-lib-cni-multus\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.813463 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.811049 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-os-release\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.813463 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.811050 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/25833488-5ae4-4ff9-8eaf-cc1107922763-ovn-node-metrics-cert\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.813463 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.811064 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-etc-openvswitch\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.813975 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.811087 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97rfm\" (UniqueName: \"kubernetes.io/projected/0d61705e-33be-4264-85b4-8edce04fffbd-kube-api-access-97rfm\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.813975 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.811131 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-etc-kubernetes\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.813975 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.811154 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/41b995eb-3ced-434b-86d9-a4095f68577a-socket-dir\") pod \"aws-ebs-csi-driver-node-zdwbz\" (UID: \"41b995eb-3ced-434b-86d9-a4095f68577a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" Jul 05 00:08:51.813975 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.811179 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-var-lib-kubelet\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.813975 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.811179 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d61705e-33be-4264-85b4-8edce04fffbd-cni-binary-copy\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.813975 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.811192 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-node-log\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.813975 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.811188 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7f25f798-bb34-44b4-83e2-19ab8622e667-konnectivity-ca\") pod \"konnectivity-agent-qp7vx\" (UID: \"7f25f798-bb34-44b4-83e2-19ab8622e667\") " pod="kube-system/konnectivity-agent-qp7vx" Jul 05 00:08:51.813975 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.811253 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/41b995eb-3ced-434b-86d9-a4095f68577a-etc-selinux\") pod \"aws-ebs-csi-driver-node-zdwbz\" (UID: \"41b995eb-3ced-434b-86d9-a4095f68577a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" Jul 05 00:08:51.813975 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.811253 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-host-run-netns\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.813975 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.810990 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/25833488-5ae4-4ff9-8eaf-cc1107922763-ovnkube-script-lib\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.813975 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.811292 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25833488-5ae4-4ff9-8eaf-cc1107922763-host-cni-bin\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.813975 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.811339 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d761a174-9f01-4bb2-aa2d-76a540929c2d-multus-cni-dir\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.813975 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.811589 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0d61705e-33be-4264-85b4-8edce04fffbd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.813975 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.811643 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/25833488-5ae4-4ff9-8eaf-cc1107922763-env-overrides\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.814459 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.811711 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/027126e8-e72a-47f9-9edd-19eee423b6b0-iptables-alerter-script\") pod \"iptables-alerter-zrxdw\" (UID: \"027126e8-e72a-47f9-9edd-19eee423b6b0\") " pod="openshift-network-operator/iptables-alerter-zrxdw" Jul 05 00:08:51.814459 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.812294 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-tmp\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.814459 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.812538 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7f25f798-bb34-44b4-83e2-19ab8622e667-agent-certs\") pod \"konnectivity-agent-qp7vx\" (UID: \"7f25f798-bb34-44b4-83e2-19ab8622e667\") " pod="kube-system/konnectivity-agent-qp7vx" Jul 05 00:08:51.814459 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.813220 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-etc-tuned\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.814459 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.813518 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/25833488-5ae4-4ff9-8eaf-cc1107922763-ovn-node-metrics-cert\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.817518 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.817495 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxhrs\" (UniqueName: \"kubernetes.io/projected/027126e8-e72a-47f9-9edd-19eee423b6b0-kube-api-access-cxhrs\") pod \"iptables-alerter-zrxdw\" (UID: \"027126e8-e72a-47f9-9edd-19eee423b6b0\") " pod="openshift-network-operator/iptables-alerter-zrxdw" Jul 05 00:08:51.817787 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.817749 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6slpb\" (UniqueName: \"kubernetes.io/projected/962c613c-ccfc-4bdd-aded-f0978bc0b8ab-kube-api-access-6slpb\") pod \"node-resolver-m6rgl\" (UID: \"962c613c-ccfc-4bdd-aded-f0978bc0b8ab\") " pod="openshift-dns/node-resolver-m6rgl" Jul 05 00:08:51.817938 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.817901 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dvxk\" (UniqueName: \"kubernetes.io/projected/f34cbf2c-82c6-4635-bb89-7dd9c60f74de-kube-api-access-2dvxk\") pod \"tuned-62fb7\" (UID: \"f34cbf2c-82c6-4635-bb89-7dd9c60f74de\") " pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:51.820861 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.820456 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbw6l\" (UniqueName: \"kubernetes.io/projected/d761a174-9f01-4bb2-aa2d-76a540929c2d-kube-api-access-gbw6l\") pod \"multus-zr9vn\" (UID: \"d761a174-9f01-4bb2-aa2d-76a540929c2d\") " pod="openshift-multus/multus-zr9vn" Jul 05 00:08:51.820861 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.820822 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lqcj\" (UniqueName: \"kubernetes.io/projected/107f4ca7-7252-4983-9468-ba558c9e9e58-kube-api-access-8lqcj\") pod \"network-metrics-daemon-tlll9\" (UID: \"107f4ca7-7252-4983-9468-ba558c9e9e58\") " pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:08:51.821095 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.821074 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97rfm\" (UniqueName: \"kubernetes.io/projected/0d61705e-33be-4264-85b4-8edce04fffbd-kube-api-access-97rfm\") pod \"multus-additional-cni-plugins-99xdd\" (UID: \"0d61705e-33be-4264-85b4-8edce04fffbd\") " pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:51.821261 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.821241 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnlkc\" (UniqueName: \"kubernetes.io/projected/25833488-5ae4-4ff9-8eaf-cc1107922763-kube-api-access-rnlkc\") pod \"ovnkube-node-t2zpd\" (UID: \"25833488-5ae4-4ff9-8eaf-cc1107922763\") " pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.821657 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.821637 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd7xp\" (UniqueName: \"kubernetes.io/projected/41b995eb-3ced-434b-86d9-a4095f68577a-kube-api-access-xd7xp\") pod \"aws-ebs-csi-driver-node-zdwbz\" (UID: \"41b995eb-3ced-434b-86d9-a4095f68577a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" Jul 05 00:08:51.912539 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.912507 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3f73c87-0938-4904-8db7-e28345166dd1-dbus\") pod \"global-pull-secret-syncer-dxsxs\" (UID: \"d3f73c87-0938-4904-8db7-e28345166dd1\") " pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:08:51.912677 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.912558 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a9a304be-a49e-4a1a-983e-7ade1cc7ea10-host\") pod \"node-ca-lz9th\" (UID: \"a9a304be-a49e-4a1a-983e-7ade1cc7ea10\") " pod="openshift-image-registry/node-ca-lz9th" Jul 05 00:08:51.912677 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.912587 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5nn5\" (UniqueName: \"kubernetes.io/projected/a9a304be-a49e-4a1a-983e-7ade1cc7ea10-kube-api-access-v5nn5\") pod \"node-ca-lz9th\" (UID: \"a9a304be-a49e-4a1a-983e-7ade1cc7ea10\") " pod="openshift-image-registry/node-ca-lz9th" Jul 05 00:08:51.912677 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.912613 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzfgv\" (UniqueName: \"kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv\") pod \"network-check-target-t4ppn\" (UID: \"f2c0c53b-05d0-4dce-844b-95ce6cff9a0f\") " pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:08:51.912677 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.912639 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a9a304be-a49e-4a1a-983e-7ade1cc7ea10-host\") pod \"node-ca-lz9th\" (UID: \"a9a304be-a49e-4a1a-983e-7ade1cc7ea10\") " pod="openshift-image-registry/node-ca-lz9th" Jul 05 00:08:51.912677 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.912644 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3f73c87-0938-4904-8db7-e28345166dd1-kubelet-config\") pod \"global-pull-secret-syncer-dxsxs\" (UID: \"d3f73c87-0938-4904-8db7-e28345166dd1\") " pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:08:51.912677 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.912646 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3f73c87-0938-4904-8db7-e28345166dd1-dbus\") pod \"global-pull-secret-syncer-dxsxs\" (UID: \"d3f73c87-0938-4904-8db7-e28345166dd1\") " pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:08:51.913007 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.912681 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret\") pod \"global-pull-secret-syncer-dxsxs\" (UID: \"d3f73c87-0938-4904-8db7-e28345166dd1\") " pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:08:51.913007 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.912693 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3f73c87-0938-4904-8db7-e28345166dd1-kubelet-config\") pod \"global-pull-secret-syncer-dxsxs\" (UID: \"d3f73c87-0938-4904-8db7-e28345166dd1\") " pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:08:51.913007 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.912712 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a9a304be-a49e-4a1a-983e-7ade1cc7ea10-serviceca\") pod \"node-ca-lz9th\" (UID: \"a9a304be-a49e-4a1a-983e-7ade1cc7ea10\") " pod="openshift-image-registry/node-ca-lz9th" Jul 05 00:08:51.913007 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:51.912768 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 00:08:51.913007 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:51.912838 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret podName:d3f73c87-0938-4904-8db7-e28345166dd1 nodeName:}" failed. No retries permitted until 2026-07-05 00:08:52.412821364 +0000 UTC m=+3.137837419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret") pod "global-pull-secret-syncer-dxsxs" (UID: "d3f73c87-0938-4904-8db7-e28345166dd1") : object "kube-system"/"original-pull-secret" not registered Jul 05 00:08:51.913193 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.913170 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a9a304be-a49e-4a1a-983e-7ade1cc7ea10-serviceca\") pod \"node-ca-lz9th\" (UID: \"a9a304be-a49e-4a1a-983e-7ade1cc7ea10\") " pod="openshift-image-registry/node-ca-lz9th" Jul 05 00:08:51.918730 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:51.918708 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 00:08:51.918837 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:51.918736 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 00:08:51.918837 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:51.918749 2561 projected.go:196] Error preparing data for projected volume kube-api-access-gzfgv for pod openshift-network-diagnostics/network-check-target-t4ppn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 00:08:51.918837 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:51.918821 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv podName:f2c0c53b-05d0-4dce-844b-95ce6cff9a0f nodeName:}" failed. No retries permitted until 2026-07-05 00:08:52.418791129 +0000 UTC m=+3.143807184 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gzfgv" (UniqueName: "kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv") pod "network-check-target-t4ppn" (UID: "f2c0c53b-05d0-4dce-844b-95ce6cff9a0f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 00:08:51.921170 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.921108 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5nn5\" (UniqueName: \"kubernetes.io/projected/a9a304be-a49e-4a1a-983e-7ade1cc7ea10-kube-api-access-v5nn5\") pod \"node-ca-lz9th\" (UID: \"a9a304be-a49e-4a1a-983e-7ade1cc7ea10\") " pod="openshift-image-registry/node-ca-lz9th" Jul 05 00:08:51.988004 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.987980 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:08:51.997561 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:51.997539 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25833488_5ae4_4ff9_8eaf_cc1107922763.slice/crio-45f960a49bc43a02932e71edb51126bba593dff43eff2ecd74db8db9e3bd5395 WatchSource:0}: Error finding container 45f960a49bc43a02932e71edb51126bba593dff43eff2ecd74db8db9e3bd5395: Status 404 returned error can't find the container with id 45f960a49bc43a02932e71edb51126bba593dff43eff2ecd74db8db9e3bd5395 Jul 05 00:08:51.999565 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:51.999402 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qp7vx" Jul 05 00:08:52.007730 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:52.007709 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zr9vn" Jul 05 00:08:52.009120 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:52.009095 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f25f798_bb34_44b4_83e2_19ab8622e667.slice/crio-de27342f09a5a6ea224bb73e5673e5eecd8f80ff2c75a2ff1010df2172170453 WatchSource:0}: Error finding container de27342f09a5a6ea224bb73e5673e5eecd8f80ff2c75a2ff1010df2172170453: Status 404 returned error can't find the container with id de27342f09a5a6ea224bb73e5673e5eecd8f80ff2c75a2ff1010df2172170453 Jul 05 00:08:52.012559 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:52.012432 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-99xdd" Jul 05 00:08:52.017380 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:52.017358 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m6rgl" Jul 05 00:08:52.017664 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:52.017641 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd761a174_9f01_4bb2_aa2d_76a540929c2d.slice/crio-b9fb33a73caf345eb8278a8560f5a958a9b907717c226b555a17a28b60fcd9b8 WatchSource:0}: Error finding container b9fb33a73caf345eb8278a8560f5a958a9b907717c226b555a17a28b60fcd9b8: Status 404 returned error can't find the container with id b9fb33a73caf345eb8278a8560f5a958a9b907717c226b555a17a28b60fcd9b8 Jul 05 00:08:52.022235 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:52.022203 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d61705e_33be_4264_85b4_8edce04fffbd.slice/crio-4d1eed79255dbd03cededbe75dca820b867baea0fc845a6500fb6470ae9933af WatchSource:0}: Error finding container 4d1eed79255dbd03cededbe75dca820b867baea0fc845a6500fb6470ae9933af: Status 404 returned error can't find the container with id 4d1eed79255dbd03cededbe75dca820b867baea0fc845a6500fb6470ae9933af Jul 05 00:08:52.023261 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:52.023102 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-62fb7" Jul 05 00:08:52.027944 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:52.027606 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod962c613c_ccfc_4bdd_aded_f0978bc0b8ab.slice/crio-737cd951ce355d5d59855940ca631ea542e168b7173cfdcb390f46fbca58456c WatchSource:0}: Error finding container 737cd951ce355d5d59855940ca631ea542e168b7173cfdcb390f46fbca58456c: Status 404 returned error can't find the container with id 737cd951ce355d5d59855940ca631ea542e168b7173cfdcb390f46fbca58456c Jul 05 00:08:52.029168 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:52.028244 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zrxdw" Jul 05 00:08:52.033362 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:52.033327 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf34cbf2c_82c6_4635_bb89_7dd9c60f74de.slice/crio-3d2d5819ba0ee567711849b84b57b4f69c2bb4fe85ecfe609ccfc4182d058d61 WatchSource:0}: Error finding container 3d2d5819ba0ee567711849b84b57b4f69c2bb4fe85ecfe609ccfc4182d058d61: Status 404 returned error can't find the container with id 3d2d5819ba0ee567711849b84b57b4f69c2bb4fe85ecfe609ccfc4182d058d61 Jul 05 00:08:52.034318 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:52.034296 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" Jul 05 00:08:52.038556 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:52.038537 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lz9th" Jul 05 00:08:52.048767 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:52.048721 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b995eb_3ced_434b_86d9_a4095f68577a.slice/crio-ecd110f1eb64b098f973ce43a68aaea7a2451b17b735599256e2e6744bd90268 WatchSource:0}: Error finding container ecd110f1eb64b098f973ce43a68aaea7a2451b17b735599256e2e6744bd90268: Status 404 returned error can't find the container with id ecd110f1eb64b098f973ce43a68aaea7a2451b17b735599256e2e6744bd90268 Jul 05 00:08:52.053184 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:08:52.053161 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9a304be_a49e_4a1a_983e_7ade1cc7ea10.slice/crio-2011a1b1da835486300b3b49137c3460fa17becde038749f32c0722a9bec3603 WatchSource:0}: Error finding container 2011a1b1da835486300b3b49137c3460fa17becde038749f32c0722a9bec3603: Status 404 returned error can't find the container with id 2011a1b1da835486300b3b49137c3460fa17becde038749f32c0722a9bec3603 Jul 05 00:08:52.205421 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:52.205361 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 00:08:52.315871 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:52.315838 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs\") pod \"network-metrics-daemon-tlll9\" (UID: \"107f4ca7-7252-4983-9468-ba558c9e9e58\") " pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:08:52.316037 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:52.315993 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 00:08:52.316099 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:52.316050 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs podName:107f4ca7-7252-4983-9468-ba558c9e9e58 nodeName:}" failed. No retries permitted until 2026-07-05 00:08:53.316030386 +0000 UTC m=+4.041046435 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs") pod "network-metrics-daemon-tlll9" (UID: "107f4ca7-7252-4983-9468-ba558c9e9e58") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 00:08:52.416249 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:52.416212 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret\") pod \"global-pull-secret-syncer-dxsxs\" (UID: \"d3f73c87-0938-4904-8db7-e28345166dd1\") " pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:08:52.416406 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:52.416348 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 00:08:52.416406 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:52.416399 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret podName:d3f73c87-0938-4904-8db7-e28345166dd1 nodeName:}" failed. No retries permitted until 2026-07-05 00:08:53.416382989 +0000 UTC m=+4.141399028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret") pod "global-pull-secret-syncer-dxsxs" (UID: "d3f73c87-0938-4904-8db7-e28345166dd1") : object "kube-system"/"original-pull-secret" not registered Jul 05 00:08:52.510674 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:52.510597 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 00:08:52.517212 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:52.517185 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzfgv\" (UniqueName: \"kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv\") pod \"network-check-target-t4ppn\" (UID: \"f2c0c53b-05d0-4dce-844b-95ce6cff9a0f\") " pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:08:52.517359 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:52.517336 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 00:08:52.517359 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:52.517351 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 00:08:52.517359 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:52.517360 2561 projected.go:196] Error preparing data for projected volume kube-api-access-gzfgv for pod openshift-network-diagnostics/network-check-target-t4ppn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 00:08:52.517522 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:52.517404 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv podName:f2c0c53b-05d0-4dce-844b-95ce6cff9a0f nodeName:}" failed. No retries permitted until 2026-07-05 00:08:53.517390436 +0000 UTC m=+4.242406474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzfgv" (UniqueName: "kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv") pod "network-check-target-t4ppn" (UID: "f2c0c53b-05d0-4dce-844b-95ce6cff9a0f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 00:08:52.774385 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:52.774257 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 00:03:51 +0000 UTC" deadline="2028-02-26 19:46:11.770289997 +0000 UTC" Jul 05 00:08:52.774385 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:52.774333 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14443h37m18.995961007s" Jul 05 00:08:52.780175 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:52.780140 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lz9th" event={"ID":"a9a304be-a49e-4a1a-983e-7ade1cc7ea10","Type":"ContainerStarted","Data":"2011a1b1da835486300b3b49137c3460fa17becde038749f32c0722a9bec3603"} Jul 05 00:08:52.781546 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:52.781519 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zrxdw" event={"ID":"027126e8-e72a-47f9-9edd-19eee423b6b0","Type":"ContainerStarted","Data":"452da54d5cb06fadf6f34c0352adbcda5be5657469c428ed881e1e31171357a9"} Jul 05 00:08:52.782780 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:52.782759 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-62fb7" event={"ID":"f34cbf2c-82c6-4635-bb89-7dd9c60f74de","Type":"ContainerStarted","Data":"3d2d5819ba0ee567711849b84b57b4f69c2bb4fe85ecfe609ccfc4182d058d61"} Jul 05 00:08:52.784015 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:52.783993 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m6rgl" event={"ID":"962c613c-ccfc-4bdd-aded-f0978bc0b8ab","Type":"ContainerStarted","Data":"737cd951ce355d5d59855940ca631ea542e168b7173cfdcb390f46fbca58456c"} Jul 05 00:08:52.785208 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:52.785180 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zr9vn" event={"ID":"d761a174-9f01-4bb2-aa2d-76a540929c2d","Type":"ContainerStarted","Data":"b9fb33a73caf345eb8278a8560f5a958a9b907717c226b555a17a28b60fcd9b8"} Jul 05 00:08:52.786380 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:52.786339 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qp7vx" event={"ID":"7f25f798-bb34-44b4-83e2-19ab8622e667","Type":"ContainerStarted","Data":"de27342f09a5a6ea224bb73e5673e5eecd8f80ff2c75a2ff1010df2172170453"} Jul 05 00:08:52.787653 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:52.787630 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" event={"ID":"25833488-5ae4-4ff9-8eaf-cc1107922763","Type":"ContainerStarted","Data":"45f960a49bc43a02932e71edb51126bba593dff43eff2ecd74db8db9e3bd5395"} Jul 05 00:08:52.789563 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:52.789537 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" event={"ID":"41b995eb-3ced-434b-86d9-a4095f68577a","Type":"ContainerStarted","Data":"ecd110f1eb64b098f973ce43a68aaea7a2451b17b735599256e2e6744bd90268"} Jul 05 00:08:52.790755 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:52.790730 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99xdd" event={"ID":"0d61705e-33be-4264-85b4-8edce04fffbd","Type":"ContainerStarted","Data":"4d1eed79255dbd03cededbe75dca820b867baea0fc845a6500fb6470ae9933af"} Jul 05 00:08:53.323557 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:53.323523 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs\") pod \"network-metrics-daemon-tlll9\" (UID: \"107f4ca7-7252-4983-9468-ba558c9e9e58\") " pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:08:53.323748 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:53.323661 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 00:08:53.323748 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:53.323719 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs podName:107f4ca7-7252-4983-9468-ba558c9e9e58 nodeName:}" failed. No retries permitted until 2026-07-05 00:08:55.323702152 +0000 UTC m=+6.048718192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs") pod "network-metrics-daemon-tlll9" (UID: "107f4ca7-7252-4983-9468-ba558c9e9e58") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 00:08:53.424588 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:53.424550 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret\") pod \"global-pull-secret-syncer-dxsxs\" (UID: \"d3f73c87-0938-4904-8db7-e28345166dd1\") " pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:08:53.424751 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:53.424698 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 00:08:53.424849 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:53.424760 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret podName:d3f73c87-0938-4904-8db7-e28345166dd1 nodeName:}" failed. No retries permitted until 2026-07-05 00:08:55.424742481 +0000 UTC m=+6.149758533 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret") pod "global-pull-secret-syncer-dxsxs" (UID: "d3f73c87-0938-4904-8db7-e28345166dd1") : object "kube-system"/"original-pull-secret" not registered Jul 05 00:08:53.525027 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:53.524990 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzfgv\" (UniqueName: \"kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv\") pod \"network-check-target-t4ppn\" (UID: \"f2c0c53b-05d0-4dce-844b-95ce6cff9a0f\") " pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:08:53.525226 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:53.525208 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 00:08:53.525307 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:53.525233 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 00:08:53.525307 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:53.525249 2561 projected.go:196] Error preparing data for projected volume kube-api-access-gzfgv for pod openshift-network-diagnostics/network-check-target-t4ppn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 00:08:53.525307 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:53.525304 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv podName:f2c0c53b-05d0-4dce-844b-95ce6cff9a0f nodeName:}" failed. No retries permitted until 2026-07-05 00:08:55.525287411 +0000 UTC m=+6.250303453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzfgv" (UniqueName: "kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv") pod "network-check-target-t4ppn" (UID: "f2c0c53b-05d0-4dce-844b-95ce6cff9a0f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 00:08:53.772937 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:53.772871 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:08:53.773095 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:53.772998 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxsxs" podUID="d3f73c87-0938-4904-8db7-e28345166dd1" Jul 05 00:08:53.773407 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:53.773383 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:08:53.773521 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:53.773492 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlll9" podUID="107f4ca7-7252-4983-9468-ba558c9e9e58" Jul 05 00:08:53.773581 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:53.773556 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:08:53.773639 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:53.773622 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4ppn" podUID="f2c0c53b-05d0-4dce-844b-95ce6cff9a0f" Jul 05 00:08:53.774839 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:53.774807 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 00:03:51 +0000 UTC" deadline="2027-12-06 17:16:38.252795027 +0000 UTC" Jul 05 00:08:53.775222 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:53.774840 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12473h7m44.477960199s" Jul 05 00:08:55.340106 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:55.340074 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs\") pod \"network-metrics-daemon-tlll9\" (UID: \"107f4ca7-7252-4983-9468-ba558c9e9e58\") " pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:08:55.340562 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:55.340224 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 00:08:55.340562 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:55.340279 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs podName:107f4ca7-7252-4983-9468-ba558c9e9e58 nodeName:}" failed. No retries permitted until 2026-07-05 00:08:59.340261738 +0000 UTC m=+10.065277776 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs") pod "network-metrics-daemon-tlll9" (UID: "107f4ca7-7252-4983-9468-ba558c9e9e58") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 00:08:55.441195 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:55.441154 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret\") pod \"global-pull-secret-syncer-dxsxs\" (UID: \"d3f73c87-0938-4904-8db7-e28345166dd1\") " pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:08:55.441359 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:55.441313 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 00:08:55.441433 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:55.441385 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret podName:d3f73c87-0938-4904-8db7-e28345166dd1 nodeName:}" failed. No retries permitted until 2026-07-05 00:08:59.441366335 +0000 UTC m=+10.166382374 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret") pod "global-pull-secret-syncer-dxsxs" (UID: "d3f73c87-0938-4904-8db7-e28345166dd1") : object "kube-system"/"original-pull-secret" not registered Jul 05 00:08:55.542077 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:55.542044 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzfgv\" (UniqueName: \"kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv\") pod \"network-check-target-t4ppn\" (UID: \"f2c0c53b-05d0-4dce-844b-95ce6cff9a0f\") " pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:08:55.542251 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:55.542218 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 00:08:55.542251 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:55.542240 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 00:08:55.542373 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:55.542263 2561 projected.go:196] Error preparing data for projected volume kube-api-access-gzfgv for pod openshift-network-diagnostics/network-check-target-t4ppn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 00:08:55.542373 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:55.542317 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv podName:f2c0c53b-05d0-4dce-844b-95ce6cff9a0f nodeName:}" failed. No retries permitted until 2026-07-05 00:08:59.542300269 +0000 UTC m=+10.267316308 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzfgv" (UniqueName: "kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv") pod "network-check-target-t4ppn" (UID: "f2c0c53b-05d0-4dce-844b-95ce6cff9a0f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 00:08:55.771287 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:55.771210 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:08:55.771451 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:55.771219 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:08:55.771451 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:55.771345 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxsxs" podUID="d3f73c87-0938-4904-8db7-e28345166dd1" Jul 05 00:08:55.771451 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:55.771422 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4ppn" podUID="f2c0c53b-05d0-4dce-844b-95ce6cff9a0f" Jul 05 00:08:55.771451 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:55.771222 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:08:55.771635 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:55.771526 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlll9" podUID="107f4ca7-7252-4983-9468-ba558c9e9e58" Jul 05 00:08:57.771404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:57.771364 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:08:57.771852 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:57.771382 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:08:57.771852 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:57.771486 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4ppn" podUID="f2c0c53b-05d0-4dce-844b-95ce6cff9a0f" Jul 05 00:08:57.771852 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:57.771494 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:08:57.771852 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:57.771591 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxsxs" podUID="d3f73c87-0938-4904-8db7-e28345166dd1" Jul 05 00:08:57.771852 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:57.771686 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlll9" podUID="107f4ca7-7252-4983-9468-ba558c9e9e58" Jul 05 00:08:59.374611 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:59.374574 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs\") pod \"network-metrics-daemon-tlll9\" (UID: \"107f4ca7-7252-4983-9468-ba558c9e9e58\") " pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:08:59.375082 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:59.374762 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 00:08:59.375082 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:59.374862 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs podName:107f4ca7-7252-4983-9468-ba558c9e9e58 nodeName:}" failed. No retries permitted until 2026-07-05 00:09:07.374840969 +0000 UTC m=+18.099857020 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs") pod "network-metrics-daemon-tlll9" (UID: "107f4ca7-7252-4983-9468-ba558c9e9e58") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 00:08:59.475943 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:59.475903 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret\") pod \"global-pull-secret-syncer-dxsxs\" (UID: \"d3f73c87-0938-4904-8db7-e28345166dd1\") " pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:08:59.476110 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:59.476042 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 00:08:59.476161 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:59.476128 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret podName:d3f73c87-0938-4904-8db7-e28345166dd1 nodeName:}" failed. No retries permitted until 2026-07-05 00:09:07.476106188 +0000 UTC m=+18.201122236 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret") pod "global-pull-secret-syncer-dxsxs" (UID: "d3f73c87-0938-4904-8db7-e28345166dd1") : object "kube-system"/"original-pull-secret" not registered Jul 05 00:08:59.576847 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:59.576812 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzfgv\" (UniqueName: \"kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv\") pod \"network-check-target-t4ppn\" (UID: \"f2c0c53b-05d0-4dce-844b-95ce6cff9a0f\") " pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:08:59.577030 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:59.576985 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 00:08:59.577030 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:59.577009 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 00:08:59.577030 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:59.577024 2561 projected.go:196] Error preparing data for projected volume kube-api-access-gzfgv for pod openshift-network-diagnostics/network-check-target-t4ppn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 00:08:59.577185 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:59.577085 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv podName:f2c0c53b-05d0-4dce-844b-95ce6cff9a0f nodeName:}" failed. No retries permitted until 2026-07-05 00:09:07.577069684 +0000 UTC m=+18.302085726 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzfgv" (UniqueName: "kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv") pod "network-check-target-t4ppn" (UID: "f2c0c53b-05d0-4dce-844b-95ce6cff9a0f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 00:08:59.771345 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:59.771248 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:08:59.771345 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:59.771280 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:08:59.771511 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:59.771378 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxsxs" podUID="d3f73c87-0938-4904-8db7-e28345166dd1" Jul 05 00:08:59.771511 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:59.771445 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4ppn" podUID="f2c0c53b-05d0-4dce-844b-95ce6cff9a0f" Jul 05 00:08:59.771511 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:08:59.771477 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:08:59.771599 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:08:59.771574 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlll9" podUID="107f4ca7-7252-4983-9468-ba558c9e9e58" Jul 05 00:09:01.771520 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:01.771437 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:09:01.772118 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:01.771435 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:09:01.772118 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:01.771563 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlll9" podUID="107f4ca7-7252-4983-9468-ba558c9e9e58" Jul 05 00:09:01.772118 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:01.771595 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:09:01.772118 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:01.771692 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxsxs" podUID="d3f73c87-0938-4904-8db7-e28345166dd1" Jul 05 00:09:01.772118 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:01.771775 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4ppn" podUID="f2c0c53b-05d0-4dce-844b-95ce6cff9a0f" Jul 05 00:09:02.824987 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:02.824909 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-62fb7" event={"ID":"f34cbf2c-82c6-4635-bb89-7dd9c60f74de","Type":"ContainerStarted","Data":"164695e8a3c0bca230f3f30306177126bebc12f8e3623edb9e7ecb4f0654451c"} Jul 05 00:09:02.826356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:02.826334 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-188.ec2.internal" event={"ID":"4d98373d2705b464e11a31bbc31f03dd","Type":"ContainerStarted","Data":"bf00e96217c8a2c5d18f6c1a8ccf240a3d7053d85ffbc0645152e7a0d6a1a343"} Jul 05 00:09:02.842320 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:02.842233 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-62fb7" podStartSLOduration=2.501854405 podStartE2EDuration="12.842214786s" totalImagesPullingTime="10.340360381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 00:08:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:09:02.840663124 +0000 UTC m=+13.565679177" watchObservedRunningTime="2026-07-05 00:09:02.842214786 +0000 UTC m=+13.567230846" Jul 05 00:09:02.853094 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:02.853057 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-188.ec2.internal" podStartSLOduration=11.853040188 podStartE2EDuration="11.853040188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 00:08:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:09:02.8528305 +0000 UTC m=+13.577846559" watchObservedRunningTime="2026-07-05 00:09:02.853040188 +0000 UTC m=+13.578056253" Jul 05 00:09:03.770835 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:03.770789 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:09:03.770959 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:03.770943 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:09:03.770959 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:03.770944 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlll9" podUID="107f4ca7-7252-4983-9468-ba558c9e9e58" Jul 05 00:09:03.771074 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:03.770994 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:09:03.771136 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:03.771068 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxsxs" podUID="d3f73c87-0938-4904-8db7-e28345166dd1" Jul 05 00:09:03.771194 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:03.771134 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4ppn" podUID="f2c0c53b-05d0-4dce-844b-95ce6cff9a0f" Jul 05 00:09:03.829777 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:03.829745 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lz9th" event={"ID":"a9a304be-a49e-4a1a-983e-7ade1cc7ea10","Type":"ContainerStarted","Data":"a339906f72963732aa824d36ba0d2a690abc176391c24a3075126cfff0fac62d"} Jul 05 00:09:03.831445 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:03.831385 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zrxdw" event={"ID":"027126e8-e72a-47f9-9edd-19eee423b6b0","Type":"ContainerStarted","Data":"b6caba99cac3394c5b7a0bc72cedcb14cda8ecd25924b37035591bc7b914cd25"} Jul 05 00:09:03.832822 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:03.832785 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m6rgl" event={"ID":"962c613c-ccfc-4bdd-aded-f0978bc0b8ab","Type":"ContainerStarted","Data":"dcb5681ccd211424c83ed18f03a7aee2c07fcc19cae9c0905bd570a04b4e1158"} Jul 05 00:09:03.834247 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:03.834223 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qp7vx" event={"ID":"7f25f798-bb34-44b4-83e2-19ab8622e667","Type":"ContainerStarted","Data":"a22017a501aacdcf10f1adf6751ff3ac1da420c1fd809064c323380241dd5318"} Jul 05 00:09:03.835682 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:03.835660 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" event={"ID":"41b995eb-3ced-434b-86d9-a4095f68577a","Type":"ContainerStarted","Data":"c7f2d4d0bce69ec280e7172d2acb1a5f0a40cacab34c5948758a2deec7f5bd6d"} Jul 05 00:09:03.837141 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:03.837111 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99xdd" event={"ID":"0d61705e-33be-4264-85b4-8edce04fffbd","Type":"ContainerStarted","Data":"d4c83bb1c3ec18024eeb428f95241c19a9014b0b6361168c944de94c759be93d"} Jul 05 00:09:03.838467 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:03.838448 2561 generic.go:356] "Generic (PLEG): container finished" podID="7d89021ce33a5b1f6d6abbda92c13ccc" containerID="9797ec599f5c3d437f69cac20d0a995de83139185c6f3cf07bca7ca513214d16" exitCode=0 Jul 05 00:09:03.838569 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:03.838509 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-188.ec2.internal" event={"ID":"7d89021ce33a5b1f6d6abbda92c13ccc","Type":"ContainerDied","Data":"9797ec599f5c3d437f69cac20d0a995de83139185c6f3cf07bca7ca513214d16"} Jul 05 00:09:03.844351 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:03.844307 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lz9th" podStartSLOduration=3.754641382 podStartE2EDuration="13.844294662s" totalImagesPullingTime="10.08965328s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 00:08:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:09:03.843932325 +0000 UTC m=+14.568948384" watchObservedRunningTime="2026-07-05 00:09:03.844294662 +0000 UTC m=+14.569310724" Jul 05 00:09:03.857586 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:03.857548 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-m6rgl" podStartSLOduration=4.751233013 podStartE2EDuration="14.857536834s" totalImagesPullingTime="10.106303821s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 00:08:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:09:03.857198598 +0000 UTC m=+14.582214658" watchObservedRunningTime="2026-07-05 00:09:03.857536834 +0000 UTC m=+14.582552894" Jul 05 00:09:03.912076 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:03.912039 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zrxdw" podStartSLOduration=3.82261681 podStartE2EDuration="13.912026036s" totalImagesPullingTime="10.089409226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 00:08:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:09:03.895160607 +0000 UTC m=+14.620176669" watchObservedRunningTime="2026-07-05 00:09:03.912026036 +0000 UTC m=+14.637042095" Jul 05 00:09:03.927265 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:03.927214 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qp7vx" podStartSLOduration=4.790088431 podStartE2EDuration="14.927196737s" totalImagesPullingTime="10.137108306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:08:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:09:03.927165445 +0000 UTC m=+14.652181505" watchObservedRunningTime="2026-07-05 00:09:03.927196737 +0000 UTC m=+14.652212800" Jul 05 00:09:05.573650 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:05.573614 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qp7vx" Jul 05 00:09:05.574300 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:05.574271 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qp7vx" Jul 05 00:09:05.771033 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:05.771000 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:09:05.771204 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:05.771000 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:09:05.771204 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:05.771137 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlll9" podUID="107f4ca7-7252-4983-9468-ba558c9e9e58" Jul 05 00:09:05.771204 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:05.771000 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:09:05.771204 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:05.771187 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxsxs" podUID="d3f73c87-0938-4904-8db7-e28345166dd1" Jul 05 00:09:05.771385 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:05.771222 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4ppn" podUID="f2c0c53b-05d0-4dce-844b-95ce6cff9a0f" Jul 05 00:09:05.842544 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:05.842472 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qp7vx" Jul 05 00:09:05.843128 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:05.843108 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qp7vx" Jul 05 00:09:07.441460 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:07.441427 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs\") pod \"network-metrics-daemon-tlll9\" (UID: \"107f4ca7-7252-4983-9468-ba558c9e9e58\") " pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:09:07.442127 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:07.441547 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 00:09:07.442127 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:07.441603 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs podName:107f4ca7-7252-4983-9468-ba558c9e9e58 nodeName:}" failed. No retries permitted until 2026-07-05 00:09:23.441586893 +0000 UTC m=+34.166602929 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs") pod "network-metrics-daemon-tlll9" (UID: "107f4ca7-7252-4983-9468-ba558c9e9e58") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 00:09:07.542260 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:07.542225 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret\") pod \"global-pull-secret-syncer-dxsxs\" (UID: \"d3f73c87-0938-4904-8db7-e28345166dd1\") " pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:09:07.542409 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:07.542348 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 00:09:07.542480 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:07.542424 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret podName:d3f73c87-0938-4904-8db7-e28345166dd1 nodeName:}" failed. No retries permitted until 2026-07-05 00:09:23.542403881 +0000 UTC m=+34.267419932 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret") pod "global-pull-secret-syncer-dxsxs" (UID: "d3f73c87-0938-4904-8db7-e28345166dd1") : object "kube-system"/"original-pull-secret" not registered Jul 05 00:09:07.643044 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:07.643006 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzfgv\" (UniqueName: \"kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv\") pod \"network-check-target-t4ppn\" (UID: \"f2c0c53b-05d0-4dce-844b-95ce6cff9a0f\") " pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:09:07.643216 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:07.643200 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 00:09:07.643285 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:07.643228 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 00:09:07.643285 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:07.643242 2561 projected.go:196] Error preparing data for projected volume kube-api-access-gzfgv for pod openshift-network-diagnostics/network-check-target-t4ppn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 00:09:07.643376 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:07.643308 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv podName:f2c0c53b-05d0-4dce-844b-95ce6cff9a0f nodeName:}" failed. No retries permitted until 2026-07-05 00:09:23.643288699 +0000 UTC m=+34.368304737 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzfgv" (UniqueName: "kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv") pod "network-check-target-t4ppn" (UID: "f2c0c53b-05d0-4dce-844b-95ce6cff9a0f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 00:09:07.770930 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:07.770865 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:09:07.770930 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:07.770894 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:09:07.771107 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:07.770861 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:09:07.771107 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:07.770979 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlll9" podUID="107f4ca7-7252-4983-9468-ba558c9e9e58" Jul 05 00:09:07.771107 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:07.771033 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxsxs" podUID="d3f73c87-0938-4904-8db7-e28345166dd1" Jul 05 00:09:07.771107 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:07.771104 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4ppn" podUID="f2c0c53b-05d0-4dce-844b-95ce6cff9a0f" Jul 05 00:09:08.849458 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:08.849420 2561 generic.go:356] "Generic (PLEG): container finished" podID="0d61705e-33be-4264-85b4-8edce04fffbd" containerID="d4c83bb1c3ec18024eeb428f95241c19a9014b0b6361168c944de94c759be93d" exitCode=0 Jul 05 00:09:08.850072 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:08.849484 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99xdd" event={"ID":"0d61705e-33be-4264-85b4-8edce04fffbd","Type":"ContainerDied","Data":"d4c83bb1c3ec18024eeb428f95241c19a9014b0b6361168c944de94c759be93d"} Jul 05 00:09:09.771675 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:09.771648 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:09:09.771865 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:09.771740 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxsxs" podUID="d3f73c87-0938-4904-8db7-e28345166dd1" Jul 05 00:09:09.771865 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:09.771838 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:09:09.771994 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:09.771962 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4ppn" podUID="f2c0c53b-05d0-4dce-844b-95ce6cff9a0f" Jul 05 00:09:09.772114 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:09.772039 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:09:09.772170 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:09.772138 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlll9" podUID="107f4ca7-7252-4983-9468-ba558c9e9e58" Jul 05 00:09:11.771619 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:11.771590 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:09:11.772087 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:11.771590 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:09:11.772087 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:11.771699 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4ppn" podUID="f2c0c53b-05d0-4dce-844b-95ce6cff9a0f" Jul 05 00:09:11.772087 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:11.771593 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:09:11.772087 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:11.771771 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxsxs" podUID="d3f73c87-0938-4904-8db7-e28345166dd1" Jul 05 00:09:11.772087 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:11.771878 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlll9" podUID="107f4ca7-7252-4983-9468-ba558c9e9e58" Jul 05 00:09:12.573577 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:12.573297 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 05 00:09:12.765067 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:12.764996 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-05T00:09:12.57357576Z","UUID":"b16d51d2-e29a-4b73-b440-c76da536e895","Handler":null,"Name":"","Endpoint":""} Jul 05 00:09:12.766537 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:12.766519 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 05 00:09:12.766623 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:12.766553 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 05 00:09:12.859708 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:12.859675 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-188.ec2.internal" event={"ID":"7d89021ce33a5b1f6d6abbda92c13ccc","Type":"ContainerStarted","Data":"616090b51e48782fc0c234db674f5f80ef2fe853eb039d320e259c1d3f2d3434"} Jul 05 00:09:12.861089 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:12.861068 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zr9vn" event={"ID":"d761a174-9f01-4bb2-aa2d-76a540929c2d","Type":"ContainerStarted","Data":"251486244c754928a1d14160e29f33956f54a0fe463d87e9ec86334bf62dd96e"} Jul 05 00:09:12.864004 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:12.863981 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" event={"ID":"25833488-5ae4-4ff9-8eaf-cc1107922763","Type":"ContainerStarted","Data":"a170bba2cbb1c641568b85f0fe0513c68f4757bcdfe7d6be30684e3b92358841"} Jul 05 00:09:12.864108 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:12.864039 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" event={"ID":"25833488-5ae4-4ff9-8eaf-cc1107922763","Type":"ContainerStarted","Data":"e5ee43aff71aa0488bc0dbbdc450c95ef84899dd20ea918507dd65a0b9fdf416"} Jul 05 00:09:12.864108 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:12.864078 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" event={"ID":"25833488-5ae4-4ff9-8eaf-cc1107922763","Type":"ContainerStarted","Data":"e4282932463415deb7af454c5d56b1751c269ad29c623e2ab1241bb72b0e9b10"} Jul 05 00:09:12.864213 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:12.864113 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" event={"ID":"25833488-5ae4-4ff9-8eaf-cc1107922763","Type":"ContainerStarted","Data":"77e3cb5f001dabce3e8d90cb6df79a0d480c74cab452ff83c95a30b3f6cba46d"} Jul 05 00:09:12.864213 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:12.864143 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" event={"ID":"25833488-5ae4-4ff9-8eaf-cc1107922763","Type":"ContainerStarted","Data":"de2134f52afb69c789074e25089dbe6d4287e0845167d9ae5236fb125a3e40a2"} Jul 05 00:09:12.864213 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:12.864179 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" event={"ID":"25833488-5ae4-4ff9-8eaf-cc1107922763","Type":"ContainerStarted","Data":"d8d44655515b32b028a188426bcde125ba9e22c831dcd2eccd4f9249edd4291a"} Jul 05 00:09:12.865576 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:12.865559 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" event={"ID":"41b995eb-3ced-434b-86d9-a4095f68577a","Type":"ContainerStarted","Data":"571fda7f80f50bc18ca0fc9c0c37a19a1d9ae485b323d4c70204337aec3e19b9"} Jul 05 00:09:12.873177 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:12.873144 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-188.ec2.internal" podStartSLOduration=21.873127978 podStartE2EDuration="21.873127978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 00:08:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:09:12.87303588 +0000 UTC m=+23.598051940" watchObservedRunningTime="2026-07-05 00:09:12.873127978 +0000 UTC m=+23.598144033" Jul 05 00:09:12.888406 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:12.888367 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zr9vn" podStartSLOduration=3.8163072529999997 podStartE2EDuration="23.888357081s" totalImagesPullingTime="20.072049828s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 00:08:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:09:12.888038887 +0000 UTC m=+23.613054945" watchObservedRunningTime="2026-07-05 00:09:12.888357081 +0000 UTC m=+23.613373140" Jul 05 00:09:13.770966 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:13.770934 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:09:13.770966 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:13.770957 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:09:13.771311 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:13.770937 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:09:13.771311 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:13.771036 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxsxs" podUID="d3f73c87-0938-4904-8db7-e28345166dd1" Jul 05 00:09:13.771311 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:13.771106 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlll9" podUID="107f4ca7-7252-4983-9468-ba558c9e9e58" Jul 05 00:09:13.771311 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:13.771158 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4ppn" podUID="f2c0c53b-05d0-4dce-844b-95ce6cff9a0f" Jul 05 00:09:14.871902 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:14.871871 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" event={"ID":"41b995eb-3ced-434b-86d9-a4095f68577a","Type":"ContainerStarted","Data":"ffa6da835aff3bd61e495fc71c450aef4166ecfc141387a0e107069a0e6d171e"} Jul 05 00:09:14.916558 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:14.916510 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zdwbz" podStartSLOduration=4.58641323 podStartE2EDuration="24.916495577s" totalImagesPullingTime="20.330082347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 00:08:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:09:14.916030055 +0000 UTC m=+25.641046140" watchObservedRunningTime="2026-07-05 00:09:14.916495577 +0000 UTC m=+25.641511636" Jul 05 00:09:15.771675 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:15.771648 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:09:15.771675 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:15.771663 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:09:15.771870 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:15.771663 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:09:15.771870 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:15.771750 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxsxs" podUID="d3f73c87-0938-4904-8db7-e28345166dd1" Jul 05 00:09:15.771870 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:15.771829 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4ppn" podUID="f2c0c53b-05d0-4dce-844b-95ce6cff9a0f" Jul 05 00:09:15.771962 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:15.771888 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlll9" podUID="107f4ca7-7252-4983-9468-ba558c9e9e58" Jul 05 00:09:15.877250 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:15.877216 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" event={"ID":"25833488-5ae4-4ff9-8eaf-cc1107922763","Type":"ContainerStarted","Data":"651ef025d845b86fd879b6e2e07d6ecae24e27f8e724e9d9433eb3b844f973f1"} Jul 05 00:09:17.771315 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:17.771147 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:09:17.771901 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:17.771147 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:09:17.771901 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:17.771409 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxsxs" podUID="d3f73c87-0938-4904-8db7-e28345166dd1" Jul 05 00:09:17.771901 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:17.771473 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlll9" podUID="107f4ca7-7252-4983-9468-ba558c9e9e58" Jul 05 00:09:17.771901 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:17.771170 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:09:17.771901 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:17.771547 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4ppn" podUID="f2c0c53b-05d0-4dce-844b-95ce6cff9a0f" Jul 05 00:09:17.885887 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:17.885841 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" event={"ID":"25833488-5ae4-4ff9-8eaf-cc1107922763","Type":"ContainerStarted","Data":"c5cf6a77e5b1b72a18bada94f996881d9c9c1e1ad9a45a73280b3ae5bc773ff5"} Jul 05 00:09:17.886226 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:17.886202 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:09:17.887789 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:17.887766 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99xdd" event={"ID":"0d61705e-33be-4264-85b4-8edce04fffbd","Type":"ContainerStarted","Data":"7a3593e5bc6c0cfd783084a7e41936f38421230e9a8d04e59bad5943dcd318b0"} Jul 05 00:09:17.907209 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:17.907191 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:09:17.909591 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:17.909559 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" podStartSLOduration=8.817559522 podStartE2EDuration="28.909548895s" totalImagesPullingTime="20.091989373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 00:08:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:09:17.907988475 +0000 UTC m=+28.633004534" watchObservedRunningTime="2026-07-05 00:09:17.909548895 +0000 UTC m=+28.634564954" Jul 05 00:09:18.891379 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:18.891345 2561 generic.go:356] "Generic (PLEG): container finished" podID="0d61705e-33be-4264-85b4-8edce04fffbd" containerID="7a3593e5bc6c0cfd783084a7e41936f38421230e9a8d04e59bad5943dcd318b0" exitCode=0 Jul 05 00:09:18.891770 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:18.891424 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99xdd" event={"ID":"0d61705e-33be-4264-85b4-8edce04fffbd","Type":"ContainerDied","Data":"7a3593e5bc6c0cfd783084a7e41936f38421230e9a8d04e59bad5943dcd318b0"} Jul 05 00:09:18.891770 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:18.891495 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 05 00:09:18.891923 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:18.891904 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:09:18.907391 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:18.907375 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:09:19.371536 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:19.371460 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:09:19.681982 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:19.681897 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dxsxs"] Jul 05 00:09:19.682152 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:19.682003 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:09:19.682152 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:19.682095 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxsxs" podUID="d3f73c87-0938-4904-8db7-e28345166dd1" Jul 05 00:09:19.685142 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:19.685074 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tlll9"] Jul 05 00:09:19.685309 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:19.685267 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:09:19.685419 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:19.685398 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlll9" podUID="107f4ca7-7252-4983-9468-ba558c9e9e58" Jul 05 00:09:19.685749 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:19.685726 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t4ppn"] Jul 05 00:09:19.685859 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:19.685830 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:09:19.685945 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:19.685923 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4ppn" podUID="f2c0c53b-05d0-4dce-844b-95ce6cff9a0f" Jul 05 00:09:20.898001 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:20.897963 2561 generic.go:356] "Generic (PLEG): container finished" podID="0d61705e-33be-4264-85b4-8edce04fffbd" containerID="04147d4e17b4f586d26e879413e1ab3e361aa04fd7cdb1794f508d05768bc8b7" exitCode=0 Jul 05 00:09:20.898332 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:20.898035 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99xdd" event={"ID":"0d61705e-33be-4264-85b4-8edce04fffbd","Type":"ContainerDied","Data":"04147d4e17b4f586d26e879413e1ab3e361aa04fd7cdb1794f508d05768bc8b7"} Jul 05 00:09:21.771218 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:21.771022 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:09:21.771390 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:21.771022 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:09:21.771390 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:21.771317 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlll9" podUID="107f4ca7-7252-4983-9468-ba558c9e9e58" Jul 05 00:09:21.771390 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:21.771355 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4ppn" podUID="f2c0c53b-05d0-4dce-844b-95ce6cff9a0f" Jul 05 00:09:21.771390 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:21.771059 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:09:21.771612 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:21.771437 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxsxs" podUID="d3f73c87-0938-4904-8db7-e28345166dd1" Jul 05 00:09:21.902215 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:21.902127 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99xdd" event={"ID":"0d61705e-33be-4264-85b4-8edce04fffbd","Type":"ContainerStarted","Data":"20100a32d699ec587d28aa55720ceefbeacc39a6c3ca9a178a0a1e9535bd89a3"} Jul 05 00:09:22.906260 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:22.906227 2561 generic.go:356] "Generic (PLEG): container finished" podID="0d61705e-33be-4264-85b4-8edce04fffbd" containerID="20100a32d699ec587d28aa55720ceefbeacc39a6c3ca9a178a0a1e9535bd89a3" exitCode=0 Jul 05 00:09:22.906603 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:22.906264 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99xdd" event={"ID":"0d61705e-33be-4264-85b4-8edce04fffbd","Type":"ContainerDied","Data":"20100a32d699ec587d28aa55720ceefbeacc39a6c3ca9a178a0a1e9535bd89a3"} Jul 05 00:09:23.460424 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:23.460388 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs\") pod \"network-metrics-daemon-tlll9\" (UID: \"107f4ca7-7252-4983-9468-ba558c9e9e58\") " pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:09:23.460591 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:23.460504 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 00:09:23.460591 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:23.460566 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs podName:107f4ca7-7252-4983-9468-ba558c9e9e58 nodeName:}" failed. No retries permitted until 2026-07-05 00:09:55.460548577 +0000 UTC m=+66.185564615 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs") pod "network-metrics-daemon-tlll9" (UID: "107f4ca7-7252-4983-9468-ba558c9e9e58") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 00:09:23.560873 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:23.560845 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret\") pod \"global-pull-secret-syncer-dxsxs\" (UID: \"d3f73c87-0938-4904-8db7-e28345166dd1\") " pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:09:23.561014 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:23.560964 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 00:09:23.561014 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:23.561014 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret podName:d3f73c87-0938-4904-8db7-e28345166dd1 nodeName:}" failed. No retries permitted until 2026-07-05 00:09:55.560999376 +0000 UTC m=+66.286015417 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret") pod "global-pull-secret-syncer-dxsxs" (UID: "d3f73c87-0938-4904-8db7-e28345166dd1") : object "kube-system"/"original-pull-secret" not registered Jul 05 00:09:23.661556 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:23.661524 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzfgv\" (UniqueName: \"kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv\") pod \"network-check-target-t4ppn\" (UID: \"f2c0c53b-05d0-4dce-844b-95ce6cff9a0f\") " pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:09:23.661757 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:23.661697 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 00:09:23.661757 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:23.661716 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 00:09:23.661757 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:23.661727 2561 projected.go:196] Error preparing data for projected volume kube-api-access-gzfgv for pod openshift-network-diagnostics/network-check-target-t4ppn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 00:09:23.661951 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:23.661786 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv podName:f2c0c53b-05d0-4dce-844b-95ce6cff9a0f nodeName:}" failed. No retries permitted until 2026-07-05 00:09:55.661768895 +0000 UTC m=+66.386784945 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gzfgv" (UniqueName: "kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv") pod "network-check-target-t4ppn" (UID: "f2c0c53b-05d0-4dce-844b-95ce6cff9a0f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 00:09:23.771426 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:23.771340 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:09:23.771426 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:23.771346 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:09:23.771633 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:23.771468 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:09:23.771633 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:23.771465 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxsxs" podUID="d3f73c87-0938-4904-8db7-e28345166dd1" Jul 05 00:09:23.771633 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:23.771573 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tlll9" podUID="107f4ca7-7252-4983-9468-ba558c9e9e58" Jul 05 00:09:23.771769 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:23.771659 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4ppn" podUID="f2c0c53b-05d0-4dce-844b-95ce6cff9a0f" Jul 05 00:09:24.998242 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:24.998162 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-188.ec2.internal" event="NodeReady" Jul 05 00:09:24.998992 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:24.998332 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 05 00:09:25.029555 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.029527 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-w97sv"] Jul 05 00:09:25.032606 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.032585 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" Jul 05 00:09:25.032821 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.032743 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6845f467d-cqzsc"] Jul 05 00:09:25.035088 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.035068 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 05 00:09:25.035197 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.035073 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 05 00:09:25.035197 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.035073 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-kdspz\"" Jul 05 00:09:25.038065 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.038047 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.040462 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.040437 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dm6pw"] Jul 05 00:09:25.041905 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.041653 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qmcqv\"" Jul 05 00:09:25.042979 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.042956 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 05 00:09:25.044766 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.043438 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 05 00:09:25.044766 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.043827 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 05 00:09:25.049979 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.049955 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-w97sv"] Jul 05 00:09:25.050061 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.049998 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mkr59"] Jul 05 00:09:25.051350 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.051332 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dm6pw" Jul 05 00:09:25.052904 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.052665 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 05 00:09:25.053541 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.053519 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6845f467d-cqzsc"] Jul 05 00:09:25.053650 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.053608 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mkr59" Jul 05 00:09:25.054107 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.053870 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z9vd9\"" Jul 05 00:09:25.054107 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.053960 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 05 00:09:25.054107 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.054006 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 05 00:09:25.056378 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.056334 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 05 00:09:25.056471 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.056390 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ch6vj\"" Jul 05 00:09:25.056471 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.056449 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 05 00:09:25.056584 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.056484 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 05 00:09:25.060526 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.060150 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dm6pw"] Jul 05 00:09:25.063677 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.063659 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mkr59"] Jul 05 00:09:25.173939 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.173905 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-w97sv\" (UID: \"b4d54845-8c05-46b8-9130-3aea115d4f6c\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" Jul 05 00:09:25.174102 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.173956 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-image-registry-private-configuration\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.174102 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.173975 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-ca-trust-extracted\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.174102 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.174036 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-trusted-ca\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.174102 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.174075 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzmvp\" (UniqueName: \"kubernetes.io/projected/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-kube-api-access-dzmvp\") pod \"dns-default-dm6pw\" (UID: \"21ab9246-2ceb-4ee9-be3d-f158461d8ed1\") " pod="openshift-dns/dns-default-dm6pw" Jul 05 00:09:25.174259 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.174121 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b4d54845-8c05-46b8-9130-3aea115d4f6c-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-w97sv\" (UID: \"b4d54845-8c05-46b8-9130-3aea115d4f6c\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" Jul 05 00:09:25.174259 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.174143 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tscrj\" (UniqueName: \"kubernetes.io/projected/1ee85ca6-328e-47e2-ab72-17410e1636a5-kube-api-access-tscrj\") pod \"ingress-canary-mkr59\" (UID: \"1ee85ca6-328e-47e2-ab72-17410e1636a5\") " pod="openshift-ingress-canary/ingress-canary-mkr59" Jul 05 00:09:25.174259 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.174161 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-installation-pull-secrets\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.174259 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.174201 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-certificates\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.174259 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.174257 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls\") pod \"dns-default-dm6pw\" (UID: \"21ab9246-2ceb-4ee9-be3d-f158461d8ed1\") " pod="openshift-dns/dns-default-dm6pw" Jul 05 00:09:25.174498 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.174278 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-tmp-dir\") pod \"dns-default-dm6pw\" (UID: \"21ab9246-2ceb-4ee9-be3d-f158461d8ed1\") " pod="openshift-dns/dns-default-dm6pw" Jul 05 00:09:25.174498 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.174332 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-config-volume\") pod \"dns-default-dm6pw\" (UID: \"21ab9246-2ceb-4ee9-be3d-f158461d8ed1\") " pod="openshift-dns/dns-default-dm6pw" Jul 05 00:09:25.174498 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.174350 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lrnd\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-kube-api-access-7lrnd\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.174498 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.174378 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ee85ca6-328e-47e2-ab72-17410e1636a5-cert\") pod \"ingress-canary-mkr59\" (UID: \"1ee85ca6-328e-47e2-ab72-17410e1636a5\") " pod="openshift-ingress-canary/ingress-canary-mkr59" Jul 05 00:09:25.174498 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.174394 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.174498 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.174416 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-bound-sa-token\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.275215 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.275154 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-w97sv\" (UID: \"b4d54845-8c05-46b8-9130-3aea115d4f6c\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" Jul 05 00:09:25.275215 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.275193 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-image-registry-private-configuration\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.275215 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.275210 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-ca-trust-extracted\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.275425 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.275232 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-trusted-ca\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.275425 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.275259 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzmvp\" (UniqueName: \"kubernetes.io/projected/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-kube-api-access-dzmvp\") pod \"dns-default-dm6pw\" (UID: \"21ab9246-2ceb-4ee9-be3d-f158461d8ed1\") " pod="openshift-dns/dns-default-dm6pw" Jul 05 00:09:25.275425 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.275283 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b4d54845-8c05-46b8-9130-3aea115d4f6c-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-w97sv\" (UID: \"b4d54845-8c05-46b8-9130-3aea115d4f6c\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" Jul 05 00:09:25.275425 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.275308 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tscrj\" (UniqueName: \"kubernetes.io/projected/1ee85ca6-328e-47e2-ab72-17410e1636a5-kube-api-access-tscrj\") pod \"ingress-canary-mkr59\" (UID: \"1ee85ca6-328e-47e2-ab72-17410e1636a5\") " pod="openshift-ingress-canary/ingress-canary-mkr59" Jul 05 00:09:25.275425 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.275339 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-installation-pull-secrets\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.275425 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.275364 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-certificates\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.275425 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.275386 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls\") pod \"dns-default-dm6pw\" (UID: \"21ab9246-2ceb-4ee9-be3d-f158461d8ed1\") " pod="openshift-dns/dns-default-dm6pw" Jul 05 00:09:25.275766 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:25.275308 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 05 00:09:25.275766 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:25.275527 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert podName:b4d54845-8c05-46b8-9130-3aea115d4f6c nodeName:}" failed. No retries permitted until 2026-07-05 00:09:25.775510867 +0000 UTC m=+36.500526904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-w97sv" (UID: "b4d54845-8c05-46b8-9130-3aea115d4f6c") : secret "networking-console-plugin-cert" not found Jul 05 00:09:25.275766 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:25.275461 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 00:09:25.275766 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:25.275666 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls podName:21ab9246-2ceb-4ee9-be3d-f158461d8ed1 nodeName:}" failed. No retries permitted until 2026-07-05 00:09:25.775649424 +0000 UTC m=+36.500665463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls") pod "dns-default-dm6pw" (UID: "21ab9246-2ceb-4ee9-be3d-f158461d8ed1") : secret "dns-default-metrics-tls" not found Jul 05 00:09:25.275766 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.275604 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-ca-trust-extracted\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.275766 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.275711 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-tmp-dir\") pod \"dns-default-dm6pw\" (UID: \"21ab9246-2ceb-4ee9-be3d-f158461d8ed1\") " pod="openshift-dns/dns-default-dm6pw" Jul 05 00:09:25.276088 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.275770 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-config-volume\") pod \"dns-default-dm6pw\" (UID: \"21ab9246-2ceb-4ee9-be3d-f158461d8ed1\") " pod="openshift-dns/dns-default-dm6pw" Jul 05 00:09:25.276088 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.275823 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lrnd\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-kube-api-access-7lrnd\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.276088 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.275869 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ee85ca6-328e-47e2-ab72-17410e1636a5-cert\") pod \"ingress-canary-mkr59\" (UID: \"1ee85ca6-328e-47e2-ab72-17410e1636a5\") " pod="openshift-ingress-canary/ingress-canary-mkr59" Jul 05 00:09:25.276088 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.275890 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.276088 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.275912 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-bound-sa-token\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.276088 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.276022 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-certificates\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.276088 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.276061 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-tmp-dir\") pod \"dns-default-dm6pw\" (UID: \"21ab9246-2ceb-4ee9-be3d-f158461d8ed1\") " pod="openshift-dns/dns-default-dm6pw" Jul 05 00:09:25.276387 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.276135 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b4d54845-8c05-46b8-9130-3aea115d4f6c-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-w97sv\" (UID: \"b4d54845-8c05-46b8-9130-3aea115d4f6c\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" Jul 05 00:09:25.276387 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:25.276230 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 05 00:09:25.276387 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:25.276244 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6845f467d-cqzsc: secret "image-registry-tls" not found Jul 05 00:09:25.276387 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:25.276322 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls podName:8f05d3fd-5eed-413a-bc3a-90b63d81ee2f nodeName:}" failed. No retries permitted until 2026-07-05 00:09:25.776298751 +0000 UTC m=+36.501314792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls") pod "image-registry-6845f467d-cqzsc" (UID: "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f") : secret "image-registry-tls" not found Jul 05 00:09:25.276387 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.276337 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-trusted-ca\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.276590 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.276515 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-config-volume\") pod \"dns-default-dm6pw\" (UID: \"21ab9246-2ceb-4ee9-be3d-f158461d8ed1\") " pod="openshift-dns/dns-default-dm6pw" Jul 05 00:09:25.279299 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.279276 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-installation-pull-secrets\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.279399 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.279279 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-image-registry-private-configuration\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.279438 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.279416 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ee85ca6-328e-47e2-ab72-17410e1636a5-cert\") pod \"ingress-canary-mkr59\" (UID: \"1ee85ca6-328e-47e2-ab72-17410e1636a5\") " pod="openshift-ingress-canary/ingress-canary-mkr59" Jul 05 00:09:25.284222 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.284192 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tscrj\" (UniqueName: \"kubernetes.io/projected/1ee85ca6-328e-47e2-ab72-17410e1636a5-kube-api-access-tscrj\") pod \"ingress-canary-mkr59\" (UID: \"1ee85ca6-328e-47e2-ab72-17410e1636a5\") " pod="openshift-ingress-canary/ingress-canary-mkr59" Jul 05 00:09:25.284500 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.284476 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzmvp\" (UniqueName: \"kubernetes.io/projected/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-kube-api-access-dzmvp\") pod \"dns-default-dm6pw\" (UID: \"21ab9246-2ceb-4ee9-be3d-f158461d8ed1\") " pod="openshift-dns/dns-default-dm6pw" Jul 05 00:09:25.284578 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.284540 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-bound-sa-token\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.284634 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.284598 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lrnd\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-kube-api-access-7lrnd\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.371743 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.371718 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mkr59" Jul 05 00:09:25.597476 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.597305 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mkr59"] Jul 05 00:09:25.601658 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:09:25.601623 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ee85ca6_328e_47e2_ab72_17410e1636a5.slice/crio-93b646ff31c2c89a1f7bc27d88017999b07f1ade37056f8677e4e2a2741c567b WatchSource:0}: Error finding container 93b646ff31c2c89a1f7bc27d88017999b07f1ade37056f8677e4e2a2741c567b: Status 404 returned error can't find the container with id 93b646ff31c2c89a1f7bc27d88017999b07f1ade37056f8677e4e2a2741c567b Jul 05 00:09:25.771394 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.771247 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:09:25.771394 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.771259 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:09:25.771394 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.771390 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:09:25.774482 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.774459 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 05 00:09:25.774482 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.774477 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 05 00:09:25.774678 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.774507 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m9r6w\"" Jul 05 00:09:25.774678 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.774554 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fmjx4\"" Jul 05 00:09:25.774770 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.774690 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 05 00:09:25.774836 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.774772 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 05 00:09:25.780411 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.780391 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls\") pod \"dns-default-dm6pw\" (UID: \"21ab9246-2ceb-4ee9-be3d-f158461d8ed1\") " pod="openshift-dns/dns-default-dm6pw" Jul 05 00:09:25.780513 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.780459 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:25.780513 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.780492 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-w97sv\" (UID: \"b4d54845-8c05-46b8-9130-3aea115d4f6c\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" Jul 05 00:09:25.780628 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:25.780536 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 00:09:25.780628 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:25.780572 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 05 00:09:25.780628 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:25.780586 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6845f467d-cqzsc: secret "image-registry-tls" not found Jul 05 00:09:25.780628 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:25.780597 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls podName:21ab9246-2ceb-4ee9-be3d-f158461d8ed1 nodeName:}" failed. No retries permitted until 2026-07-05 00:09:26.780577111 +0000 UTC m=+37.505593167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls") pod "dns-default-dm6pw" (UID: "21ab9246-2ceb-4ee9-be3d-f158461d8ed1") : secret "dns-default-metrics-tls" not found Jul 05 00:09:25.780628 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:25.780603 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 05 00:09:25.780628 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:25.780625 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls podName:8f05d3fd-5eed-413a-bc3a-90b63d81ee2f nodeName:}" failed. No retries permitted until 2026-07-05 00:09:26.780611331 +0000 UTC m=+37.505627367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls") pod "image-registry-6845f467d-cqzsc" (UID: "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f") : secret "image-registry-tls" not found Jul 05 00:09:25.780953 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:25.780655 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert podName:b4d54845-8c05-46b8-9130-3aea115d4f6c nodeName:}" failed. No retries permitted until 2026-07-05 00:09:26.780644705 +0000 UTC m=+37.505660743 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-w97sv" (UID: "b4d54845-8c05-46b8-9130-3aea115d4f6c") : secret "networking-console-plugin-cert" not found Jul 05 00:09:25.914196 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:25.914167 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mkr59" event={"ID":"1ee85ca6-328e-47e2-ab72-17410e1636a5","Type":"ContainerStarted","Data":"93b646ff31c2c89a1f7bc27d88017999b07f1ade37056f8677e4e2a2741c567b"} Jul 05 00:09:26.011963 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:26.011923 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qp7vx_7f25f798-bb34-44b4-83e2-19ab8622e667/konnectivity-agent/0.log" limit=1024 Jul 05 00:09:26.093513 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:26.093438 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qp7vx_7f25f798-bb34-44b4-83e2-19ab8622e667/konnectivity-agent/0.log" limit=1024 Jul 05 00:09:26.194729 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:26.194677 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qp7vx_7f25f798-bb34-44b4-83e2-19ab8622e667/konnectivity-agent/0.log" limit=1024 Jul 05 00:09:26.788264 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:26.788228 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls\") pod \"dns-default-dm6pw\" (UID: \"21ab9246-2ceb-4ee9-be3d-f158461d8ed1\") " pod="openshift-dns/dns-default-dm6pw" Jul 05 00:09:26.788459 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:26.788333 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:26.788459 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:26.788377 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-w97sv\" (UID: \"b4d54845-8c05-46b8-9130-3aea115d4f6c\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" Jul 05 00:09:26.788459 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:26.788397 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 00:09:26.788636 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:26.788466 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls podName:21ab9246-2ceb-4ee9-be3d-f158461d8ed1 nodeName:}" failed. No retries permitted until 2026-07-05 00:09:28.788445903 +0000 UTC m=+39.513461940 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls") pod "dns-default-dm6pw" (UID: "21ab9246-2ceb-4ee9-be3d-f158461d8ed1") : secret "dns-default-metrics-tls" not found Jul 05 00:09:26.788636 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:26.788489 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 05 00:09:26.788636 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:26.788513 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6845f467d-cqzsc: secret "image-registry-tls" not found Jul 05 00:09:26.788636 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:26.788564 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls podName:8f05d3fd-5eed-413a-bc3a-90b63d81ee2f nodeName:}" failed. No retries permitted until 2026-07-05 00:09:28.788547804 +0000 UTC m=+39.513563867 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls") pod "image-registry-6845f467d-cqzsc" (UID: "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f") : secret "image-registry-tls" not found Jul 05 00:09:26.788636 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:26.788491 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 05 00:09:26.788636 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:26.788610 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert podName:b4d54845-8c05-46b8-9130-3aea115d4f6c nodeName:}" failed. No retries permitted until 2026-07-05 00:09:28.788599795 +0000 UTC m=+39.513615838 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-w97sv" (UID: "b4d54845-8c05-46b8-9130-3aea115d4f6c") : secret "networking-console-plugin-cert" not found Jul 05 00:09:28.804280 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:28.804241 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls\") pod \"dns-default-dm6pw\" (UID: \"21ab9246-2ceb-4ee9-be3d-f158461d8ed1\") " pod="openshift-dns/dns-default-dm6pw" Jul 05 00:09:28.804787 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:28.804354 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:28.804787 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:28.804400 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-w97sv\" (UID: \"b4d54845-8c05-46b8-9130-3aea115d4f6c\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" Jul 05 00:09:28.804787 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:28.804360 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 00:09:28.804787 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:28.804499 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 05 00:09:28.804787 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:28.804517 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 05 00:09:28.804787 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:28.804520 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6845f467d-cqzsc: secret "image-registry-tls" not found Jul 05 00:09:28.804787 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:28.804501 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls podName:21ab9246-2ceb-4ee9-be3d-f158461d8ed1 nodeName:}" failed. No retries permitted until 2026-07-05 00:09:32.804477708 +0000 UTC m=+43.529493757 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls") pod "dns-default-dm6pw" (UID: "21ab9246-2ceb-4ee9-be3d-f158461d8ed1") : secret "dns-default-metrics-tls" not found Jul 05 00:09:28.804787 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:28.804583 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert podName:b4d54845-8c05-46b8-9130-3aea115d4f6c nodeName:}" failed. No retries permitted until 2026-07-05 00:09:32.804567966 +0000 UTC m=+43.529584006 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-w97sv" (UID: "b4d54845-8c05-46b8-9130-3aea115d4f6c") : secret "networking-console-plugin-cert" not found Jul 05 00:09:28.804787 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:28.804598 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls podName:8f05d3fd-5eed-413a-bc3a-90b63d81ee2f nodeName:}" failed. No retries permitted until 2026-07-05 00:09:32.80458908 +0000 UTC m=+43.529605121 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls") pod "image-registry-6845f467d-cqzsc" (UID: "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f") : secret "image-registry-tls" not found Jul 05 00:09:29.925587 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:29.925414 2561 generic.go:356] "Generic (PLEG): container finished" podID="0d61705e-33be-4264-85b4-8edce04fffbd" containerID="d02ae85c9cc7a7a069ac57286631e8fc9ef1e5bbd216090b81232ab569c589e4" exitCode=0 Jul 05 00:09:29.925944 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:29.925486 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99xdd" event={"ID":"0d61705e-33be-4264-85b4-8edce04fffbd","Type":"ContainerDied","Data":"d02ae85c9cc7a7a069ac57286631e8fc9ef1e5bbd216090b81232ab569c589e4"} Jul 05 00:09:29.927121 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:29.927090 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mkr59" event={"ID":"1ee85ca6-328e-47e2-ab72-17410e1636a5","Type":"ContainerStarted","Data":"25ead6f46dc64aef3c683de289d0be5cf800ea30162d2e66f71235ebb62458da"} Jul 05 00:09:29.959474 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:29.959434 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mkr59" podStartSLOduration=1.224483811 podStartE2EDuration="4.959420286s" totalImagesPullingTime="3.734936475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:09:29.958779406 +0000 UTC m=+40.683795478" watchObservedRunningTime="2026-07-05 00:09:29.959420286 +0000 UTC m=+40.684436378" Jul 05 00:09:30.932588 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:30.932555 2561 generic.go:356] "Generic (PLEG): container finished" podID="0d61705e-33be-4264-85b4-8edce04fffbd" containerID="eefc6da078cc0bfa9acc5da74041aa190613d80b833f10b0b5b7b5e553aae5d5" exitCode=0 Jul 05 00:09:30.933092 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:30.932627 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99xdd" event={"ID":"0d61705e-33be-4264-85b4-8edce04fffbd","Type":"ContainerDied","Data":"eefc6da078cc0bfa9acc5da74041aa190613d80b833f10b0b5b7b5e553aae5d5"} Jul 05 00:09:31.941245 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:31.941214 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-99xdd" event={"ID":"0d61705e-33be-4264-85b4-8edce04fffbd","Type":"ContainerStarted","Data":"16c7f2d96aa48eb8377a6819b41bfeb4e0389a35c1b27005bda25b1e08dd4ff3"} Jul 05 00:09:31.962898 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:31.962856 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-99xdd" podStartSLOduration=15.581651954 podStartE2EDuration="42.962843976s" totalImagesPullingTime="27.381192022s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 00:08:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:09:31.961284139 +0000 UTC m=+42.686300198" watchObservedRunningTime="2026-07-05 00:09:31.962843976 +0000 UTC m=+42.687860034" Jul 05 00:09:32.081977 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:32.081946 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qp7vx_7f25f798-bb34-44b4-83e2-19ab8622e667/konnectivity-agent/0.log" limit=1024 Jul 05 00:09:32.131921 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:32.131895 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qp7vx_7f25f798-bb34-44b4-83e2-19ab8622e667/konnectivity-agent/0.log" limit=1024 Jul 05 00:09:32.834064 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:32.834032 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls\") pod \"dns-default-dm6pw\" (UID: \"21ab9246-2ceb-4ee9-be3d-f158461d8ed1\") " pod="openshift-dns/dns-default-dm6pw" Jul 05 00:09:32.834231 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:32.834091 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:32.834231 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:32.834130 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-w97sv\" (UID: \"b4d54845-8c05-46b8-9130-3aea115d4f6c\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" Jul 05 00:09:32.834231 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:32.834198 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 00:09:32.834326 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:32.834250 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls podName:21ab9246-2ceb-4ee9-be3d-f158461d8ed1 nodeName:}" failed. No retries permitted until 2026-07-05 00:09:40.834235138 +0000 UTC m=+51.559251179 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls") pod "dns-default-dm6pw" (UID: "21ab9246-2ceb-4ee9-be3d-f158461d8ed1") : secret "dns-default-metrics-tls" not found Jul 05 00:09:32.834326 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:32.834250 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 05 00:09:32.834326 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:32.834267 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6845f467d-cqzsc: secret "image-registry-tls" not found Jul 05 00:09:32.834326 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:32.834287 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 05 00:09:32.834326 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:32.834291 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls podName:8f05d3fd-5eed-413a-bc3a-90b63d81ee2f nodeName:}" failed. No retries permitted until 2026-07-05 00:09:40.834284639 +0000 UTC m=+51.559300675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls") pod "image-registry-6845f467d-cqzsc" (UID: "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f") : secret "image-registry-tls" not found Jul 05 00:09:32.834467 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:32.834343 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert podName:b4d54845-8c05-46b8-9130-3aea115d4f6c nodeName:}" failed. No retries permitted until 2026-07-05 00:09:40.834331434 +0000 UTC m=+51.559347490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-w97sv" (UID: "b4d54845-8c05-46b8-9130-3aea115d4f6c") : secret "networking-console-plugin-cert" not found Jul 05 00:09:34.503644 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:34.503608 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qp7vx_7f25f798-bb34-44b4-83e2-19ab8622e667/konnectivity-agent/0.log" limit=1024 Jul 05 00:09:34.549588 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:34.549563 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qp7vx_7f25f798-bb34-44b4-83e2-19ab8622e667/konnectivity-agent/0.log" limit=1024 Jul 05 00:09:35.559803 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:35.559775 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qp7vx_7f25f798-bb34-44b4-83e2-19ab8622e667/konnectivity-agent/0.log" limit=1024 Jul 05 00:09:35.609169 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:35.609142 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qp7vx_7f25f798-bb34-44b4-83e2-19ab8622e667/konnectivity-agent/0.log" limit=1024 Jul 05 00:09:36.462505 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:36.462474 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qp7vx_7f25f798-bb34-44b4-83e2-19ab8622e667/konnectivity-agent/0.log" limit=1024 Jul 05 00:09:38.480021 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:38.479989 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qp7vx_7f25f798-bb34-44b4-83e2-19ab8622e667/konnectivity-agent/0.log" limit=1024 Jul 05 00:09:40.893002 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:40.892969 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:40.893363 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:40.893011 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-w97sv\" (UID: \"b4d54845-8c05-46b8-9130-3aea115d4f6c\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" Jul 05 00:09:40.893363 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:40.893045 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls\") pod \"dns-default-dm6pw\" (UID: \"21ab9246-2ceb-4ee9-be3d-f158461d8ed1\") " pod="openshift-dns/dns-default-dm6pw" Jul 05 00:09:40.893363 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:40.893110 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 05 00:09:40.893363 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:40.893119 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 05 00:09:40.893363 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:40.893137 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 00:09:40.893363 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:40.893125 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6845f467d-cqzsc: secret "image-registry-tls" not found Jul 05 00:09:40.893363 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:40.893180 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls podName:21ab9246-2ceb-4ee9-be3d-f158461d8ed1 nodeName:}" failed. No retries permitted until 2026-07-05 00:09:56.893167394 +0000 UTC m=+67.618183431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls") pod "dns-default-dm6pw" (UID: "21ab9246-2ceb-4ee9-be3d-f158461d8ed1") : secret "dns-default-metrics-tls" not found Jul 05 00:09:40.893363 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:40.893192 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls podName:8f05d3fd-5eed-413a-bc3a-90b63d81ee2f nodeName:}" failed. No retries permitted until 2026-07-05 00:09:56.893186743 +0000 UTC m=+67.618202780 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls") pod "image-registry-6845f467d-cqzsc" (UID: "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f") : secret "image-registry-tls" not found Jul 05 00:09:40.893363 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:40.893204 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert podName:b4d54845-8c05-46b8-9130-3aea115d4f6c nodeName:}" failed. No retries permitted until 2026-07-05 00:09:56.893198709 +0000 UTC m=+67.618214747 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-w97sv" (UID: "b4d54845-8c05-46b8-9130-3aea115d4f6c") : secret "networking-console-plugin-cert" not found Jul 05 00:09:40.989234 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:40.989206 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qp7vx_7f25f798-bb34-44b4-83e2-19ab8622e667/konnectivity-agent/0.log" limit=1024 Jul 05 00:09:41.061448 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:41.061413 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qp7vx_7f25f798-bb34-44b4-83e2-19ab8622e667/konnectivity-agent/0.log" limit=1024 Jul 05 00:09:50.908430 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:50.908405 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t2zpd" Jul 05 00:09:55.504935 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:55.504896 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs\") pod \"network-metrics-daemon-tlll9\" (UID: \"107f4ca7-7252-4983-9468-ba558c9e9e58\") " pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:09:55.507359 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:55.507340 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 05 00:09:55.515398 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:55.515381 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 05 00:09:55.515457 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:55.515444 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs podName:107f4ca7-7252-4983-9468-ba558c9e9e58 nodeName:}" failed. No retries permitted until 2026-07-05 00:10:59.515421205 +0000 UTC m=+130.240437305 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs") pod "network-metrics-daemon-tlll9" (UID: "107f4ca7-7252-4983-9468-ba558c9e9e58") : secret "metrics-daemon-secret" not found Jul 05 00:09:55.606198 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:55.606172 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret\") pod \"global-pull-secret-syncer-dxsxs\" (UID: \"d3f73c87-0938-4904-8db7-e28345166dd1\") " pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:09:55.608507 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:55.608489 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 05 00:09:55.620184 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:55.620158 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3f73c87-0938-4904-8db7-e28345166dd1-original-pull-secret\") pod \"global-pull-secret-syncer-dxsxs\" (UID: \"d3f73c87-0938-4904-8db7-e28345166dd1\") " pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:09:55.707225 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:55.707193 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzfgv\" (UniqueName: \"kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv\") pod \"network-check-target-t4ppn\" (UID: \"f2c0c53b-05d0-4dce-844b-95ce6cff9a0f\") " pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:09:55.709970 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:55.709952 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 05 00:09:55.720362 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:55.720336 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 05 00:09:55.730509 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:55.730483 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzfgv\" (UniqueName: \"kubernetes.io/projected/f2c0c53b-05d0-4dce-844b-95ce6cff9a0f-kube-api-access-gzfgv\") pod \"network-check-target-t4ppn\" (UID: \"f2c0c53b-05d0-4dce-844b-95ce6cff9a0f\") " pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:09:55.783314 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:55.783264 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxsxs" Jul 05 00:09:55.798690 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:55.798670 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fmjx4\"" Jul 05 00:09:55.806865 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:55.806845 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:09:55.911629 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:55.911595 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dxsxs"] Jul 05 00:09:55.914598 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:09:55.914573 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3f73c87_0938_4904_8db7_e28345166dd1.slice/crio-0197a83e5c37bc76df13f91202072305a822ec46cac6b067bd035803d4f57feb WatchSource:0}: Error finding container 0197a83e5c37bc76df13f91202072305a822ec46cac6b067bd035803d4f57feb: Status 404 returned error can't find the container with id 0197a83e5c37bc76df13f91202072305a822ec46cac6b067bd035803d4f57feb Jul 05 00:09:55.936071 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:55.936051 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t4ppn"] Jul 05 00:09:55.938352 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:09:55.938328 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2c0c53b_05d0_4dce_844b_95ce6cff9a0f.slice/crio-945edc6d4db281cefe66ae3dea38ee30a44b44715b396891ddb285c87e7a0f0a WatchSource:0}: Error finding container 945edc6d4db281cefe66ae3dea38ee30a44b44715b396891ddb285c87e7a0f0a: Status 404 returned error can't find the container with id 945edc6d4db281cefe66ae3dea38ee30a44b44715b396891ddb285c87e7a0f0a Jul 05 00:09:55.994228 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:55.994193 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t4ppn" event={"ID":"f2c0c53b-05d0-4dce-844b-95ce6cff9a0f","Type":"ContainerStarted","Data":"945edc6d4db281cefe66ae3dea38ee30a44b44715b396891ddb285c87e7a0f0a"} Jul 05 00:09:55.995206 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:55.995184 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dxsxs" event={"ID":"d3f73c87-0938-4904-8db7-e28345166dd1","Type":"ContainerStarted","Data":"0197a83e5c37bc76df13f91202072305a822ec46cac6b067bd035803d4f57feb"} Jul 05 00:09:56.917147 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:56.917109 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:09:56.917580 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:56.917169 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-w97sv\" (UID: \"b4d54845-8c05-46b8-9130-3aea115d4f6c\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" Jul 05 00:09:56.917580 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:09:56.917224 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls\") pod \"dns-default-dm6pw\" (UID: \"21ab9246-2ceb-4ee9-be3d-f158461d8ed1\") " pod="openshift-dns/dns-default-dm6pw" Jul 05 00:09:56.917580 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:56.917315 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 05 00:09:56.917580 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:56.917339 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6845f467d-cqzsc: secret "image-registry-tls" not found Jul 05 00:09:56.917580 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:56.917350 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 00:09:56.917580 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:56.917351 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 05 00:09:56.917580 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:56.917401 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls podName:8f05d3fd-5eed-413a-bc3a-90b63d81ee2f nodeName:}" failed. No retries permitted until 2026-07-05 00:10:28.917381109 +0000 UTC m=+99.642397170 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls") pod "image-registry-6845f467d-cqzsc" (UID: "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f") : secret "image-registry-tls" not found Jul 05 00:09:56.917580 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:56.917422 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert podName:b4d54845-8c05-46b8-9130-3aea115d4f6c nodeName:}" failed. No retries permitted until 2026-07-05 00:10:28.917408267 +0000 UTC m=+99.642424305 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-w97sv" (UID: "b4d54845-8c05-46b8-9130-3aea115d4f6c") : secret "networking-console-plugin-cert" not found Jul 05 00:09:56.917580 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:09:56.917435 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls podName:21ab9246-2ceb-4ee9-be3d-f158461d8ed1 nodeName:}" failed. No retries permitted until 2026-07-05 00:10:28.917429084 +0000 UTC m=+99.642445122 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls") pod "dns-default-dm6pw" (UID: "21ab9246-2ceb-4ee9-be3d-f158461d8ed1") : secret "dns-default-metrics-tls" not found Jul 05 00:10:02.012168 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:10:02.012127 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t4ppn" event={"ID":"f2c0c53b-05d0-4dce-844b-95ce6cff9a0f","Type":"ContainerStarted","Data":"3f8438cce934c992f39044ee93ba2d1229a6448d99fe718874f04348c9d4c950"} Jul 05 00:10:02.012572 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:10:02.012205 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:10:02.013518 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:10:02.013496 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dxsxs" event={"ID":"d3f73c87-0938-4904-8db7-e28345166dd1","Type":"ContainerStarted","Data":"29f3009d10186d9dc0b04c863768b5f1d3d3fc2f3b2aae01d9c7e03bc5edfe22"} Jul 05 00:10:02.029534 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:10:02.029395 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t4ppn" podStartSLOduration=66.450226551 podStartE2EDuration="1m12.029382327s" totalImagesPullingTime="5.579155776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:08:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:10:02.028899248 +0000 UTC m=+72.753915310" watchObservedRunningTime="2026-07-05 00:10:02.029382327 +0000 UTC m=+72.754398385" Jul 05 00:10:02.042557 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:10:02.042523 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dxsxs" podStartSLOduration=66.428463129 podStartE2EDuration="1m12.042509445s" totalImagesPullingTime="5.614046316s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 00:08:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:10:02.042470776 +0000 UTC m=+72.767486836" watchObservedRunningTime="2026-07-05 00:10:02.042509445 +0000 UTC m=+72.767525507" Jul 05 00:10:28.939729 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:10:28.939605 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-w97sv\" (UID: \"b4d54845-8c05-46b8-9130-3aea115d4f6c\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" Jul 05 00:10:28.939729 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:10:28.939661 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls\") pod \"dns-default-dm6pw\" (UID: \"21ab9246-2ceb-4ee9-be3d-f158461d8ed1\") " pod="openshift-dns/dns-default-dm6pw" Jul 05 00:10:28.939729 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:10:28.939712 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:10:28.940256 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:10:28.939742 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 05 00:10:28.940256 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:10:28.939781 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 00:10:28.940256 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:10:28.939809 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 05 00:10:28.940256 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:10:28.939822 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6845f467d-cqzsc: secret "image-registry-tls" not found Jul 05 00:10:28.940256 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:10:28.939833 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert podName:b4d54845-8c05-46b8-9130-3aea115d4f6c nodeName:}" failed. No retries permitted until 2026-07-05 00:11:32.939813038 +0000 UTC m=+163.664829095 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-w97sv" (UID: "b4d54845-8c05-46b8-9130-3aea115d4f6c") : secret "networking-console-plugin-cert" not found Jul 05 00:10:28.940256 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:10:28.939866 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls podName:21ab9246-2ceb-4ee9-be3d-f158461d8ed1 nodeName:}" failed. No retries permitted until 2026-07-05 00:11:32.939848978 +0000 UTC m=+163.664865028 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls") pod "dns-default-dm6pw" (UID: "21ab9246-2ceb-4ee9-be3d-f158461d8ed1") : secret "dns-default-metrics-tls" not found Jul 05 00:10:28.940256 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:10:28.939883 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls podName:8f05d3fd-5eed-413a-bc3a-90b63d81ee2f nodeName:}" failed. No retries permitted until 2026-07-05 00:11:32.939875301 +0000 UTC m=+163.664891339 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls") pod "image-registry-6845f467d-cqzsc" (UID: "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f") : secret "image-registry-tls" not found Jul 05 00:10:33.021024 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:10:33.020994 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t4ppn" Jul 05 00:10:59.544373 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:10:59.544341 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs\") pod \"network-metrics-daemon-tlll9\" (UID: \"107f4ca7-7252-4983-9468-ba558c9e9e58\") " pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:10:59.544945 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:10:59.544472 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 05 00:10:59.544945 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:10:59.544558 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs podName:107f4ca7-7252-4983-9468-ba558c9e9e58 nodeName:}" failed. No retries permitted until 2026-07-05 00:13:01.544536167 +0000 UTC m=+252.269552204 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs") pod "network-metrics-daemon-tlll9" (UID: "107f4ca7-7252-4983-9468-ba558c9e9e58") : secret "metrics-daemon-secret" not found Jul 05 00:11:28.047642 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:11:28.047597 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" podUID="b4d54845-8c05-46b8-9130-3aea115d4f6c" Jul 05 00:11:28.056779 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:11:28.056750 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6845f467d-cqzsc" podUID="8f05d3fd-5eed-413a-bc3a-90b63d81ee2f" Jul 05 00:11:28.065890 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:11:28.065870 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dm6pw" podUID="21ab9246-2ceb-4ee9-be3d-f158461d8ed1" Jul 05 00:11:28.214941 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:11:28.214916 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" Jul 05 00:11:28.214941 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:11:28.214927 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:11:28.215094 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:11:28.214918 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dm6pw" Jul 05 00:11:28.789835 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:11:28.789776 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-tlll9" podUID="107f4ca7-7252-4983-9468-ba558c9e9e58" Jul 05 00:11:32.973951 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:11:32.973901 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:11:32.974395 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:11:32.973960 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-w97sv\" (UID: \"b4d54845-8c05-46b8-9130-3aea115d4f6c\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" Jul 05 00:11:32.974395 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:11:32.974004 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls\") pod \"dns-default-dm6pw\" (UID: \"21ab9246-2ceb-4ee9-be3d-f158461d8ed1\") " pod="openshift-dns/dns-default-dm6pw" Jul 05 00:11:32.974395 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:11:32.974058 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 05 00:11:32.974395 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:11:32.974086 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6845f467d-cqzsc: secret "image-registry-tls" not found Jul 05 00:11:32.974395 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:11:32.974106 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 05 00:11:32.974395 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:11:32.974131 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 00:11:32.974395 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:11:32.974166 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert podName:b4d54845-8c05-46b8-9130-3aea115d4f6c nodeName:}" failed. No retries permitted until 2026-07-05 00:13:34.974145468 +0000 UTC m=+285.699161509 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-w97sv" (UID: "b4d54845-8c05-46b8-9130-3aea115d4f6c") : secret "networking-console-plugin-cert" not found Jul 05 00:11:32.974395 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:11:32.974184 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls podName:8f05d3fd-5eed-413a-bc3a-90b63d81ee2f nodeName:}" failed. No retries permitted until 2026-07-05 00:13:34.974174515 +0000 UTC m=+285.699190558 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls") pod "image-registry-6845f467d-cqzsc" (UID: "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f") : secret "image-registry-tls" not found Jul 05 00:11:32.974395 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:11:32.974198 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls podName:21ab9246-2ceb-4ee9-be3d-f158461d8ed1 nodeName:}" failed. No retries permitted until 2026-07-05 00:13:34.974190788 +0000 UTC m=+285.699206826 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls") pod "dns-default-dm6pw" (UID: "21ab9246-2ceb-4ee9-be3d-f158461d8ed1") : secret "dns-default-metrics-tls" not found Jul 05 00:11:41.770850 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:11:41.770817 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:13:01.551181 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:01.551134 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs\") pod \"network-metrics-daemon-tlll9\" (UID: \"107f4ca7-7252-4983-9468-ba558c9e9e58\") " pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:13:01.551729 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:01.551270 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 05 00:13:01.551729 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:01.551354 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs podName:107f4ca7-7252-4983-9468-ba558c9e9e58 nodeName:}" failed. No retries permitted until 2026-07-05 00:15:03.551334098 +0000 UTC m=+374.276350151 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs") pod "network-metrics-daemon-tlll9" (UID: "107f4ca7-7252-4983-9468-ba558c9e9e58") : secret "metrics-daemon-secret" not found Jul 05 00:13:16.211195 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.211117 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z7755"] Jul 05 00:13:16.212892 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.212876 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z7755" Jul 05 00:13:16.215116 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.215083 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-t6945"] Jul 05 00:13:16.215708 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.215690 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 05 00:13:16.215837 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.215690 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 05 00:13:16.219331 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.216338 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-bh7zc\"" Jul 05 00:13:16.220299 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.220273 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-j4rbf"] Jul 05 00:13:16.220299 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.220285 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-t6945" Jul 05 00:13:16.222112 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.222084 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-rj72b"] Jul 05 00:13:16.222242 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.222203 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" Jul 05 00:13:16.222746 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.222715 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gww2x\"" Jul 05 00:13:16.223095 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.223073 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 05 00:13:16.223647 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.223625 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 05 00:13:16.223957 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.223939 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 05 00:13:16.224362 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.224346 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z7755"] Jul 05 00:13:16.224502 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.224416 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-rj72b" Jul 05 00:13:16.225057 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.225037 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-49gmg\"" Jul 05 00:13:16.225267 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.225246 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 05 00:13:16.225343 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.225262 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 05 00:13:16.225895 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.225790 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 05 00:13:16.226107 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.226094 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 05 00:13:16.227426 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.227407 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 05 00:13:16.227527 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.227427 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 05 00:13:16.227527 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.227495 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 05 00:13:16.227877 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.227844 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wntsz\"" Jul 05 00:13:16.228170 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.228147 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 05 00:13:16.231207 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.231186 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-j4rbf"] Jul 05 00:13:16.232188 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.232003 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-rj72b"] Jul 05 00:13:16.232469 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.232434 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 05 00:13:16.235765 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.235743 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 05 00:13:16.242328 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.242309 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-t6945"] Jul 05 00:13:16.246896 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.246879 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e3b8e330-88ef-4783-9ef5-615ae05e4c88-config\") pod \"console-operator-68b757fb67-rj72b\" (UID: \"e3b8e330-88ef-4783-9ef5-615ae05e4c88\") " pod="openshift-console-operator/console-operator-68b757fb67-rj72b" Jul 05 00:13:16.246979 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.246903 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhjdr\" (UniqueName: \"kubernetes.io/projected/ce97d3ea-0558-47bb-bce3-0aebe2cc7603-kube-api-access-dhjdr\") pod \"insights-operator-5c847dcfc4-j4rbf\" (UID: \"ce97d3ea-0558-47bb-bce3-0aebe2cc7603\") " pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" Jul 05 00:13:16.246979 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.246922 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3b8e330-88ef-4783-9ef5-615ae05e4c88-trusted-ca\") pod \"console-operator-68b757fb67-rj72b\" (UID: \"e3b8e330-88ef-4783-9ef5-615ae05e4c88\") " pod="openshift-console-operator/console-operator-68b757fb67-rj72b" Jul 05 00:13:16.246979 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.246950 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ce97d3ea-0558-47bb-bce3-0aebe2cc7603-snapshots\") pod \"insights-operator-5c847dcfc4-j4rbf\" (UID: \"ce97d3ea-0558-47bb-bce3-0aebe2cc7603\") " pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" Jul 05 00:13:16.247085 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.246987 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce97d3ea-0558-47bb-bce3-0aebe2cc7603-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-j4rbf\" (UID: \"ce97d3ea-0558-47bb-bce3-0aebe2cc7603\") " pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" Jul 05 00:13:16.247085 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.247009 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce97d3ea-0558-47bb-bce3-0aebe2cc7603-tmp\") pod \"insights-operator-5c847dcfc4-j4rbf\" (UID: \"ce97d3ea-0558-47bb-bce3-0aebe2cc7603\") " pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" Jul 05 00:13:16.247085 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.247042 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e3b8e330-88ef-4783-9ef5-615ae05e4c88-serving-cert\") pod \"console-operator-68b757fb67-rj72b\" (UID: \"e3b8e330-88ef-4783-9ef5-615ae05e4c88\") " pod="openshift-console-operator/console-operator-68b757fb67-rj72b" Jul 05 00:13:16.247171 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.247081 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk9nd\" (UniqueName: \"kubernetes.io/projected/e3b8e330-88ef-4783-9ef5-615ae05e4c88-kube-api-access-nk9nd\") pod \"console-operator-68b757fb67-rj72b\" (UID: \"e3b8e330-88ef-4783-9ef5-615ae05e4c88\") " pod="openshift-console-operator/console-operator-68b757fb67-rj72b" Jul 05 00:13:16.247171 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.247118 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/49eef3d8-388f-4df9-8048-b762d1244786-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-t6945\" (UID: \"49eef3d8-388f-4df9-8048-b762d1244786\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-t6945" Jul 05 00:13:16.247171 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.247138 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5hf5\" (UniqueName: \"kubernetes.io/projected/dc6063cc-901a-41d7-8cca-ec261238dc1c-kube-api-access-l5hf5\") pod \"volume-data-source-validator-5d456fdbcd-z7755\" (UID: \"dc6063cc-901a-41d7-8cca-ec261238dc1c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z7755" Jul 05 00:13:16.247171 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.247164 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce97d3ea-0558-47bb-bce3-0aebe2cc7603-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-j4rbf\" (UID: \"ce97d3ea-0558-47bb-bce3-0aebe2cc7603\") " pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" Jul 05 00:13:16.247288 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.247255 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlc8l\" (UniqueName: \"kubernetes.io/projected/49eef3d8-388f-4df9-8048-b762d1244786-kube-api-access-nlc8l\") pod \"cluster-samples-operator-56fcf86bf-t6945\" (UID: \"49eef3d8-388f-4df9-8048-b762d1244786\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-t6945" Jul 05 00:13:16.247288 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.247277 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce97d3ea-0558-47bb-bce3-0aebe2cc7603-serving-cert\") pod \"insights-operator-5c847dcfc4-j4rbf\" (UID: \"ce97d3ea-0558-47bb-bce3-0aebe2cc7603\") " pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" Jul 05 00:13:16.302835 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.302784 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-j5gqz"] Jul 05 00:13:16.305102 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.305072 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j5gqz" Jul 05 00:13:16.306219 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.306192 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wvd2f"] Jul 05 00:13:16.307714 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.307696 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-7nwqv\"" Jul 05 00:13:16.307903 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.307886 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6d86866d97-ldmcp"] Jul 05 00:13:16.308016 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.308001 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wvd2f" Jul 05 00:13:16.309507 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.309493 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:16.310782 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.310763 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 05 00:13:16.311086 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.311067 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 05 00:13:16.311178 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.311069 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-6vn8r\"" Jul 05 00:13:16.311178 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.311072 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 05 00:13:16.311512 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.311498 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 05 00:13:16.312452 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.312435 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hvkzp\"" Jul 05 00:13:16.312658 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.312644 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 05 00:13:16.314078 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.314059 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 05 00:13:16.314152 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.314102 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 05 00:13:16.314846 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.314828 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 05 00:13:16.314939 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.314887 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 05 00:13:16.314993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.314940 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 05 00:13:16.316481 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.316457 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-j5gqz"] Jul 05 00:13:16.324372 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.324352 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wvd2f"] Jul 05 00:13:16.325740 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.325644 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d86866d97-ldmcp"] Jul 05 00:13:16.348347 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.348322 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce97d3ea-0558-47bb-bce3-0aebe2cc7603-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-j4rbf\" (UID: \"ce97d3ea-0558-47bb-bce3-0aebe2cc7603\") " pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" Jul 05 00:13:16.348460 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.348361 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-metrics-certs\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:16.348460 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.348389 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlc8l\" (UniqueName: \"kubernetes.io/projected/49eef3d8-388f-4df9-8048-b762d1244786-kube-api-access-nlc8l\") pod \"cluster-samples-operator-56fcf86bf-t6945\" (UID: \"49eef3d8-388f-4df9-8048-b762d1244786\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-t6945" Jul 05 00:13:16.348460 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.348416 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce97d3ea-0558-47bb-bce3-0aebe2cc7603-serving-cert\") pod \"insights-operator-5c847dcfc4-j4rbf\" (UID: \"ce97d3ea-0558-47bb-bce3-0aebe2cc7603\") " pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" Jul 05 00:13:16.348460 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.348439 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-stats-auth\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:16.348634 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.348466 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8zgk\" (UniqueName: \"kubernetes.io/projected/e1d14242-819e-4f92-bc54-eeebf3e858f3-kube-api-access-w8zgk\") pod \"kube-storage-version-migrator-operator-846bf668f7-wvd2f\" (UID: \"e1d14242-819e-4f92-bc54-eeebf3e858f3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wvd2f" Jul 05 00:13:16.348634 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.348492 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcjmz\" (UniqueName: \"kubernetes.io/projected/ccd75167-6ab6-481d-a7a3-9d08e69dacea-kube-api-access-lcjmz\") pod \"network-check-source-989f8b8dc-j5gqz\" (UID: \"ccd75167-6ab6-481d-a7a3-9d08e69dacea\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j5gqz" Jul 05 00:13:16.348634 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.348580 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1d14242-819e-4f92-bc54-eeebf3e858f3-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-wvd2f\" (UID: \"e1d14242-819e-4f92-bc54-eeebf3e858f3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wvd2f" Jul 05 00:13:16.348634 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.348615 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1d14242-819e-4f92-bc54-eeebf3e858f3-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-wvd2f\" (UID: \"e1d14242-819e-4f92-bc54-eeebf3e858f3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wvd2f" Jul 05 00:13:16.348768 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.348657 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e3b8e330-88ef-4783-9ef5-615ae05e4c88-config\") pod \"console-operator-68b757fb67-rj72b\" (UID: \"e3b8e330-88ef-4783-9ef5-615ae05e4c88\") " pod="openshift-console-operator/console-operator-68b757fb67-rj72b" Jul 05 00:13:16.348768 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.348690 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhjdr\" (UniqueName: \"kubernetes.io/projected/ce97d3ea-0558-47bb-bce3-0aebe2cc7603-kube-api-access-dhjdr\") pod \"insights-operator-5c847dcfc4-j4rbf\" (UID: \"ce97d3ea-0558-47bb-bce3-0aebe2cc7603\") " pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" Jul 05 00:13:16.348768 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.348715 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3b8e330-88ef-4783-9ef5-615ae05e4c88-trusted-ca\") pod \"console-operator-68b757fb67-rj72b\" (UID: \"e3b8e330-88ef-4783-9ef5-615ae05e4c88\") " pod="openshift-console-operator/console-operator-68b757fb67-rj72b" Jul 05 00:13:16.348944 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.348829 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ce97d3ea-0558-47bb-bce3-0aebe2cc7603-snapshots\") pod \"insights-operator-5c847dcfc4-j4rbf\" (UID: \"ce97d3ea-0558-47bb-bce3-0aebe2cc7603\") " pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" Jul 05 00:13:16.348944 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.348862 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce97d3ea-0558-47bb-bce3-0aebe2cc7603-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-j4rbf\" (UID: \"ce97d3ea-0558-47bb-bce3-0aebe2cc7603\") " pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" Jul 05 00:13:16.348944 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.348893 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548a01a5-00d4-4d0a-93ae-6468343cb273-service-ca-bundle\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:16.348944 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.348923 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce97d3ea-0558-47bb-bce3-0aebe2cc7603-tmp\") pod \"insights-operator-5c847dcfc4-j4rbf\" (UID: \"ce97d3ea-0558-47bb-bce3-0aebe2cc7603\") " pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" Jul 05 00:13:16.349128 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.348957 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-default-certificate\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:16.349128 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.348988 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc85k\" (UniqueName: \"kubernetes.io/projected/548a01a5-00d4-4d0a-93ae-6468343cb273-kube-api-access-xc85k\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:16.349128 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.349027 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e3b8e330-88ef-4783-9ef5-615ae05e4c88-serving-cert\") pod \"console-operator-68b757fb67-rj72b\" (UID: \"e3b8e330-88ef-4783-9ef5-615ae05e4c88\") " pod="openshift-console-operator/console-operator-68b757fb67-rj72b" Jul 05 00:13:16.349128 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.349054 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk9nd\" (UniqueName: \"kubernetes.io/projected/e3b8e330-88ef-4783-9ef5-615ae05e4c88-kube-api-access-nk9nd\") pod \"console-operator-68b757fb67-rj72b\" (UID: \"e3b8e330-88ef-4783-9ef5-615ae05e4c88\") " pod="openshift-console-operator/console-operator-68b757fb67-rj72b" Jul 05 00:13:16.349128 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.349087 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/49eef3d8-388f-4df9-8048-b762d1244786-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-t6945\" (UID: \"49eef3d8-388f-4df9-8048-b762d1244786\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-t6945" Jul 05 00:13:16.349128 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.349112 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5hf5\" (UniqueName: \"kubernetes.io/projected/dc6063cc-901a-41d7-8cca-ec261238dc1c-kube-api-access-l5hf5\") pod \"volume-data-source-validator-5d456fdbcd-z7755\" (UID: \"dc6063cc-901a-41d7-8cca-ec261238dc1c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z7755" Jul 05 00:13:16.349416 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.349276 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce97d3ea-0558-47bb-bce3-0aebe2cc7603-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-j4rbf\" (UID: \"ce97d3ea-0558-47bb-bce3-0aebe2cc7603\") " pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" Jul 05 00:13:16.349416 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.349314 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e3b8e330-88ef-4783-9ef5-615ae05e4c88-config\") pod \"console-operator-68b757fb67-rj72b\" (UID: \"e3b8e330-88ef-4783-9ef5-615ae05e4c88\") " pod="openshift-console-operator/console-operator-68b757fb67-rj72b" Jul 05 00:13:16.349416 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.349387 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce97d3ea-0558-47bb-bce3-0aebe2cc7603-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-j4rbf\" (UID: \"ce97d3ea-0558-47bb-bce3-0aebe2cc7603\") " pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" Jul 05 00:13:16.349624 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:16.349425 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 05 00:13:16.349624 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:16.349489 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49eef3d8-388f-4df9-8048-b762d1244786-samples-operator-tls podName:49eef3d8-388f-4df9-8048-b762d1244786 nodeName:}" failed. No retries permitted until 2026-07-05 00:13:16.849471286 +0000 UTC m=+267.574487326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/49eef3d8-388f-4df9-8048-b762d1244786-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-t6945" (UID: "49eef3d8-388f-4df9-8048-b762d1244786") : secret "samples-operator-tls" not found Jul 05 00:13:16.349731 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.349664 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3b8e330-88ef-4783-9ef5-615ae05e4c88-trusted-ca\") pod \"console-operator-68b757fb67-rj72b\" (UID: \"e3b8e330-88ef-4783-9ef5-615ae05e4c88\") " pod="openshift-console-operator/console-operator-68b757fb67-rj72b" Jul 05 00:13:16.349783 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.349747 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce97d3ea-0558-47bb-bce3-0aebe2cc7603-tmp\") pod \"insights-operator-5c847dcfc4-j4rbf\" (UID: \"ce97d3ea-0558-47bb-bce3-0aebe2cc7603\") " pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" Jul 05 00:13:16.349979 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.349959 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ce97d3ea-0558-47bb-bce3-0aebe2cc7603-snapshots\") pod \"insights-operator-5c847dcfc4-j4rbf\" (UID: \"ce97d3ea-0558-47bb-bce3-0aebe2cc7603\") " pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" Jul 05 00:13:16.350947 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.350929 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce97d3ea-0558-47bb-bce3-0aebe2cc7603-serving-cert\") pod \"insights-operator-5c847dcfc4-j4rbf\" (UID: \"ce97d3ea-0558-47bb-bce3-0aebe2cc7603\") " pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" Jul 05 00:13:16.351317 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.351300 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e3b8e330-88ef-4783-9ef5-615ae05e4c88-serving-cert\") pod \"console-operator-68b757fb67-rj72b\" (UID: \"e3b8e330-88ef-4783-9ef5-615ae05e4c88\") " pod="openshift-console-operator/console-operator-68b757fb67-rj72b" Jul 05 00:13:16.359303 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.359276 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlc8l\" (UniqueName: \"kubernetes.io/projected/49eef3d8-388f-4df9-8048-b762d1244786-kube-api-access-nlc8l\") pod \"cluster-samples-operator-56fcf86bf-t6945\" (UID: \"49eef3d8-388f-4df9-8048-b762d1244786\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-t6945" Jul 05 00:13:16.360247 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.360217 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5hf5\" (UniqueName: \"kubernetes.io/projected/dc6063cc-901a-41d7-8cca-ec261238dc1c-kube-api-access-l5hf5\") pod \"volume-data-source-validator-5d456fdbcd-z7755\" (UID: \"dc6063cc-901a-41d7-8cca-ec261238dc1c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z7755" Jul 05 00:13:16.360570 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.360550 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhjdr\" (UniqueName: \"kubernetes.io/projected/ce97d3ea-0558-47bb-bce3-0aebe2cc7603-kube-api-access-dhjdr\") pod \"insights-operator-5c847dcfc4-j4rbf\" (UID: \"ce97d3ea-0558-47bb-bce3-0aebe2cc7603\") " pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" Jul 05 00:13:16.360662 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.360642 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk9nd\" (UniqueName: \"kubernetes.io/projected/e3b8e330-88ef-4783-9ef5-615ae05e4c88-kube-api-access-nk9nd\") pod \"console-operator-68b757fb67-rj72b\" (UID: \"e3b8e330-88ef-4783-9ef5-615ae05e4c88\") " pod="openshift-console-operator/console-operator-68b757fb67-rj72b" Jul 05 00:13:16.449628 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.449593 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548a01a5-00d4-4d0a-93ae-6468343cb273-service-ca-bundle\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:16.449628 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.449635 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-default-certificate\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:16.449907 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.449652 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc85k\" (UniqueName: \"kubernetes.io/projected/548a01a5-00d4-4d0a-93ae-6468343cb273-kube-api-access-xc85k\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:16.449907 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.449844 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-metrics-certs\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:16.449907 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:16.449877 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/548a01a5-00d4-4d0a-93ae-6468343cb273-service-ca-bundle podName:548a01a5-00d4-4d0a-93ae-6468343cb273 nodeName:}" failed. No retries permitted until 2026-07-05 00:13:16.949850518 +0000 UTC m=+267.674866569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/548a01a5-00d4-4d0a-93ae-6468343cb273-service-ca-bundle") pod "router-default-6d86866d97-ldmcp" (UID: "548a01a5-00d4-4d0a-93ae-6468343cb273") : configmap references non-existent config key: service-ca.crt Jul 05 00:13:16.450104 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.449920 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-stats-auth\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:16.450104 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:16.449931 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 00:13:16.450104 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.449958 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8zgk\" (UniqueName: \"kubernetes.io/projected/e1d14242-819e-4f92-bc54-eeebf3e858f3-kube-api-access-w8zgk\") pod \"kube-storage-version-migrator-operator-846bf668f7-wvd2f\" (UID: \"e1d14242-819e-4f92-bc54-eeebf3e858f3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wvd2f" Jul 05 00:13:16.450104 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:16.449978 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-metrics-certs podName:548a01a5-00d4-4d0a-93ae-6468343cb273 nodeName:}" failed. No retries permitted until 2026-07-05 00:13:16.949962628 +0000 UTC m=+267.674978668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-metrics-certs") pod "router-default-6d86866d97-ldmcp" (UID: "548a01a5-00d4-4d0a-93ae-6468343cb273") : secret "router-metrics-certs-default" not found Jul 05 00:13:16.450104 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.450008 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcjmz\" (UniqueName: \"kubernetes.io/projected/ccd75167-6ab6-481d-a7a3-9d08e69dacea-kube-api-access-lcjmz\") pod \"network-check-source-989f8b8dc-j5gqz\" (UID: \"ccd75167-6ab6-481d-a7a3-9d08e69dacea\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j5gqz" Jul 05 00:13:16.450104 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.450061 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1d14242-819e-4f92-bc54-eeebf3e858f3-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-wvd2f\" (UID: \"e1d14242-819e-4f92-bc54-eeebf3e858f3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wvd2f" Jul 05 00:13:16.450104 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.450084 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1d14242-819e-4f92-bc54-eeebf3e858f3-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-wvd2f\" (UID: \"e1d14242-819e-4f92-bc54-eeebf3e858f3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wvd2f" Jul 05 00:13:16.450622 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.450603 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1d14242-819e-4f92-bc54-eeebf3e858f3-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-wvd2f\" (UID: \"e1d14242-819e-4f92-bc54-eeebf3e858f3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wvd2f" Jul 05 00:13:16.452115 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.452085 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1d14242-819e-4f92-bc54-eeebf3e858f3-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-wvd2f\" (UID: \"e1d14242-819e-4f92-bc54-eeebf3e858f3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wvd2f" Jul 05 00:13:16.452242 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.452212 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-default-certificate\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:16.452339 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.452317 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-stats-auth\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:16.458436 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.458417 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc85k\" (UniqueName: \"kubernetes.io/projected/548a01a5-00d4-4d0a-93ae-6468343cb273-kube-api-access-xc85k\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:16.458973 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.458952 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8zgk\" (UniqueName: \"kubernetes.io/projected/e1d14242-819e-4f92-bc54-eeebf3e858f3-kube-api-access-w8zgk\") pod \"kube-storage-version-migrator-operator-846bf668f7-wvd2f\" (UID: \"e1d14242-819e-4f92-bc54-eeebf3e858f3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wvd2f" Jul 05 00:13:16.459172 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.459157 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcjmz\" (UniqueName: \"kubernetes.io/projected/ccd75167-6ab6-481d-a7a3-9d08e69dacea-kube-api-access-lcjmz\") pod \"network-check-source-989f8b8dc-j5gqz\" (UID: \"ccd75167-6ab6-481d-a7a3-9d08e69dacea\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j5gqz" Jul 05 00:13:16.527423 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.527349 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z7755" Jul 05 00:13:16.541521 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.541497 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" Jul 05 00:13:16.547445 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.547413 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-rj72b" Jul 05 00:13:16.615539 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.615500 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j5gqz" Jul 05 00:13:16.622368 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.621605 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wvd2f" Jul 05 00:13:16.673216 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.673100 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z7755"] Jul 05 00:13:16.680021 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:13:16.679985 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc6063cc_901a_41d7_8cca_ec261238dc1c.slice/crio-43408b73d6c413945af39817ecb3069eaf95154b2787cf01655317e33c110cc8 WatchSource:0}: Error finding container 43408b73d6c413945af39817ecb3069eaf95154b2787cf01655317e33c110cc8: Status 404 returned error can't find the container with id 43408b73d6c413945af39817ecb3069eaf95154b2787cf01655317e33c110cc8 Jul 05 00:13:16.693762 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.693720 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-j4rbf"] Jul 05 00:13:16.697293 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:13:16.697258 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce97d3ea_0558_47bb_bce3_0aebe2cc7603.slice/crio-a1fe9c1ac809681380b213adfb181a6b9044a48ebe865c0c69b7a3dd48f86f72 WatchSource:0}: Error finding container a1fe9c1ac809681380b213adfb181a6b9044a48ebe865c0c69b7a3dd48f86f72: Status 404 returned error can't find the container with id a1fe9c1ac809681380b213adfb181a6b9044a48ebe865c0c69b7a3dd48f86f72 Jul 05 00:13:16.721538 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.721508 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-rj72b"] Jul 05 00:13:16.725048 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:13:16.725005 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3b8e330_88ef_4783_9ef5_615ae05e4c88.slice/crio-f025bbf1b40fcba3894c9df59410896beab0b689170b65abd35dd221bfdefd70 WatchSource:0}: Error finding container f025bbf1b40fcba3894c9df59410896beab0b689170b65abd35dd221bfdefd70: Status 404 returned error can't find the container with id f025bbf1b40fcba3894c9df59410896beab0b689170b65abd35dd221bfdefd70 Jul 05 00:13:16.762219 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.762183 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wvd2f"] Jul 05 00:13:16.765528 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:13:16.765498 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1d14242_819e_4f92_bc54_eeebf3e858f3.slice/crio-c43bdc893f58de61808adfa84330b5a762e8747c6d74ef97681ab3a063376643 WatchSource:0}: Error finding container c43bdc893f58de61808adfa84330b5a762e8747c6d74ef97681ab3a063376643: Status 404 returned error can't find the container with id c43bdc893f58de61808adfa84330b5a762e8747c6d74ef97681ab3a063376643 Jul 05 00:13:16.779316 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.779244 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-j5gqz"] Jul 05 00:13:16.781385 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:13:16.781367 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccd75167_6ab6_481d_a7a3_9d08e69dacea.slice/crio-f57027b846417c7d5a0bc4dbf9daa361fe025e69ac5be9194c76af15630c5c00 WatchSource:0}: Error finding container f57027b846417c7d5a0bc4dbf9daa361fe025e69ac5be9194c76af15630c5c00: Status 404 returned error can't find the container with id f57027b846417c7d5a0bc4dbf9daa361fe025e69ac5be9194c76af15630c5c00 Jul 05 00:13:16.853935 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.853909 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/49eef3d8-388f-4df9-8048-b762d1244786-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-t6945\" (UID: \"49eef3d8-388f-4df9-8048-b762d1244786\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-t6945" Jul 05 00:13:16.854061 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:16.854042 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 05 00:13:16.854114 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:16.854098 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49eef3d8-388f-4df9-8048-b762d1244786-samples-operator-tls podName:49eef3d8-388f-4df9-8048-b762d1244786 nodeName:}" failed. No retries permitted until 2026-07-05 00:13:17.854083725 +0000 UTC m=+268.579099762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/49eef3d8-388f-4df9-8048-b762d1244786-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-t6945" (UID: "49eef3d8-388f-4df9-8048-b762d1244786") : secret "samples-operator-tls" not found Jul 05 00:13:16.954594 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.954563 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548a01a5-00d4-4d0a-93ae-6468343cb273-service-ca-bundle\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:16.954743 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:16.954635 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-metrics-certs\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:16.954829 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:16.954738 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/548a01a5-00d4-4d0a-93ae-6468343cb273-service-ca-bundle podName:548a01a5-00d4-4d0a-93ae-6468343cb273 nodeName:}" failed. No retries permitted until 2026-07-05 00:13:17.954718993 +0000 UTC m=+268.679735051 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/548a01a5-00d4-4d0a-93ae-6468343cb273-service-ca-bundle") pod "router-default-6d86866d97-ldmcp" (UID: "548a01a5-00d4-4d0a-93ae-6468343cb273") : configmap references non-existent config key: service-ca.crt Jul 05 00:13:16.954829 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:16.954753 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 00:13:16.954829 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:16.954824 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-metrics-certs podName:548a01a5-00d4-4d0a-93ae-6468343cb273 nodeName:}" failed. No retries permitted until 2026-07-05 00:13:17.954780523 +0000 UTC m=+268.679796559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-metrics-certs") pod "router-default-6d86866d97-ldmcp" (UID: "548a01a5-00d4-4d0a-93ae-6468343cb273") : secret "router-metrics-certs-default" not found Jul 05 00:13:17.472632 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:17.471019 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wvd2f" event={"ID":"e1d14242-819e-4f92-bc54-eeebf3e858f3","Type":"ContainerStarted","Data":"c43bdc893f58de61808adfa84330b5a762e8747c6d74ef97681ab3a063376643"} Jul 05 00:13:17.478090 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:17.478003 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" event={"ID":"ce97d3ea-0558-47bb-bce3-0aebe2cc7603","Type":"ContainerStarted","Data":"a1fe9c1ac809681380b213adfb181a6b9044a48ebe865c0c69b7a3dd48f86f72"} Jul 05 00:13:17.479616 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:17.479561 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z7755" event={"ID":"dc6063cc-901a-41d7-8cca-ec261238dc1c","Type":"ContainerStarted","Data":"43408b73d6c413945af39817ecb3069eaf95154b2787cf01655317e33c110cc8"} Jul 05 00:13:17.481413 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:17.481343 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j5gqz" event={"ID":"ccd75167-6ab6-481d-a7a3-9d08e69dacea","Type":"ContainerStarted","Data":"abd77a06cf0d7299d442fb65a454f60d5f9f6f2df751ea5a05906ae0f350bb69"} Jul 05 00:13:17.481413 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:17.481382 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j5gqz" event={"ID":"ccd75167-6ab6-481d-a7a3-9d08e69dacea","Type":"ContainerStarted","Data":"f57027b846417c7d5a0bc4dbf9daa361fe025e69ac5be9194c76af15630c5c00"} Jul 05 00:13:17.483523 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:17.483500 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-rj72b" event={"ID":"e3b8e330-88ef-4783-9ef5-615ae05e4c88","Type":"ContainerStarted","Data":"f025bbf1b40fcba3894c9df59410896beab0b689170b65abd35dd221bfdefd70"} Jul 05 00:13:17.874212 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:17.874161 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/49eef3d8-388f-4df9-8048-b762d1244786-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-t6945\" (UID: \"49eef3d8-388f-4df9-8048-b762d1244786\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-t6945" Jul 05 00:13:17.874824 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:17.874784 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 05 00:13:17.874920 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:17.874869 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49eef3d8-388f-4df9-8048-b762d1244786-samples-operator-tls podName:49eef3d8-388f-4df9-8048-b762d1244786 nodeName:}" failed. No retries permitted until 2026-07-05 00:13:19.874849 +0000 UTC m=+270.599865043 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/49eef3d8-388f-4df9-8048-b762d1244786-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-t6945" (UID: "49eef3d8-388f-4df9-8048-b762d1244786") : secret "samples-operator-tls" not found Jul 05 00:13:17.975476 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:17.975428 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548a01a5-00d4-4d0a-93ae-6468343cb273-service-ca-bundle\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:17.975712 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:17.975535 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-metrics-certs\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:17.975712 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:17.975628 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/548a01a5-00d4-4d0a-93ae-6468343cb273-service-ca-bundle podName:548a01a5-00d4-4d0a-93ae-6468343cb273 nodeName:}" failed. No retries permitted until 2026-07-05 00:13:19.975603502 +0000 UTC m=+270.700619546 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/548a01a5-00d4-4d0a-93ae-6468343cb273-service-ca-bundle") pod "router-default-6d86866d97-ldmcp" (UID: "548a01a5-00d4-4d0a-93ae-6468343cb273") : configmap references non-existent config key: service-ca.crt Jul 05 00:13:17.975712 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:17.975658 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 00:13:17.975712 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:17.975709 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-metrics-certs podName:548a01a5-00d4-4d0a-93ae-6468343cb273 nodeName:}" failed. No retries permitted until 2026-07-05 00:13:19.97569416 +0000 UTC m=+270.700710200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-metrics-certs") pod "router-default-6d86866d97-ldmcp" (UID: "548a01a5-00d4-4d0a-93ae-6468343cb273") : secret "router-metrics-certs-default" not found Jul 05 00:13:18.489535 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:18.489126 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z7755" event={"ID":"dc6063cc-901a-41d7-8cca-ec261238dc1c","Type":"ContainerStarted","Data":"2adc6a6a86033ce489382718e17b957ccba554d5a7eb30d7e8da593fedb21b7d"} Jul 05 00:13:18.505016 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:18.504968 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z7755" podStartSLOduration=1.047625979 podStartE2EDuration="2.504946677s" totalImagesPullingTime="1.457320698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:13:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:13:18.503747819 +0000 UTC m=+269.228763881" watchObservedRunningTime="2026-07-05 00:13:18.504946677 +0000 UTC m=+269.229962737" Jul 05 00:13:18.505330 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:18.505265 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-j5gqz" podStartSLOduration=2.5052529359999998 podStartE2EDuration="2.505252936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:13:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:13:17.497462719 +0000 UTC m=+268.222478778" watchObservedRunningTime="2026-07-05 00:13:18.505252936 +0000 UTC m=+269.230269024" Jul 05 00:13:19.893715 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:19.893687 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/49eef3d8-388f-4df9-8048-b762d1244786-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-t6945\" (UID: \"49eef3d8-388f-4df9-8048-b762d1244786\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-t6945" Jul 05 00:13:19.894010 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:19.893842 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 05 00:13:19.894010 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:19.893904 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49eef3d8-388f-4df9-8048-b762d1244786-samples-operator-tls podName:49eef3d8-388f-4df9-8048-b762d1244786 nodeName:}" failed. No retries permitted until 2026-07-05 00:13:23.893888372 +0000 UTC m=+274.618904408 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/49eef3d8-388f-4df9-8048-b762d1244786-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-t6945" (UID: "49eef3d8-388f-4df9-8048-b762d1244786") : secret "samples-operator-tls" not found Jul 05 00:13:19.994721 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:19.994651 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-metrics-certs\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:19.994850 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:19.994730 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548a01a5-00d4-4d0a-93ae-6468343cb273-service-ca-bundle\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:19.994850 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:19.994826 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 00:13:19.994922 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:19.994859 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/548a01a5-00d4-4d0a-93ae-6468343cb273-service-ca-bundle podName:548a01a5-00d4-4d0a-93ae-6468343cb273 nodeName:}" failed. No retries permitted until 2026-07-05 00:13:23.994843636 +0000 UTC m=+274.719859685 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/548a01a5-00d4-4d0a-93ae-6468343cb273-service-ca-bundle") pod "router-default-6d86866d97-ldmcp" (UID: "548a01a5-00d4-4d0a-93ae-6468343cb273") : configmap references non-existent config key: service-ca.crt Jul 05 00:13:19.994922 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:19.994887 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-metrics-certs podName:548a01a5-00d4-4d0a-93ae-6468343cb273 nodeName:}" failed. No retries permitted until 2026-07-05 00:13:23.994869818 +0000 UTC m=+274.719885858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-metrics-certs") pod "router-default-6d86866d97-ldmcp" (UID: "548a01a5-00d4-4d0a-93ae-6468343cb273") : secret "router-metrics-certs-default" not found Jul 05 00:13:20.496413 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:20.496375 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wvd2f" event={"ID":"e1d14242-819e-4f92-bc54-eeebf3e858f3","Type":"ContainerStarted","Data":"0dd658737cd26ce3b075c9c72cf639e6bca0c72c8bfb3c63e1eaa00d107b5d91"} Jul 05 00:13:20.497890 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:20.497863 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" event={"ID":"ce97d3ea-0558-47bb-bce3-0aebe2cc7603","Type":"ContainerStarted","Data":"e9f3f954dbe4d479a69d74d1c48ce6824b2165d952d4e5302c6ad1202f840ab7"} Jul 05 00:13:20.499279 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:20.499257 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/0.log" Jul 05 00:13:20.499394 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:20.499299 2561 generic.go:356] "Generic (PLEG): container finished" podID="e3b8e330-88ef-4783-9ef5-615ae05e4c88" containerID="7b8772425097f5da144dbebb515da44e90e94ad07bdccf31e0cc2abb1616b50a" exitCode=255 Jul 05 00:13:20.499394 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:20.499327 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-rj72b" event={"ID":"e3b8e330-88ef-4783-9ef5-615ae05e4c88","Type":"ContainerDied","Data":"7b8772425097f5da144dbebb515da44e90e94ad07bdccf31e0cc2abb1616b50a"} Jul 05 00:13:20.499519 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:20.499504 2561 scope.go:117] "RemoveContainer" containerID="7b8772425097f5da144dbebb515da44e90e94ad07bdccf31e0cc2abb1616b50a" Jul 05 00:13:20.512362 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:20.512318 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wvd2f" podStartSLOduration=1.535245242 podStartE2EDuration="4.512303254s" totalImagesPullingTime="2.977058012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:13:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:13:20.511177982 +0000 UTC m=+271.236194066" watchObservedRunningTime="2026-07-05 00:13:20.512303254 +0000 UTC m=+271.237319314" Jul 05 00:13:20.529546 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:20.529498 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" podStartSLOduration=1.49096269 podStartE2EDuration="4.529478024s" totalImagesPullingTime="3.038515334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:13:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:13:20.527774351 +0000 UTC m=+271.252790411" watchObservedRunningTime="2026-07-05 00:13:20.529478024 +0000 UTC m=+271.254494086" Jul 05 00:13:20.896885 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:20.895894 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tn5mz"] Jul 05 00:13:20.898836 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:20.898811 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:20.901943 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:20.901745 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 05 00:13:20.902291 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:20.902263 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 05 00:13:20.902427 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:20.902404 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m5c25\"" Jul 05 00:13:20.911449 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:20.911430 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tn5mz"] Jul 05 00:13:21.002745 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:21.002715 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-data-volume\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:21.002908 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:21.002791 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:21.002968 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:21.002932 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-crio-socket\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:21.002968 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:21.002958 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhkd4\" (UniqueName: \"kubernetes.io/projected/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-kube-api-access-qhkd4\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:21.003039 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:21.003026 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:21.103997 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:21.103962 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-crio-socket\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:21.103997 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:21.104005 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhkd4\" (UniqueName: \"kubernetes.io/projected/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-kube-api-access-qhkd4\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:21.104229 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:21.104077 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:21.104229 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:21.104101 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-crio-socket\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:21.104229 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:21.104114 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-data-volume\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:21.104229 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:21.104191 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:21.104426 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:21.104234 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 00:13:21.104426 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:21.104308 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 00:13:21.104426 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:21.104340 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-insights-runtime-extractor-tls podName:c51e3fb6-b6ca-4a4b-8895-cc595f81e82a nodeName:}" failed. No retries permitted until 2026-07-05 00:13:21.604317171 +0000 UTC m=+272.329333210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tn5mz" (UID: "c51e3fb6-b6ca-4a4b-8895-cc595f81e82a") : secret "insights-runtime-extractor-tls" not found Jul 05 00:13:21.104426 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:21.104379 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-kube-rbac-proxy-cm podName:c51e3fb6-b6ca-4a4b-8895-cc595f81e82a nodeName:}" failed. No retries permitted until 2026-07-05 00:13:21.604361343 +0000 UTC m=+272.329377399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tn5mz" (UID: "c51e3fb6-b6ca-4a4b-8895-cc595f81e82a") : configmap "kube-rbac-proxy" not found Jul 05 00:13:21.104426 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:21.104405 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-data-volume\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:21.120715 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:21.120688 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhkd4\" (UniqueName: \"kubernetes.io/projected/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-kube-api-access-qhkd4\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:21.504774 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:21.504707 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/1.log" Jul 05 00:13:21.505157 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:21.505141 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/0.log" Jul 05 00:13:21.505218 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:21.505176 2561 generic.go:356] "Generic (PLEG): container finished" podID="e3b8e330-88ef-4783-9ef5-615ae05e4c88" containerID="2f3b4c6cfcef6d0022b859a7a9d44aa070dee025136a70b88a7aaf8365ef013a" exitCode=255 Jul 05 00:13:21.505276 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:21.505255 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-rj72b" event={"ID":"e3b8e330-88ef-4783-9ef5-615ae05e4c88","Type":"ContainerDied","Data":"2f3b4c6cfcef6d0022b859a7a9d44aa070dee025136a70b88a7aaf8365ef013a"} Jul 05 00:13:21.505338 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:21.505327 2561 scope.go:117] "RemoveContainer" containerID="7b8772425097f5da144dbebb515da44e90e94ad07bdccf31e0cc2abb1616b50a" Jul 05 00:13:21.505529 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:21.505498 2561 scope.go:117] "RemoveContainer" containerID="2f3b4c6cfcef6d0022b859a7a9d44aa070dee025136a70b88a7aaf8365ef013a" Jul 05 00:13:21.505718 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:21.505694 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-rj72b_openshift-console-operator(e3b8e330-88ef-4783-9ef5-615ae05e4c88)\"" pod="openshift-console-operator/console-operator-68b757fb67-rj72b" podUID="e3b8e330-88ef-4783-9ef5-615ae05e4c88" Jul 05 00:13:21.608425 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:21.608396 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:21.608571 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:21.608527 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 00:13:21.608631 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:21.608569 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:21.608631 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:21.608589 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-insights-runtime-extractor-tls podName:c51e3fb6-b6ca-4a4b-8895-cc595f81e82a nodeName:}" failed. No retries permitted until 2026-07-05 00:13:22.608570049 +0000 UTC m=+273.333586106 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tn5mz" (UID: "c51e3fb6-b6ca-4a4b-8895-cc595f81e82a") : secret "insights-runtime-extractor-tls" not found Jul 05 00:13:21.608631 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:21.608624 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 00:13:21.608783 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:21.608679 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-kube-rbac-proxy-cm podName:c51e3fb6-b6ca-4a4b-8895-cc595f81e82a nodeName:}" failed. No retries permitted until 2026-07-05 00:13:22.608660845 +0000 UTC m=+273.333676885 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tn5mz" (UID: "c51e3fb6-b6ca-4a4b-8895-cc595f81e82a") : configmap "kube-rbac-proxy" not found Jul 05 00:13:22.509492 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:22.509466 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/1.log" Jul 05 00:13:22.509975 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:22.509880 2561 scope.go:117] "RemoveContainer" containerID="2f3b4c6cfcef6d0022b859a7a9d44aa070dee025136a70b88a7aaf8365ef013a" Jul 05 00:13:22.510112 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:22.510089 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-rj72b_openshift-console-operator(e3b8e330-88ef-4783-9ef5-615ae05e4c88)\"" pod="openshift-console-operator/console-operator-68b757fb67-rj72b" podUID="e3b8e330-88ef-4783-9ef5-615ae05e4c88" Jul 05 00:13:22.542141 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:22.542114 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-7xdgp"] Jul 05 00:13:22.544683 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:22.544662 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-7xdgp" Jul 05 00:13:22.547204 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:22.547181 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 05 00:13:22.547303 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:22.547181 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 05 00:13:22.547303 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:22.547239 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 05 00:13:22.547494 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:22.547479 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 05 00:13:22.547638 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:22.547623 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-scrxh\"" Jul 05 00:13:22.553020 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:22.553001 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-7xdgp"] Jul 05 00:13:22.617311 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:22.617286 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:22.617436 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:22.617382 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 00:13:22.617436 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:22.617436 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-kube-rbac-proxy-cm podName:c51e3fb6-b6ca-4a4b-8895-cc595f81e82a nodeName:}" failed. No retries permitted until 2026-07-05 00:13:24.617418168 +0000 UTC m=+275.342434220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tn5mz" (UID: "c51e3fb6-b6ca-4a4b-8895-cc595f81e82a") : configmap "kube-rbac-proxy" not found Jul 05 00:13:22.617570 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:22.617518 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/947b9928-802c-4a56-8361-52fbd02eb0ce-signing-key\") pod \"service-ca-758f599c5-7xdgp\" (UID: \"947b9928-802c-4a56-8361-52fbd02eb0ce\") " pod="openshift-service-ca/service-ca-758f599c5-7xdgp" Jul 05 00:13:22.617570 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:22.617544 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxf97\" (UniqueName: \"kubernetes.io/projected/947b9928-802c-4a56-8361-52fbd02eb0ce-kube-api-access-kxf97\") pod \"service-ca-758f599c5-7xdgp\" (UID: \"947b9928-802c-4a56-8361-52fbd02eb0ce\") " pod="openshift-service-ca/service-ca-758f599c5-7xdgp" Jul 05 00:13:22.617674 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:22.617631 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/947b9928-802c-4a56-8361-52fbd02eb0ce-signing-cabundle\") pod \"service-ca-758f599c5-7xdgp\" (UID: \"947b9928-802c-4a56-8361-52fbd02eb0ce\") " pod="openshift-service-ca/service-ca-758f599c5-7xdgp" Jul 05 00:13:22.617718 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:22.617678 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:22.617781 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:22.617767 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 00:13:22.617842 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:22.617830 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-insights-runtime-extractor-tls podName:c51e3fb6-b6ca-4a4b-8895-cc595f81e82a nodeName:}" failed. No retries permitted until 2026-07-05 00:13:24.617819971 +0000 UTC m=+275.342836008 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tn5mz" (UID: "c51e3fb6-b6ca-4a4b-8895-cc595f81e82a") : secret "insights-runtime-extractor-tls" not found Jul 05 00:13:22.718229 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:22.718198 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/947b9928-802c-4a56-8361-52fbd02eb0ce-signing-key\") pod \"service-ca-758f599c5-7xdgp\" (UID: \"947b9928-802c-4a56-8361-52fbd02eb0ce\") " pod="openshift-service-ca/service-ca-758f599c5-7xdgp" Jul 05 00:13:22.718229 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:22.718232 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxf97\" (UniqueName: \"kubernetes.io/projected/947b9928-802c-4a56-8361-52fbd02eb0ce-kube-api-access-kxf97\") pod \"service-ca-758f599c5-7xdgp\" (UID: \"947b9928-802c-4a56-8361-52fbd02eb0ce\") " pod="openshift-service-ca/service-ca-758f599c5-7xdgp" Jul 05 00:13:22.718404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:22.718280 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/947b9928-802c-4a56-8361-52fbd02eb0ce-signing-cabundle\") pod \"service-ca-758f599c5-7xdgp\" (UID: \"947b9928-802c-4a56-8361-52fbd02eb0ce\") " pod="openshift-service-ca/service-ca-758f599c5-7xdgp" Jul 05 00:13:22.719020 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:22.718999 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/947b9928-802c-4a56-8361-52fbd02eb0ce-signing-cabundle\") pod \"service-ca-758f599c5-7xdgp\" (UID: \"947b9928-802c-4a56-8361-52fbd02eb0ce\") " pod="openshift-service-ca/service-ca-758f599c5-7xdgp" Jul 05 00:13:22.720687 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:22.720668 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/947b9928-802c-4a56-8361-52fbd02eb0ce-signing-key\") pod \"service-ca-758f599c5-7xdgp\" (UID: \"947b9928-802c-4a56-8361-52fbd02eb0ce\") " pod="openshift-service-ca/service-ca-758f599c5-7xdgp" Jul 05 00:13:22.726318 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:22.726295 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxf97\" (UniqueName: \"kubernetes.io/projected/947b9928-802c-4a56-8361-52fbd02eb0ce-kube-api-access-kxf97\") pod \"service-ca-758f599c5-7xdgp\" (UID: \"947b9928-802c-4a56-8361-52fbd02eb0ce\") " pod="openshift-service-ca/service-ca-758f599c5-7xdgp" Jul 05 00:13:22.853972 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:22.853940 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-7xdgp" Jul 05 00:13:22.972043 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:22.972004 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-7xdgp"] Jul 05 00:13:22.975492 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:13:22.975466 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod947b9928_802c_4a56_8361_52fbd02eb0ce.slice/crio-aba22c7bdd1ea3b989348fb9c362eabb4f1d003eb516cd0ef05cffaa4402c8cb WatchSource:0}: Error finding container aba22c7bdd1ea3b989348fb9c362eabb4f1d003eb516cd0ef05cffaa4402c8cb: Status 404 returned error can't find the container with id aba22c7bdd1ea3b989348fb9c362eabb4f1d003eb516cd0ef05cffaa4402c8cb Jul 05 00:13:23.093947 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:23.093920 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m6rgl_962c613c-ccfc-4bdd-aded-f0978bc0b8ab/dns-node-resolver/0.log" Jul 05 00:13:23.513878 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:23.513844 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-7xdgp" event={"ID":"947b9928-802c-4a56-8361-52fbd02eb0ce","Type":"ContainerStarted","Data":"aba22c7bdd1ea3b989348fb9c362eabb4f1d003eb516cd0ef05cffaa4402c8cb"} Jul 05 00:13:23.893484 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:23.893453 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lz9th_a9a304be-a49e-4a1a-983e-7ade1cc7ea10/node-ca/0.log" Jul 05 00:13:23.929533 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:23.929501 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/49eef3d8-388f-4df9-8048-b762d1244786-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-t6945\" (UID: \"49eef3d8-388f-4df9-8048-b762d1244786\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-t6945" Jul 05 00:13:23.929680 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:23.929613 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 05 00:13:23.929718 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:23.929687 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49eef3d8-388f-4df9-8048-b762d1244786-samples-operator-tls podName:49eef3d8-388f-4df9-8048-b762d1244786 nodeName:}" failed. No retries permitted until 2026-07-05 00:13:31.929667385 +0000 UTC m=+282.654683421 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/49eef3d8-388f-4df9-8048-b762d1244786-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-t6945" (UID: "49eef3d8-388f-4df9-8048-b762d1244786") : secret "samples-operator-tls" not found Jul 05 00:13:24.030456 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:24.030417 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-metrics-certs\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:24.030620 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:24.030583 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 05 00:13:24.030688 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:24.030619 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548a01a5-00d4-4d0a-93ae-6468343cb273-service-ca-bundle\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:24.030688 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:24.030648 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-metrics-certs podName:548a01a5-00d4-4d0a-93ae-6468343cb273 nodeName:}" failed. No retries permitted until 2026-07-05 00:13:32.0306334 +0000 UTC m=+282.755649438 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-metrics-certs") pod "router-default-6d86866d97-ldmcp" (UID: "548a01a5-00d4-4d0a-93ae-6468343cb273") : secret "router-metrics-certs-default" not found Jul 05 00:13:24.030784 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:24.030721 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/548a01a5-00d4-4d0a-93ae-6468343cb273-service-ca-bundle podName:548a01a5-00d4-4d0a-93ae-6468343cb273 nodeName:}" failed. No retries permitted until 2026-07-05 00:13:32.030704225 +0000 UTC m=+282.755720276 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/548a01a5-00d4-4d0a-93ae-6468343cb273-service-ca-bundle") pod "router-default-6d86866d97-ldmcp" (UID: "548a01a5-00d4-4d0a-93ae-6468343cb273") : configmap references non-existent config key: service-ca.crt Jul 05 00:13:24.636367 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:24.636333 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:24.636830 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:24.636473 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 00:13:24.636830 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:24.636474 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:24.636830 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:24.636553 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-kube-rbac-proxy-cm podName:c51e3fb6-b6ca-4a4b-8895-cc595f81e82a nodeName:}" failed. No retries permitted until 2026-07-05 00:13:28.636532327 +0000 UTC m=+279.361548365 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tn5mz" (UID: "c51e3fb6-b6ca-4a4b-8895-cc595f81e82a") : configmap "kube-rbac-proxy" not found Jul 05 00:13:24.636830 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:24.636578 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 00:13:24.636830 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:24.636631 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-insights-runtime-extractor-tls podName:c51e3fb6-b6ca-4a4b-8895-cc595f81e82a nodeName:}" failed. No retries permitted until 2026-07-05 00:13:28.636615741 +0000 UTC m=+279.361631783 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tn5mz" (UID: "c51e3fb6-b6ca-4a4b-8895-cc595f81e82a") : secret "insights-runtime-extractor-tls" not found Jul 05 00:13:24.694027 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:24.693987 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mkr59_1ee85ca6-328e-47e2-ab72-17410e1636a5/serve-healthcheck-canary/0.log" Jul 05 00:13:25.522386 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:25.522354 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-7xdgp" event={"ID":"947b9928-802c-4a56-8361-52fbd02eb0ce","Type":"ContainerStarted","Data":"6ec1d79d71d9e295b8d5e0fcbccf0701e38a5ff6b2a4cbec06b5672989e2df90"} Jul 05 00:13:25.539449 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:25.539403 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-7xdgp" podStartSLOduration=1.576940909 podStartE2EDuration="3.539388228s" totalImagesPullingTime="1.962447319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:13:25.537145825 +0000 UTC m=+276.262161884" watchObservedRunningTime="2026-07-05 00:13:25.539388228 +0000 UTC m=+276.264404286" Jul 05 00:13:26.547635 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:26.547544 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-rj72b" Jul 05 00:13:26.548084 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:26.547639 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-rj72b" Jul 05 00:13:26.548084 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:26.548017 2561 scope.go:117] "RemoveContainer" containerID="2f3b4c6cfcef6d0022b859a7a9d44aa070dee025136a70b88a7aaf8365ef013a" Jul 05 00:13:26.548209 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:26.548188 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-rj72b_openshift-console-operator(e3b8e330-88ef-4783-9ef5-615ae05e4c88)\"" pod="openshift-console-operator/console-operator-68b757fb67-rj72b" podUID="e3b8e330-88ef-4783-9ef5-615ae05e4c88" Jul 05 00:13:28.669510 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:28.669478 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:28.669959 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:28.669558 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:28.669959 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:28.669637 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 00:13:28.669959 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:28.669699 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-insights-runtime-extractor-tls podName:c51e3fb6-b6ca-4a4b-8895-cc595f81e82a nodeName:}" failed. No retries permitted until 2026-07-05 00:13:36.669682893 +0000 UTC m=+287.394698930 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tn5mz" (UID: "c51e3fb6-b6ca-4a4b-8895-cc595f81e82a") : secret "insights-runtime-extractor-tls" not found Jul 05 00:13:28.670201 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:28.670181 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:31.215472 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:31.215429 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" podUID="b4d54845-8c05-46b8-9130-3aea115d4f6c" Jul 05 00:13:31.215472 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:31.215448 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6845f467d-cqzsc" podUID="8f05d3fd-5eed-413a-bc3a-90b63d81ee2f" Jul 05 00:13:31.215472 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:31.215448 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dm6pw" podUID="21ab9246-2ceb-4ee9-be3d-f158461d8ed1" Jul 05 00:13:31.541580 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:31.541495 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dm6pw" Jul 05 00:13:31.542016 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:31.541998 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" Jul 05 00:13:31.542285 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:31.542271 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:13:31.995563 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:31.995537 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/49eef3d8-388f-4df9-8048-b762d1244786-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-t6945\" (UID: \"49eef3d8-388f-4df9-8048-b762d1244786\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-t6945" Jul 05 00:13:31.997781 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:31.997757 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/49eef3d8-388f-4df9-8048-b762d1244786-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-t6945\" (UID: \"49eef3d8-388f-4df9-8048-b762d1244786\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-t6945" Jul 05 00:13:32.096429 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:32.096405 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548a01a5-00d4-4d0a-93ae-6468343cb273-service-ca-bundle\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:32.096530 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:32.096471 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-metrics-certs\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:32.096587 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:32.096572 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/548a01a5-00d4-4d0a-93ae-6468343cb273-service-ca-bundle podName:548a01a5-00d4-4d0a-93ae-6468343cb273 nodeName:}" failed. No retries permitted until 2026-07-05 00:13:48.096556328 +0000 UTC m=+298.821572387 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/548a01a5-00d4-4d0a-93ae-6468343cb273-service-ca-bundle") pod "router-default-6d86866d97-ldmcp" (UID: "548a01a5-00d4-4d0a-93ae-6468343cb273") : configmap references non-existent config key: service-ca.crt Jul 05 00:13:32.098583 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:32.098557 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/548a01a5-00d4-4d0a-93ae-6468343cb273-metrics-certs\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:32.135201 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:32.135178 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-t6945" Jul 05 00:13:32.264487 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:32.264411 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-t6945"] Jul 05 00:13:32.545256 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:32.545172 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-t6945" event={"ID":"49eef3d8-388f-4df9-8048-b762d1244786","Type":"ContainerStarted","Data":"5533c4bd2c7942b0aaee8d8ec173749a64960b3daeaca300bb155599bf1f4097"} Jul 05 00:13:34.553174 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:34.553138 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-t6945" event={"ID":"49eef3d8-388f-4df9-8048-b762d1244786","Type":"ContainerStarted","Data":"e14009e855d59144a69247b20bafe38b19427103ef76601c632eeddfb915624e"} Jul 05 00:13:34.553523 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:34.553200 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-t6945" event={"ID":"49eef3d8-388f-4df9-8048-b762d1244786","Type":"ContainerStarted","Data":"d6e0484ce58561240fe584102bfa5103e209f34f8606c35deb13c864e78b2b60"} Jul 05 00:13:34.569868 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:34.569823 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-t6945" podStartSLOduration=16.527775378 podStartE2EDuration="18.569804801s" totalImagesPullingTime="2.042029423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:13:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:13:34.568662001 +0000 UTC m=+285.293678060" watchObservedRunningTime="2026-07-05 00:13:34.569804801 +0000 UTC m=+285.294820852" Jul 05 00:13:35.022725 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:35.022689 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls\") pod \"dns-default-dm6pw\" (UID: \"21ab9246-2ceb-4ee9-be3d-f158461d8ed1\") " pod="openshift-dns/dns-default-dm6pw" Jul 05 00:13:35.022904 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:35.022749 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-w97sv\" (UID: \"b4d54845-8c05-46b8-9130-3aea115d4f6c\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" Jul 05 00:13:35.022904 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:35.022842 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:13:35.025260 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:35.025223 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21ab9246-2ceb-4ee9-be3d-f158461d8ed1-metrics-tls\") pod \"dns-default-dm6pw\" (UID: \"21ab9246-2ceb-4ee9-be3d-f158461d8ed1\") " pod="openshift-dns/dns-default-dm6pw" Jul 05 00:13:35.025381 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:35.025282 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b4d54845-8c05-46b8-9130-3aea115d4f6c-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-w97sv\" (UID: \"b4d54845-8c05-46b8-9130-3aea115d4f6c\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" Jul 05 00:13:35.025381 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:35.025363 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls\") pod \"image-registry-6845f467d-cqzsc\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:13:35.146026 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:35.146002 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z9vd9\"" Jul 05 00:13:35.146161 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:35.146004 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-kdspz\"" Jul 05 00:13:35.146161 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:35.146013 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qmcqv\"" Jul 05 00:13:35.153184 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:35.153169 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" Jul 05 00:13:35.153275 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:35.153189 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:13:35.153275 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:35.153260 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dm6pw" Jul 05 00:13:35.314399 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:35.314330 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dm6pw"] Jul 05 00:13:35.317602 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:13:35.317573 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21ab9246_2ceb_4ee9_be3d_f158461d8ed1.slice/crio-4c6e63701e9b083fa75a99f046ff0fa68f131c6e1df86c27dfe6a3061ab05b53 WatchSource:0}: Error finding container 4c6e63701e9b083fa75a99f046ff0fa68f131c6e1df86c27dfe6a3061ab05b53: Status 404 returned error can't find the container with id 4c6e63701e9b083fa75a99f046ff0fa68f131c6e1df86c27dfe6a3061ab05b53 Jul 05 00:13:35.538745 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:35.538432 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-w97sv"] Jul 05 00:13:35.541839 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:35.541808 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6845f467d-cqzsc"] Jul 05 00:13:35.542092 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:13:35.542059 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d54845_8c05_46b8_9130_3aea115d4f6c.slice/crio-ebc400ffba6a2221be79787e6b94be2be1e14a61d981115d055c158a26a7fe92 WatchSource:0}: Error finding container ebc400ffba6a2221be79787e6b94be2be1e14a61d981115d055c158a26a7fe92: Status 404 returned error can't find the container with id ebc400ffba6a2221be79787e6b94be2be1e14a61d981115d055c158a26a7fe92 Jul 05 00:13:35.544992 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:13:35.544966 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f05d3fd_5eed_413a_bc3a_90b63d81ee2f.slice/crio-08157091e8dbce3def84ced21eb8c3afaa2b01d2e96d8b597bd9cac3d46c7ccb WatchSource:0}: Error finding container 08157091e8dbce3def84ced21eb8c3afaa2b01d2e96d8b597bd9cac3d46c7ccb: Status 404 returned error can't find the container with id 08157091e8dbce3def84ced21eb8c3afaa2b01d2e96d8b597bd9cac3d46c7ccb Jul 05 00:13:35.557407 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:35.557360 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dm6pw" event={"ID":"21ab9246-2ceb-4ee9-be3d-f158461d8ed1","Type":"ContainerStarted","Data":"4c6e63701e9b083fa75a99f046ff0fa68f131c6e1df86c27dfe6a3061ab05b53"} Jul 05 00:13:35.558683 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:35.558657 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6845f467d-cqzsc" event={"ID":"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f","Type":"ContainerStarted","Data":"08157091e8dbce3def84ced21eb8c3afaa2b01d2e96d8b597bd9cac3d46c7ccb"} Jul 05 00:13:35.559868 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:35.559836 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" event={"ID":"b4d54845-8c05-46b8-9130-3aea115d4f6c","Type":"ContainerStarted","Data":"ebc400ffba6a2221be79787e6b94be2be1e14a61d981115d055c158a26a7fe92"} Jul 05 00:13:36.565720 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:36.565677 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6845f467d-cqzsc" event={"ID":"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f","Type":"ContainerStarted","Data":"016355749a8d1fb2fedffd820f638636ecb69b5af44c62df7ea4d0f6823a3dc9"} Jul 05 00:13:36.566158 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:36.565860 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:13:36.584360 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:36.584309 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6845f467d-cqzsc" podStartSLOduration=286.584295162 podStartE2EDuration="4m46.584295162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:08:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:13:36.583098967 +0000 UTC m=+287.308115039" watchObservedRunningTime="2026-07-05 00:13:36.584295162 +0000 UTC m=+287.309311221" Jul 05 00:13:36.738078 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:36.738035 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:36.740576 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:36.740548 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c51e3fb6-b6ca-4a4b-8895-cc595f81e82a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tn5mz\" (UID: \"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a\") " pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:36.811884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:36.811855 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tn5mz" Jul 05 00:13:36.945155 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:36.945122 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tn5mz"] Jul 05 00:13:37.277092 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:13:37.277056 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc51e3fb6_b6ca_4a4b_8895_cc595f81e82a.slice/crio-73ad2be619cccce8a8601eed659a63dd1f5eb556dc74e9ed9717d86542b88070 WatchSource:0}: Error finding container 73ad2be619cccce8a8601eed659a63dd1f5eb556dc74e9ed9717d86542b88070: Status 404 returned error can't find the container with id 73ad2be619cccce8a8601eed659a63dd1f5eb556dc74e9ed9717d86542b88070 Jul 05 00:13:37.571521 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:37.571449 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dm6pw" event={"ID":"21ab9246-2ceb-4ee9-be3d-f158461d8ed1","Type":"ContainerStarted","Data":"e7e73a942ff1c5ef0d0191f6ec3a668404e8faa9b3d663726e84c048b0fafaca"} Jul 05 00:13:37.571521 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:37.571505 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dm6pw" event={"ID":"21ab9246-2ceb-4ee9-be3d-f158461d8ed1","Type":"ContainerStarted","Data":"4f4df230164eca5e92a0a9bac05b8709839703cb181bfadbd1f359f9b6371765"} Jul 05 00:13:37.571943 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:37.571574 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dm6pw" Jul 05 00:13:37.572775 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:37.572742 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tn5mz" event={"ID":"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a","Type":"ContainerStarted","Data":"73ad2be619cccce8a8601eed659a63dd1f5eb556dc74e9ed9717d86542b88070"} Jul 05 00:13:37.574055 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:37.574033 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" event={"ID":"b4d54845-8c05-46b8-9130-3aea115d4f6c","Type":"ContainerStarted","Data":"45372c7bc7c305125b664b34ad7d3851174b6c6b87ade77ede3905862b3efa5d"} Jul 05 00:13:37.588016 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:37.587974 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dm6pw" podStartSLOduration=250.583005166 podStartE2EDuration="4m12.587961178s" totalImagesPullingTime="2.004956012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:09:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:13:37.586458335 +0000 UTC m=+288.311474396" watchObservedRunningTime="2026-07-05 00:13:37.587961178 +0000 UTC m=+288.312977238" Jul 05 00:13:37.600748 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:37.600711 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-w97sv" podStartSLOduration=263.330215163 podStartE2EDuration="4m24.600700977s" totalImagesPullingTime="1.270485814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:09:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:13:37.599305425 +0000 UTC m=+288.324321487" watchObservedRunningTime="2026-07-05 00:13:37.600700977 +0000 UTC m=+288.325717035" Jul 05 00:13:40.771757 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:40.771729 2561 scope.go:117] "RemoveContainer" containerID="2f3b4c6cfcef6d0022b859a7a9d44aa070dee025136a70b88a7aaf8365ef013a" Jul 05 00:13:41.589133 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:41.589092 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tn5mz" event={"ID":"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a","Type":"ContainerStarted","Data":"3d7b8a229c392d247c23780b696aecb685bd4339503e0a44f12156a23a034857"} Jul 05 00:13:41.591041 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:41.591019 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/1.log" Jul 05 00:13:41.591178 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:41.591093 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-rj72b" event={"ID":"e3b8e330-88ef-4783-9ef5-615ae05e4c88","Type":"ContainerStarted","Data":"cfab892670fae27473604f1d067aebd8bbdeb81db7ed6f3a2f3067069290ead1"} Jul 05 00:13:41.591417 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:41.591391 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-rj72b" Jul 05 00:13:41.596510 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:41.596487 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-rj72b" Jul 05 00:13:41.608845 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:41.608805 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-rj72b" podStartSLOduration=22.594131226000002 podStartE2EDuration="25.608778428s" totalImagesPullingTime="3.014647202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:13:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:13:41.607426174 +0000 UTC m=+292.332442232" watchObservedRunningTime="2026-07-05 00:13:41.608778428 +0000 UTC m=+292.333794543" Jul 05 00:13:42.597561 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:42.597517 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tn5mz" event={"ID":"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a","Type":"ContainerStarted","Data":"a36c1aee31fdc109d1765cfea0bf6706d5930e59431c7a2bb0b2acc06e4a4603"} Jul 05 00:13:44.607179 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:44.607098 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tn5mz" event={"ID":"c51e3fb6-b6ca-4a4b-8895-cc595f81e82a","Type":"ContainerStarted","Data":"820ce1f5626997c0516bc28c98387cc28bc8da5728698314d6a915609ccb5e8a"} Jul 05 00:13:44.624310 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:44.624267 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tn5mz" podStartSLOduration=17.685880359 podStartE2EDuration="24.624252585s" totalImagesPullingTime="6.938372226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 00:13:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:13:44.623682968 +0000 UTC m=+295.348699050" watchObservedRunningTime="2026-07-05 00:13:44.624252585 +0000 UTC m=+295.349268644" Jul 05 00:13:44.771345 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:13:44.771301 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-tlll9" podUID="107f4ca7-7252-4983-9468-ba558c9e9e58" Jul 05 00:13:47.580064 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:47.580031 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dm6pw" Jul 05 00:13:48.129369 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:48.129333 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548a01a5-00d4-4d0a-93ae-6468343cb273-service-ca-bundle\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:48.130007 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:48.129984 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/548a01a5-00d4-4d0a-93ae-6468343cb273-service-ca-bundle\") pod \"router-default-6d86866d97-ldmcp\" (UID: \"548a01a5-00d4-4d0a-93ae-6468343cb273\") " pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:48.428934 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:48.428842 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:48.554199 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:48.554173 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d86866d97-ldmcp"] Jul 05 00:13:48.556649 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:13:48.556624 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod548a01a5_00d4_4d0a_93ae_6468343cb273.slice/crio-152ffe42a80bb2fa5dd0d226abf23207acd62e467a4a05bc3171d7238ac109db WatchSource:0}: Error finding container 152ffe42a80bb2fa5dd0d226abf23207acd62e467a4a05bc3171d7238ac109db: Status 404 returned error can't find the container with id 152ffe42a80bb2fa5dd0d226abf23207acd62e467a4a05bc3171d7238ac109db Jul 05 00:13:48.621247 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:48.621216 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d86866d97-ldmcp" event={"ID":"548a01a5-00d4-4d0a-93ae-6468343cb273","Type":"ContainerStarted","Data":"773fd950e5b067ce84e9957659d8a6a8d040bc40f79094bcf742fd4529502f71"} Jul 05 00:13:48.621533 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:48.621267 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d86866d97-ldmcp" event={"ID":"548a01a5-00d4-4d0a-93ae-6468343cb273","Type":"ContainerStarted","Data":"152ffe42a80bb2fa5dd0d226abf23207acd62e467a4a05bc3171d7238ac109db"} Jul 05 00:13:48.638182 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:48.638141 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6d86866d97-ldmcp" podStartSLOduration=32.638126156 podStartE2EDuration="32.638126156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:13:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:13:48.636954078 +0000 UTC m=+299.361970137" watchObservedRunningTime="2026-07-05 00:13:48.638126156 +0000 UTC m=+299.363142214" Jul 05 00:13:49.429772 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:49.429741 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:49.432297 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:49.432274 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:49.624315 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:49.624281 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:49.625439 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:49.625419 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6d86866d97-ldmcp" Jul 05 00:13:49.707543 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:49.707472 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/1.log" Jul 05 00:13:49.708277 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:49.708227 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/1.log" Jul 05 00:13:49.719442 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:49.719413 2561 kubelet.go:1648] "Image garbage collection succeeded" Jul 05 00:13:50.536561 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.536524 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c5c6ff8b9-449sv"] Jul 05 00:13:50.539554 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.539537 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:13:50.542951 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.542926 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7m58v\"" Jul 05 00:13:50.543160 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.543142 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 05 00:13:50.544194 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.544178 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 05 00:13:50.544473 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.544442 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 05 00:13:50.544473 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.544455 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 05 00:13:50.544642 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.544506 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 05 00:13:50.544642 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.544464 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 05 00:13:50.544732 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.544646 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 05 00:13:50.555757 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.555735 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c5c6ff8b9-449sv"] Jul 05 00:13:50.647308 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.647278 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-console-config\") pod \"console-c5c6ff8b9-449sv\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:13:50.647668 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.647333 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-service-ca\") pod \"console-c5c6ff8b9-449sv\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:13:50.647668 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.647387 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-oauth-serving-cert\") pod \"console-c5c6ff8b9-449sv\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:13:50.647668 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.647419 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbm68\" (UniqueName: \"kubernetes.io/projected/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-kube-api-access-mbm68\") pod \"console-c5c6ff8b9-449sv\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:13:50.647668 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.647448 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-console-serving-cert\") pod \"console-c5c6ff8b9-449sv\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:13:50.647668 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.647463 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-console-oauth-config\") pod \"console-c5c6ff8b9-449sv\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:13:50.748321 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.748290 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-console-config\") pod \"console-c5c6ff8b9-449sv\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:13:50.748477 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.748371 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-service-ca\") pod \"console-c5c6ff8b9-449sv\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:13:50.748477 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.748392 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-oauth-serving-cert\") pod \"console-c5c6ff8b9-449sv\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:13:50.748590 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.748534 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbm68\" (UniqueName: \"kubernetes.io/projected/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-kube-api-access-mbm68\") pod \"console-c5c6ff8b9-449sv\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:13:50.748644 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.748589 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-console-serving-cert\") pod \"console-c5c6ff8b9-449sv\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:13:50.748644 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.748615 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-console-oauth-config\") pod \"console-c5c6ff8b9-449sv\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:13:50.749148 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.749122 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-console-config\") pod \"console-c5c6ff8b9-449sv\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:13:50.749273 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.749168 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-oauth-serving-cert\") pod \"console-c5c6ff8b9-449sv\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:13:50.749273 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.749168 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-service-ca\") pod \"console-c5c6ff8b9-449sv\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:13:50.751039 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.751010 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-console-oauth-config\") pod \"console-c5c6ff8b9-449sv\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:13:50.751039 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.751024 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-console-serving-cert\") pod \"console-c5c6ff8b9-449sv\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:13:50.756183 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.756163 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbm68\" (UniqueName: \"kubernetes.io/projected/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-kube-api-access-mbm68\") pod \"console-c5c6ff8b9-449sv\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:13:50.848227 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.848203 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:13:50.972350 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:50.972317 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c5c6ff8b9-449sv"] Jul 05 00:13:50.974323 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:13:50.974294 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcac54bd8_1c40_4d47_964a_6a2dab51a7c6.slice/crio-a63f464af0723f6433517e42b28d676e2939eaeeb2858aa10b0e79ec509f65bf WatchSource:0}: Error finding container a63f464af0723f6433517e42b28d676e2939eaeeb2858aa10b0e79ec509f65bf: Status 404 returned error can't find the container with id a63f464af0723f6433517e42b28d676e2939eaeeb2858aa10b0e79ec509f65bf Jul 05 00:13:51.632769 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:51.632731 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c5c6ff8b9-449sv" event={"ID":"cac54bd8-1c40-4d47-964a-6a2dab51a7c6","Type":"ContainerStarted","Data":"a63f464af0723f6433517e42b28d676e2939eaeeb2858aa10b0e79ec509f65bf"} Jul 05 00:13:55.159441 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:55.159128 2561 patch_prober.go:28] interesting pod/image-registry-6845f467d-cqzsc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 05 00:13:55.159441 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:55.159191 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6845f467d-cqzsc" podUID="8f05d3fd-5eed-413a-bc3a-90b63d81ee2f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 05 00:13:55.648767 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:55.648729 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c5c6ff8b9-449sv" event={"ID":"cac54bd8-1c40-4d47-964a-6a2dab51a7c6","Type":"ContainerStarted","Data":"c8cc5934b80a688d04096fca3efc69d18ccd1f2b2346876275cf7704f8ba65a8"} Jul 05 00:13:55.666956 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:55.666911 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c5c6ff8b9-449sv" podStartSLOduration=1.9371051989999999 podStartE2EDuration="5.666898112s" totalImagesPullingTime="3.729792913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:13:55.666270593 +0000 UTC m=+306.391286655" watchObservedRunningTime="2026-07-05 00:13:55.666898112 +0000 UTC m=+306.391914173" Jul 05 00:13:57.578672 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:57.578644 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:13:58.771315 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:58.771283 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:13:58.910772 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:58.910744 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9b894d9c8-vcn9x"] Jul 05 00:13:58.990390 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:58.990365 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9b894d9c8-vcn9x"] Jul 05 00:13:58.990522 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:58.990454 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:13:58.999202 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:58.999183 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 05 00:13:59.010962 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.010937 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9zg9\" (UniqueName: \"kubernetes.io/projected/74250274-ed33-4573-a6b3-2e47dd1568f6-kube-api-access-w9zg9\") pod \"console-9b894d9c8-vcn9x\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:13:59.011052 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.010977 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-service-ca\") pod \"console-9b894d9c8-vcn9x\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:13:59.011052 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.011023 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74250274-ed33-4573-a6b3-2e47dd1568f6-console-serving-cert\") pod \"console-9b894d9c8-vcn9x\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:13:59.011122 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.011061 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74250274-ed33-4573-a6b3-2e47dd1568f6-console-oauth-config\") pod \"console-9b894d9c8-vcn9x\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:13:59.011122 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.011079 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-trusted-ca-bundle\") pod \"console-9b894d9c8-vcn9x\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:13:59.011183 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.011137 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-console-config\") pod \"console-9b894d9c8-vcn9x\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:13:59.011215 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.011190 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-oauth-serving-cert\") pod \"console-9b894d9c8-vcn9x\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:13:59.111520 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.111492 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9zg9\" (UniqueName: \"kubernetes.io/projected/74250274-ed33-4573-a6b3-2e47dd1568f6-kube-api-access-w9zg9\") pod \"console-9b894d9c8-vcn9x\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:13:59.111610 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.111536 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-service-ca\") pod \"console-9b894d9c8-vcn9x\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:13:59.111610 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.111571 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74250274-ed33-4573-a6b3-2e47dd1568f6-console-serving-cert\") pod \"console-9b894d9c8-vcn9x\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:13:59.111610 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.111588 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74250274-ed33-4573-a6b3-2e47dd1568f6-console-oauth-config\") pod \"console-9b894d9c8-vcn9x\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:13:59.111610 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.111603 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-trusted-ca-bundle\") pod \"console-9b894d9c8-vcn9x\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:13:59.111785 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.111638 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-console-config\") pod \"console-9b894d9c8-vcn9x\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:13:59.111896 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.111786 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-oauth-serving-cert\") pod \"console-9b894d9c8-vcn9x\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:13:59.112376 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.112346 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-console-config\") pod \"console-9b894d9c8-vcn9x\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:13:59.112464 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.112402 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-service-ca\") pod \"console-9b894d9c8-vcn9x\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:13:59.112549 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.112524 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-oauth-serving-cert\") pod \"console-9b894d9c8-vcn9x\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:13:59.112588 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.112554 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-trusted-ca-bundle\") pod \"console-9b894d9c8-vcn9x\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:13:59.113992 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.113974 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74250274-ed33-4573-a6b3-2e47dd1568f6-console-oauth-config\") pod \"console-9b894d9c8-vcn9x\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:13:59.114077 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.114063 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74250274-ed33-4573-a6b3-2e47dd1568f6-console-serving-cert\") pod \"console-9b894d9c8-vcn9x\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:13:59.118722 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.118702 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9zg9\" (UniqueName: \"kubernetes.io/projected/74250274-ed33-4573-a6b3-2e47dd1568f6-kube-api-access-w9zg9\") pod \"console-9b894d9c8-vcn9x\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:13:59.300201 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.300173 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:13:59.463432 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.463301 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9b894d9c8-vcn9x"] Jul 05 00:13:59.465855 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:13:59.465829 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74250274_ed33_4573_a6b3_2e47dd1568f6.slice/crio-b6963f92ce37cc040af2a704ae7051bd8f5047a0e09fd924e4a0c6b47a16ed88 WatchSource:0}: Error finding container b6963f92ce37cc040af2a704ae7051bd8f5047a0e09fd924e4a0c6b47a16ed88: Status 404 returned error can't find the container with id b6963f92ce37cc040af2a704ae7051bd8f5047a0e09fd924e4a0c6b47a16ed88 Jul 05 00:13:59.664206 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.663650 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b894d9c8-vcn9x" event={"ID":"74250274-ed33-4573-a6b3-2e47dd1568f6","Type":"ContainerStarted","Data":"dcb78ed44ef8439c35c6b281c2c7d7124fe03306f9643b2532093b9d6651a7a6"} Jul 05 00:13:59.664206 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.663709 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b894d9c8-vcn9x" event={"ID":"74250274-ed33-4573-a6b3-2e47dd1568f6","Type":"ContainerStarted","Data":"b6963f92ce37cc040af2a704ae7051bd8f5047a0e09fd924e4a0c6b47a16ed88"} Jul 05 00:13:59.682326 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:13:59.682278 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9b894d9c8-vcn9x" podStartSLOduration=1.682263793 podStartE2EDuration="1.682263793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:13:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:13:59.680948618 +0000 UTC m=+310.405964687" watchObservedRunningTime="2026-07-05 00:13:59.682263793 +0000 UTC m=+310.407279907" Jul 05 00:14:00.395052 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.395019 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-qwk6z"] Jul 05 00:14:00.417528 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.417500 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-qwk6z"] Jul 05 00:14:00.417694 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.417549 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ms8rb"] Jul 05 00:14:00.418458 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.418433 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qwk6z" Jul 05 00:14:00.421410 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.421390 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 05 00:14:00.421627 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.421606 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 05 00:14:00.421906 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.421504 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 05 00:14:00.421906 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.421452 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 05 00:14:00.422813 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.422573 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-vx7m8\"" Jul 05 00:14:00.422813 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.422580 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 05 00:14:00.431739 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.431717 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.434340 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.434287 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 05 00:14:00.434451 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.434431 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 05 00:14:00.434657 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.434641 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 05 00:14:00.435130 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.435113 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qgkjb\"" Jul 05 00:14:00.524927 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.524896 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ffd08932-7257-4b59-8a1f-01c91839aca1-node-exporter-textfile\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.525064 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.524946 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00a4e5ad-fd46-4aaa-920b-d9e311c983ec-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-qwk6z\" (UID: \"00a4e5ad-fd46-4aaa-920b-d9e311c983ec\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qwk6z" Jul 05 00:14:00.525064 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.524980 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffd08932-7257-4b59-8a1f-01c91839aca1-sys\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.525064 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.525011 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ffd08932-7257-4b59-8a1f-01c91839aca1-node-exporter-wtmp\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.525064 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.525036 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txf7x\" (UniqueName: \"kubernetes.io/projected/00a4e5ad-fd46-4aaa-920b-d9e311c983ec-kube-api-access-txf7x\") pod \"openshift-state-metrics-54cf96dfcf-qwk6z\" (UID: \"00a4e5ad-fd46-4aaa-920b-d9e311c983ec\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qwk6z" Jul 05 00:14:00.525064 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.525055 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/00a4e5ad-fd46-4aaa-920b-d9e311c983ec-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-qwk6z\" (UID: \"00a4e5ad-fd46-4aaa-920b-d9e311c983ec\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qwk6z" Jul 05 00:14:00.525309 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.525106 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ffd08932-7257-4b59-8a1f-01c91839aca1-root\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.525309 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.525131 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ffd08932-7257-4b59-8a1f-01c91839aca1-node-exporter-accelerators-collector-config\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.525309 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.525163 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5zrz\" (UniqueName: \"kubernetes.io/projected/ffd08932-7257-4b59-8a1f-01c91839aca1-kube-api-access-r5zrz\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.525309 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.525180 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffd08932-7257-4b59-8a1f-01c91839aca1-node-exporter-tls\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.525309 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.525233 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffd08932-7257-4b59-8a1f-01c91839aca1-metrics-client-ca\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.525309 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.525258 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00a4e5ad-fd46-4aaa-920b-d9e311c983ec-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-qwk6z\" (UID: \"00a4e5ad-fd46-4aaa-920b-d9e311c983ec\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qwk6z" Jul 05 00:14:00.525309 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.525286 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffd08932-7257-4b59-8a1f-01c91839aca1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.626513 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.626492 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ffd08932-7257-4b59-8a1f-01c91839aca1-node-exporter-textfile\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.626633 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.626526 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00a4e5ad-fd46-4aaa-920b-d9e311c983ec-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-qwk6z\" (UID: \"00a4e5ad-fd46-4aaa-920b-d9e311c983ec\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qwk6z" Jul 05 00:14:00.626633 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.626554 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffd08932-7257-4b59-8a1f-01c91839aca1-sys\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.626633 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.626578 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ffd08932-7257-4b59-8a1f-01c91839aca1-node-exporter-wtmp\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.626633 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.626604 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txf7x\" (UniqueName: \"kubernetes.io/projected/00a4e5ad-fd46-4aaa-920b-d9e311c983ec-kube-api-access-txf7x\") pod \"openshift-state-metrics-54cf96dfcf-qwk6z\" (UID: \"00a4e5ad-fd46-4aaa-920b-d9e311c983ec\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qwk6z" Jul 05 00:14:00.626839 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.626632 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/00a4e5ad-fd46-4aaa-920b-d9e311c983ec-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-qwk6z\" (UID: \"00a4e5ad-fd46-4aaa-920b-d9e311c983ec\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qwk6z" Jul 05 00:14:00.626839 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.626651 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ffd08932-7257-4b59-8a1f-01c91839aca1-sys\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.626839 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.626658 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ffd08932-7257-4b59-8a1f-01c91839aca1-root\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.626839 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.626699 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ffd08932-7257-4b59-8a1f-01c91839aca1-root\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.626839 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.626709 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ffd08932-7257-4b59-8a1f-01c91839aca1-node-exporter-accelerators-collector-config\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.626839 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.626744 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5zrz\" (UniqueName: \"kubernetes.io/projected/ffd08932-7257-4b59-8a1f-01c91839aca1-kube-api-access-r5zrz\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.626839 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.626769 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffd08932-7257-4b59-8a1f-01c91839aca1-node-exporter-tls\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.626839 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.626831 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffd08932-7257-4b59-8a1f-01c91839aca1-metrics-client-ca\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.627217 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.626841 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ffd08932-7257-4b59-8a1f-01c91839aca1-node-exporter-wtmp\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.627217 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.626880 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00a4e5ad-fd46-4aaa-920b-d9e311c983ec-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-qwk6z\" (UID: \"00a4e5ad-fd46-4aaa-920b-d9e311c983ec\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qwk6z" Jul 05 00:14:00.627217 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.626881 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ffd08932-7257-4b59-8a1f-01c91839aca1-node-exporter-textfile\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.627363 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.627316 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffd08932-7257-4b59-8a1f-01c91839aca1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.627363 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.627351 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffd08932-7257-4b59-8a1f-01c91839aca1-metrics-client-ca\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.627363 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:14:00.627355 2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 05 00:14:00.627510 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:14:00.627409 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffd08932-7257-4b59-8a1f-01c91839aca1-node-exporter-tls podName:ffd08932-7257-4b59-8a1f-01c91839aca1 nodeName:}" failed. No retries permitted until 2026-07-05 00:14:01.127391831 +0000 UTC m=+311.852407878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ffd08932-7257-4b59-8a1f-01c91839aca1-node-exporter-tls") pod "node-exporter-ms8rb" (UID: "ffd08932-7257-4b59-8a1f-01c91839aca1") : secret "node-exporter-tls" not found Jul 05 00:14:00.627510 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:14:00.627431 2561 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 05 00:14:00.627510 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:14:00.627477 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00a4e5ad-fd46-4aaa-920b-d9e311c983ec-openshift-state-metrics-tls podName:00a4e5ad-fd46-4aaa-920b-d9e311c983ec nodeName:}" failed. No retries permitted until 2026-07-05 00:14:01.127462917 +0000 UTC m=+311.852478956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/00a4e5ad-fd46-4aaa-920b-d9e311c983ec-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-qwk6z" (UID: "00a4e5ad-fd46-4aaa-920b-d9e311c983ec") : secret "openshift-state-metrics-tls" not found Jul 05 00:14:00.627693 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.627672 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ffd08932-7257-4b59-8a1f-01c91839aca1-node-exporter-accelerators-collector-config\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.627748 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.627700 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00a4e5ad-fd46-4aaa-920b-d9e311c983ec-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-qwk6z\" (UID: \"00a4e5ad-fd46-4aaa-920b-d9e311c983ec\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qwk6z" Jul 05 00:14:00.630074 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.630051 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ffd08932-7257-4b59-8a1f-01c91839aca1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.630219 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.630198 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/00a4e5ad-fd46-4aaa-920b-d9e311c983ec-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-qwk6z\" (UID: \"00a4e5ad-fd46-4aaa-920b-d9e311c983ec\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qwk6z" Jul 05 00:14:00.638447 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.638423 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5zrz\" (UniqueName: \"kubernetes.io/projected/ffd08932-7257-4b59-8a1f-01c91839aca1-kube-api-access-r5zrz\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:00.639263 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.639243 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txf7x\" (UniqueName: \"kubernetes.io/projected/00a4e5ad-fd46-4aaa-920b-d9e311c983ec-kube-api-access-txf7x\") pod \"openshift-state-metrics-54cf96dfcf-qwk6z\" (UID: \"00a4e5ad-fd46-4aaa-920b-d9e311c983ec\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qwk6z" Jul 05 00:14:00.848999 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.848963 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:14:00.849160 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.849023 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:14:00.853893 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:00.853870 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:14:01.135654 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:01.135573 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/00a4e5ad-fd46-4aaa-920b-d9e311c983ec-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-qwk6z\" (UID: \"00a4e5ad-fd46-4aaa-920b-d9e311c983ec\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qwk6z" Jul 05 00:14:01.135787 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:01.135653 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffd08932-7257-4b59-8a1f-01c91839aca1-node-exporter-tls\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:01.137989 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:01.137958 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ffd08932-7257-4b59-8a1f-01c91839aca1-node-exporter-tls\") pod \"node-exporter-ms8rb\" (UID: \"ffd08932-7257-4b59-8a1f-01c91839aca1\") " pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:01.138189 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:01.138166 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/00a4e5ad-fd46-4aaa-920b-d9e311c983ec-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-qwk6z\" (UID: \"00a4e5ad-fd46-4aaa-920b-d9e311c983ec\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qwk6z" Jul 05 00:14:01.332065 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:01.332033 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qwk6z" Jul 05 00:14:01.342964 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:01.342928 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ms8rb" Jul 05 00:14:01.393010 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:14:01.392977 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd08932_7257_4b59_8a1f_01c91839aca1.slice/crio-30d916cb6e38a2c736474391d0dad5aac91033ab751a0780b8537fc8e0ea7255 WatchSource:0}: Error finding container 30d916cb6e38a2c736474391d0dad5aac91033ab751a0780b8537fc8e0ea7255: Status 404 returned error can't find the container with id 30d916cb6e38a2c736474391d0dad5aac91033ab751a0780b8537fc8e0ea7255 Jul 05 00:14:01.394806 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:01.394775 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 00:14:01.497220 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:01.497158 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-qwk6z"] Jul 05 00:14:01.499872 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:14:01.499843 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00a4e5ad_fd46_4aaa_920b_d9e311c983ec.slice/crio-375ddd9a97e8bea6114548d1f8f60533fa3cf05fc2f6fa5fd9f860d953081cb5 WatchSource:0}: Error finding container 375ddd9a97e8bea6114548d1f8f60533fa3cf05fc2f6fa5fd9f860d953081cb5: Status 404 returned error can't find the container with id 375ddd9a97e8bea6114548d1f8f60533fa3cf05fc2f6fa5fd9f860d953081cb5 Jul 05 00:14:01.674065 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:01.674030 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qwk6z" event={"ID":"00a4e5ad-fd46-4aaa-920b-d9e311c983ec","Type":"ContainerStarted","Data":"3114cdc8ec782c1819e311e09c95dd7467c4465f92f19b5ba24bc2ce9c332e62"} Jul 05 00:14:01.674172 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:01.674093 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qwk6z" event={"ID":"00a4e5ad-fd46-4aaa-920b-d9e311c983ec","Type":"ContainerStarted","Data":"1633bc806bd862969e339dcd989b9c47210b7cb563a3e0963e7b675d7a133367"} Jul 05 00:14:01.674172 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:01.674125 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qwk6z" event={"ID":"00a4e5ad-fd46-4aaa-920b-d9e311c983ec","Type":"ContainerStarted","Data":"375ddd9a97e8bea6114548d1f8f60533fa3cf05fc2f6fa5fd9f860d953081cb5"} Jul 05 00:14:01.675380 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:01.675354 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ms8rb" event={"ID":"ffd08932-7257-4b59-8a1f-01c91839aca1","Type":"ContainerStarted","Data":"30d916cb6e38a2c736474391d0dad5aac91033ab751a0780b8537fc8e0ea7255"} Jul 05 00:14:01.682446 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:01.682276 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:14:02.681028 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:02.680956 2561 generic.go:356] "Generic (PLEG): container finished" podID="ffd08932-7257-4b59-8a1f-01c91839aca1" containerID="26b8ad671d003f31977ee2b90e319e9b4329a0161f79e70a7686990c1c7914e2" exitCode=0 Jul 05 00:14:02.681422 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:02.681048 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ms8rb" event={"ID":"ffd08932-7257-4b59-8a1f-01c91839aca1","Type":"ContainerDied","Data":"26b8ad671d003f31977ee2b90e319e9b4329a0161f79e70a7686990c1c7914e2"} Jul 05 00:14:03.385653 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.385614 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-55f858b44-w78ww"] Jul 05 00:14:03.389084 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.389056 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.391721 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.391698 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 05 00:14:03.391896 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.391863 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 05 00:14:03.391991 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.391906 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hmbhz\"" Jul 05 00:14:03.392148 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.392134 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 05 00:14:03.392217 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.392201 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 05 00:14:03.392282 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.392217 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 05 00:14:03.392892 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.392861 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-82nekh47gkdnb\"" Jul 05 00:14:03.399698 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.399624 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-55f858b44-w78ww"] Jul 05 00:14:03.454537 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.454515 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5c44da80-8871-4e4a-897e-49453716fb51-secret-thanos-querier-tls\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.454647 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.454544 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c44da80-8871-4e4a-897e-49453716fb51-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.454647 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.454621 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c44da80-8871-4e4a-897e-49453716fb51-secret-grpc-tls\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.454647 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.454640 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgx7c\" (UniqueName: \"kubernetes.io/projected/5c44da80-8871-4e4a-897e-49453716fb51-kube-api-access-zgx7c\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.454835 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.454674 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c44da80-8871-4e4a-897e-49453716fb51-metrics-client-ca\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.454835 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.454718 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5c44da80-8871-4e4a-897e-49453716fb51-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.454835 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.454820 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c44da80-8871-4e4a-897e-49453716fb51-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.454992 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.454856 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5c44da80-8871-4e4a-897e-49453716fb51-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.555551 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.555515 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgx7c\" (UniqueName: \"kubernetes.io/projected/5c44da80-8871-4e4a-897e-49453716fb51-kube-api-access-zgx7c\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.555682 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.555562 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c44da80-8871-4e4a-897e-49453716fb51-metrics-client-ca\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.555682 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.555598 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5c44da80-8871-4e4a-897e-49453716fb51-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.555790 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.555722 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c44da80-8871-4e4a-897e-49453716fb51-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.555790 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.555758 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5c44da80-8871-4e4a-897e-49453716fb51-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.555932 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.555825 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5c44da80-8871-4e4a-897e-49453716fb51-secret-thanos-querier-tls\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.555932 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.555863 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c44da80-8871-4e4a-897e-49453716fb51-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.556029 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.555961 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c44da80-8871-4e4a-897e-49453716fb51-secret-grpc-tls\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.556432 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.556401 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c44da80-8871-4e4a-897e-49453716fb51-metrics-client-ca\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.558741 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.558713 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5c44da80-8871-4e4a-897e-49453716fb51-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.558849 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.558822 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c44da80-8871-4e4a-897e-49453716fb51-secret-grpc-tls\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.559048 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.559028 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c44da80-8871-4e4a-897e-49453716fb51-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.559306 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.559278 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c44da80-8871-4e4a-897e-49453716fb51-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.559306 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.559297 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5c44da80-8871-4e4a-897e-49453716fb51-secret-thanos-querier-tls\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.559409 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.559282 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5c44da80-8871-4e4a-897e-49453716fb51-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.562995 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.562975 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgx7c\" (UniqueName: \"kubernetes.io/projected/5c44da80-8871-4e4a-897e-49453716fb51-kube-api-access-zgx7c\") pod \"thanos-querier-55f858b44-w78ww\" (UID: \"5c44da80-8871-4e4a-897e-49453716fb51\") " pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.687017 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.686927 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ms8rb" event={"ID":"ffd08932-7257-4b59-8a1f-01c91839aca1","Type":"ContainerStarted","Data":"b9d27e292b31f7f2cec11bf8691b82df5255cd159d23b4d06d4a0307cbf5115b"} Jul 05 00:14:03.687017 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.686992 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ms8rb" event={"ID":"ffd08932-7257-4b59-8a1f-01c91839aca1","Type":"ContainerStarted","Data":"7e37c0c6ee78f3b7260926687999c6c145a205682392c825317c943a3e35f531"} Jul 05 00:14:03.689276 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.689243 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qwk6z" event={"ID":"00a4e5ad-fd46-4aaa-920b-d9e311c983ec","Type":"ContainerStarted","Data":"716eda6543cd109480856055a895ce0cfd6af6ee706902c73dd4592cbd21437a"} Jul 05 00:14:03.700160 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.700141 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:03.709117 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.709081 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ms8rb" podStartSLOduration=2.623880925 podStartE2EDuration="3.70906946s" totalImagesPullingTime="1.011834437s" totalInitContainerRuntime="73.354098ms" isStatefulPod=true podCreationTimestamp="2026-07-05 00:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:14:03.708743668 +0000 UTC m=+314.433759727" watchObservedRunningTime="2026-07-05 00:14:03.70906946 +0000 UTC m=+314.434085510" Jul 05 00:14:03.730927 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.730653 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qwk6z" podStartSLOduration=2.5874587719999997 podStartE2EDuration="3.730621777s" totalImagesPullingTime="1.143163005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:14:03.730609546 +0000 UTC m=+314.455625605" watchObservedRunningTime="2026-07-05 00:14:03.730621777 +0000 UTC m=+314.455637837" Jul 05 00:14:03.838723 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:03.838696 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-55f858b44-w78ww"] Jul 05 00:14:03.841455 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:14:03.841424 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c44da80_8871_4e4a_897e_49453716fb51.slice/crio-4c7ead0d5152e84932430396d19afc662944ea46c834ec36fd38ec3e963d588b WatchSource:0}: Error finding container 4c7ead0d5152e84932430396d19afc662944ea46c834ec36fd38ec3e963d588b: Status 404 returned error can't find the container with id 4c7ead0d5152e84932430396d19afc662944ea46c834ec36fd38ec3e963d588b Jul 05 00:14:04.695161 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.695124 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" event={"ID":"5c44da80-8871-4e4a-897e-49453716fb51","Type":"ContainerStarted","Data":"4c7ead0d5152e84932430396d19afc662944ea46c834ec36fd38ec3e963d588b"} Jul 05 00:14:04.797490 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.797452 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-86659787cb-9x6pn"] Jul 05 00:14:04.799863 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.799837 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:04.802296 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.802259 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 05 00:14:04.802409 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.802342 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 05 00:14:04.802525 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.802510 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-89tw9\"" Jul 05 00:14:04.803943 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.803919 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 05 00:14:04.804035 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.803963 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fhku12pvb561e\"" Jul 05 00:14:04.804102 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.803920 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 05 00:14:04.810808 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.810767 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86659787cb-9x6pn"] Jul 05 00:14:04.867324 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.867293 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkpbm\" (UniqueName: \"kubernetes.io/projected/33714cc0-2510-4d30-89ca-e7e1c7f84340-kube-api-access-bkpbm\") pod \"metrics-server-86659787cb-9x6pn\" (UID: \"33714cc0-2510-4d30-89ca-e7e1c7f84340\") " pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:04.867464 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.867397 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/33714cc0-2510-4d30-89ca-e7e1c7f84340-metrics-server-audit-profiles\") pod \"metrics-server-86659787cb-9x6pn\" (UID: \"33714cc0-2510-4d30-89ca-e7e1c7f84340\") " pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:04.867464 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.867429 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33714cc0-2510-4d30-89ca-e7e1c7f84340-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86659787cb-9x6pn\" (UID: \"33714cc0-2510-4d30-89ca-e7e1c7f84340\") " pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:04.867571 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.867464 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/33714cc0-2510-4d30-89ca-e7e1c7f84340-secret-metrics-server-tls\") pod \"metrics-server-86659787cb-9x6pn\" (UID: \"33714cc0-2510-4d30-89ca-e7e1c7f84340\") " pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:04.867571 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.867490 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/33714cc0-2510-4d30-89ca-e7e1c7f84340-audit-log\") pod \"metrics-server-86659787cb-9x6pn\" (UID: \"33714cc0-2510-4d30-89ca-e7e1c7f84340\") " pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:04.867647 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.867591 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/33714cc0-2510-4d30-89ca-e7e1c7f84340-secret-metrics-server-client-certs\") pod \"metrics-server-86659787cb-9x6pn\" (UID: \"33714cc0-2510-4d30-89ca-e7e1c7f84340\") " pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:04.867647 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.867632 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/33714cc0-2510-4d30-89ca-e7e1c7f84340-client-ca-bundle\") pod \"metrics-server-86659787cb-9x6pn\" (UID: \"33714cc0-2510-4d30-89ca-e7e1c7f84340\") " pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:04.968900 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.968834 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/33714cc0-2510-4d30-89ca-e7e1c7f84340-metrics-server-audit-profiles\") pod \"metrics-server-86659787cb-9x6pn\" (UID: \"33714cc0-2510-4d30-89ca-e7e1c7f84340\") " pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:04.968900 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.968872 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33714cc0-2510-4d30-89ca-e7e1c7f84340-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86659787cb-9x6pn\" (UID: \"33714cc0-2510-4d30-89ca-e7e1c7f84340\") " pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:04.969073 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.968905 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/33714cc0-2510-4d30-89ca-e7e1c7f84340-secret-metrics-server-tls\") pod \"metrics-server-86659787cb-9x6pn\" (UID: \"33714cc0-2510-4d30-89ca-e7e1c7f84340\") " pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:04.969377 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.969348 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/33714cc0-2510-4d30-89ca-e7e1c7f84340-audit-log\") pod \"metrics-server-86659787cb-9x6pn\" (UID: \"33714cc0-2510-4d30-89ca-e7e1c7f84340\") " pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:04.969515 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.969422 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/33714cc0-2510-4d30-89ca-e7e1c7f84340-secret-metrics-server-client-certs\") pod \"metrics-server-86659787cb-9x6pn\" (UID: \"33714cc0-2510-4d30-89ca-e7e1c7f84340\") " pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:04.969515 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.969451 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/33714cc0-2510-4d30-89ca-e7e1c7f84340-client-ca-bundle\") pod \"metrics-server-86659787cb-9x6pn\" (UID: \"33714cc0-2510-4d30-89ca-e7e1c7f84340\") " pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:04.969515 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.969508 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkpbm\" (UniqueName: \"kubernetes.io/projected/33714cc0-2510-4d30-89ca-e7e1c7f84340-kube-api-access-bkpbm\") pod \"metrics-server-86659787cb-9x6pn\" (UID: \"33714cc0-2510-4d30-89ca-e7e1c7f84340\") " pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:04.970675 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.970451 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/33714cc0-2510-4d30-89ca-e7e1c7f84340-metrics-server-audit-profiles\") pod \"metrics-server-86659787cb-9x6pn\" (UID: \"33714cc0-2510-4d30-89ca-e7e1c7f84340\") " pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:04.970675 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.970523 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33714cc0-2510-4d30-89ca-e7e1c7f84340-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86659787cb-9x6pn\" (UID: \"33714cc0-2510-4d30-89ca-e7e1c7f84340\") " pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:04.970878 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.970765 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/33714cc0-2510-4d30-89ca-e7e1c7f84340-audit-log\") pod \"metrics-server-86659787cb-9x6pn\" (UID: \"33714cc0-2510-4d30-89ca-e7e1c7f84340\") " pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:04.972672 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.972646 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/33714cc0-2510-4d30-89ca-e7e1c7f84340-secret-metrics-server-tls\") pod \"metrics-server-86659787cb-9x6pn\" (UID: \"33714cc0-2510-4d30-89ca-e7e1c7f84340\") " pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:04.975595 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.973274 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/33714cc0-2510-4d30-89ca-e7e1c7f84340-secret-metrics-server-client-certs\") pod \"metrics-server-86659787cb-9x6pn\" (UID: \"33714cc0-2510-4d30-89ca-e7e1c7f84340\") " pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:04.975595 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.973317 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/33714cc0-2510-4d30-89ca-e7e1c7f84340-client-ca-bundle\") pod \"metrics-server-86659787cb-9x6pn\" (UID: \"33714cc0-2510-4d30-89ca-e7e1c7f84340\") " pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:04.981307 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:04.981271 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkpbm\" (UniqueName: \"kubernetes.io/projected/33714cc0-2510-4d30-89ca-e7e1c7f84340-kube-api-access-bkpbm\") pod \"metrics-server-86659787cb-9x6pn\" (UID: \"33714cc0-2510-4d30-89ca-e7e1c7f84340\") " pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:05.112393 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:05.112355 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:05.178734 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:05.178697 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-9rp78"] Jul 05 00:14:05.181740 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:05.181716 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9rp78" Jul 05 00:14:05.184645 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:05.184620 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 05 00:14:05.184645 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:05.184632 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ghkqg\"" Jul 05 00:14:05.190427 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:05.190030 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-9rp78"] Jul 05 00:14:05.257452 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:05.257334 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86659787cb-9x6pn"] Jul 05 00:14:05.259948 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:14:05.259917 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33714cc0_2510_4d30_89ca_e7e1c7f84340.slice/crio-66f2f684fc6e4ae4b442b401d698e01a5cbb31fee32b3ab439016ae55dd68214 WatchSource:0}: Error finding container 66f2f684fc6e4ae4b442b401d698e01a5cbb31fee32b3ab439016ae55dd68214: Status 404 returned error can't find the container with id 66f2f684fc6e4ae4b442b401d698e01a5cbb31fee32b3ab439016ae55dd68214 Jul 05 00:14:05.272501 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:05.272477 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1813fe8d-71b8-4cc6-93ad-6e49a9d77af3-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-9rp78\" (UID: \"1813fe8d-71b8-4cc6-93ad-6e49a9d77af3\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9rp78" Jul 05 00:14:05.272596 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:05.272513 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mk96\" (UniqueName: \"kubernetes.io/projected/1813fe8d-71b8-4cc6-93ad-6e49a9d77af3-kube-api-access-8mk96\") pod \"monitoring-plugin-d5dcff7cf-9rp78\" (UID: \"1813fe8d-71b8-4cc6-93ad-6e49a9d77af3\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9rp78" Jul 05 00:14:05.374093 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:05.374063 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1813fe8d-71b8-4cc6-93ad-6e49a9d77af3-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-9rp78\" (UID: \"1813fe8d-71b8-4cc6-93ad-6e49a9d77af3\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9rp78" Jul 05 00:14:05.374241 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:05.374107 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mk96\" (UniqueName: \"kubernetes.io/projected/1813fe8d-71b8-4cc6-93ad-6e49a9d77af3-kube-api-access-8mk96\") pod \"monitoring-plugin-d5dcff7cf-9rp78\" (UID: \"1813fe8d-71b8-4cc6-93ad-6e49a9d77af3\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9rp78" Jul 05 00:14:05.374241 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:14:05.374227 2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 05 00:14:05.374347 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:14:05.374312 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1813fe8d-71b8-4cc6-93ad-6e49a9d77af3-monitoring-plugin-cert podName:1813fe8d-71b8-4cc6-93ad-6e49a9d77af3 nodeName:}" failed. No retries permitted until 2026-07-05 00:14:05.874292083 +0000 UTC m=+316.599308124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/1813fe8d-71b8-4cc6-93ad-6e49a9d77af3-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-9rp78" (UID: "1813fe8d-71b8-4cc6-93ad-6e49a9d77af3") : secret "monitoring-plugin-cert" not found Jul 05 00:14:05.383064 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:05.383033 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mk96\" (UniqueName: \"kubernetes.io/projected/1813fe8d-71b8-4cc6-93ad-6e49a9d77af3-kube-api-access-8mk96\") pod \"monitoring-plugin-d5dcff7cf-9rp78\" (UID: \"1813fe8d-71b8-4cc6-93ad-6e49a9d77af3\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9rp78" Jul 05 00:14:05.618844 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:05.618811 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6845f467d-cqzsc"] Jul 05 00:14:05.700582 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:05.700542 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" event={"ID":"33714cc0-2510-4d30-89ca-e7e1c7f84340","Type":"ContainerStarted","Data":"66f2f684fc6e4ae4b442b401d698e01a5cbb31fee32b3ab439016ae55dd68214"} Jul 05 00:14:05.879367 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:05.879293 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1813fe8d-71b8-4cc6-93ad-6e49a9d77af3-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-9rp78\" (UID: \"1813fe8d-71b8-4cc6-93ad-6e49a9d77af3\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9rp78" Jul 05 00:14:05.881783 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:05.881731 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1813fe8d-71b8-4cc6-93ad-6e49a9d77af3-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-9rp78\" (UID: \"1813fe8d-71b8-4cc6-93ad-6e49a9d77af3\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9rp78" Jul 05 00:14:06.093282 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:06.093260 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9rp78" Jul 05 00:14:06.219009 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:06.218983 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-9rp78"] Jul 05 00:14:06.220951 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:14:06.220928 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1813fe8d_71b8_4cc6_93ad_6e49a9d77af3.slice/crio-1c0aeccf020f44a24cb6d9f4e4bb2817127147a8144dac2b0c454e7fa3071150 WatchSource:0}: Error finding container 1c0aeccf020f44a24cb6d9f4e4bb2817127147a8144dac2b0c454e7fa3071150: Status 404 returned error can't find the container with id 1c0aeccf020f44a24cb6d9f4e4bb2817127147a8144dac2b0c454e7fa3071150 Jul 05 00:14:06.707722 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:06.707684 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" event={"ID":"5c44da80-8871-4e4a-897e-49453716fb51","Type":"ContainerStarted","Data":"d5864b307e5a46648e30f8ef153388c3ab7a2b5079294da96de132844f3630ca"} Jul 05 00:14:06.708181 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:06.707770 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" event={"ID":"5c44da80-8871-4e4a-897e-49453716fb51","Type":"ContainerStarted","Data":"53836c96544ae5c8c62b68508feca01eda2c4f39f6cde8b0255e07ceaaf056f7"} Jul 05 00:14:06.708181 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:06.707831 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" event={"ID":"5c44da80-8871-4e4a-897e-49453716fb51","Type":"ContainerStarted","Data":"8e87ee5ce64dd376a51c1006d6afd3b5d3a74442997dd81b07f9417c2816f417"} Jul 05 00:14:06.709081 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:06.709048 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9rp78" event={"ID":"1813fe8d-71b8-4cc6-93ad-6e49a9d77af3","Type":"ContainerStarted","Data":"1c0aeccf020f44a24cb6d9f4e4bb2817127147a8144dac2b0c454e7fa3071150"} Jul 05 00:14:07.140663 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.140624 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9b894d9c8-vcn9x"] Jul 05 00:14:07.167560 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.167530 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55df65fb65-mct44"] Jul 05 00:14:07.170487 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.170462 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:07.181526 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.181501 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55df65fb65-mct44"] Jul 05 00:14:07.291411 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.291371 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-service-ca\") pod \"console-55df65fb65-mct44\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:07.291609 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.291493 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vh2g\" (UniqueName: \"kubernetes.io/projected/ed1a169d-a717-4beb-9b10-48dc324eeb4b-kube-api-access-4vh2g\") pod \"console-55df65fb65-mct44\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:07.291609 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.291565 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed1a169d-a717-4beb-9b10-48dc324eeb4b-console-serving-cert\") pod \"console-55df65fb65-mct44\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:07.291609 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.291591 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed1a169d-a717-4beb-9b10-48dc324eeb4b-console-oauth-config\") pod \"console-55df65fb65-mct44\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:07.291786 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.291621 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-oauth-serving-cert\") pod \"console-55df65fb65-mct44\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:07.291786 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.291697 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-trusted-ca-bundle\") pod \"console-55df65fb65-mct44\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:07.291786 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.291734 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-console-config\") pod \"console-55df65fb65-mct44\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:07.392842 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.392745 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-oauth-serving-cert\") pod \"console-55df65fb65-mct44\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:07.392993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.392853 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-trusted-ca-bundle\") pod \"console-55df65fb65-mct44\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:07.392993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.392889 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-console-config\") pod \"console-55df65fb65-mct44\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:07.392993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.392941 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-service-ca\") pod \"console-55df65fb65-mct44\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:07.393147 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.393001 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vh2g\" (UniqueName: \"kubernetes.io/projected/ed1a169d-a717-4beb-9b10-48dc324eeb4b-kube-api-access-4vh2g\") pod \"console-55df65fb65-mct44\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:07.393147 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.393058 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed1a169d-a717-4beb-9b10-48dc324eeb4b-console-serving-cert\") pod \"console-55df65fb65-mct44\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:07.393147 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.393082 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed1a169d-a717-4beb-9b10-48dc324eeb4b-console-oauth-config\") pod \"console-55df65fb65-mct44\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:07.393593 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.393562 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-oauth-serving-cert\") pod \"console-55df65fb65-mct44\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:07.393761 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.393734 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-console-config\") pod \"console-55df65fb65-mct44\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:07.393910 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.393734 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-service-ca\") pod \"console-55df65fb65-mct44\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:07.393910 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.393766 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-trusted-ca-bundle\") pod \"console-55df65fb65-mct44\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:07.395672 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.395645 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed1a169d-a717-4beb-9b10-48dc324eeb4b-console-oauth-config\") pod \"console-55df65fb65-mct44\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:07.395766 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.395749 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed1a169d-a717-4beb-9b10-48dc324eeb4b-console-serving-cert\") pod \"console-55df65fb65-mct44\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:07.400379 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.400360 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vh2g\" (UniqueName: \"kubernetes.io/projected/ed1a169d-a717-4beb-9b10-48dc324eeb4b-kube-api-access-4vh2g\") pod \"console-55df65fb65-mct44\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:07.483691 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.483653 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:07.882788 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:07.882730 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55df65fb65-mct44"] Jul 05 00:14:07.889026 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:14:07.888996 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded1a169d_a717_4beb_9b10_48dc324eeb4b.slice/crio-d134980a2edb4083689b2694b6711b56098e867fb85a1b477df34f35b840470e WatchSource:0}: Error finding container d134980a2edb4083689b2694b6711b56098e867fb85a1b477df34f35b840470e: Status 404 returned error can't find the container with id d134980a2edb4083689b2694b6711b56098e867fb85a1b477df34f35b840470e Jul 05 00:14:08.720076 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:08.720042 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55df65fb65-mct44" event={"ID":"ed1a169d-a717-4beb-9b10-48dc324eeb4b","Type":"ContainerStarted","Data":"1768b3e3cf33851ed830ea5975d8b483018793d75be2af3c921bd9929d23ab6e"} Jul 05 00:14:08.720241 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:08.720133 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55df65fb65-mct44" event={"ID":"ed1a169d-a717-4beb-9b10-48dc324eeb4b","Type":"ContainerStarted","Data":"d134980a2edb4083689b2694b6711b56098e867fb85a1b477df34f35b840470e"} Jul 05 00:14:08.722889 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:08.722857 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" event={"ID":"5c44da80-8871-4e4a-897e-49453716fb51","Type":"ContainerStarted","Data":"dcc31eb90ddf122d21cb21aace4952bd35359bfc36951189c0c03913c15a3e8a"} Jul 05 00:14:08.723013 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:08.722918 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" event={"ID":"5c44da80-8871-4e4a-897e-49453716fb51","Type":"ContainerStarted","Data":"4bd2abaff14fedf377b907b3ccdba452c3bc0e890518fc0eb10c235abbf7ab6b"} Jul 05 00:14:08.723013 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:08.722961 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" event={"ID":"5c44da80-8871-4e4a-897e-49453716fb51","Type":"ContainerStarted","Data":"0bcecd24f3272d780f56653dda567b89419eda17208abefb630d02be81328ba8"} Jul 05 00:14:08.723013 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:08.723004 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:08.724347 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:08.724323 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" event={"ID":"33714cc0-2510-4d30-89ca-e7e1c7f84340","Type":"ContainerStarted","Data":"ebfce8e9c192ef0c0ed2a8c98b04d0b2a88c029948b7d5348f239f93182ec79a"} Jul 05 00:14:08.725711 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:08.725688 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9rp78" event={"ID":"1813fe8d-71b8-4cc6-93ad-6e49a9d77af3","Type":"ContainerStarted","Data":"48f76b01472a1bce4f0db12065864d89a74b6b0a6b4c6dba0ed13dfaca2f8eb7"} Jul 05 00:14:08.725893 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:08.725879 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9rp78" Jul 05 00:14:08.730475 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:08.730461 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9rp78" Jul 05 00:14:08.738624 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:08.738587 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55df65fb65-mct44" podStartSLOduration=1.738577142 podStartE2EDuration="1.738577142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:14:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:14:08.737108031 +0000 UTC m=+319.462124091" watchObservedRunningTime="2026-07-05 00:14:08.738577142 +0000 UTC m=+319.463593200" Jul 05 00:14:08.757572 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:08.757532 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" podStartSLOduration=2.036361066 podStartE2EDuration="5.757520708s" totalImagesPullingTime="3.721159642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:14:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:14:08.755461957 +0000 UTC m=+319.480478040" watchObservedRunningTime="2026-07-05 00:14:08.757520708 +0000 UTC m=+319.482536766" Jul 05 00:14:08.770876 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:08.770828 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-9rp78" podStartSLOduration=2.225536537 podStartE2EDuration="3.770816048s" totalImagesPullingTime="1.545279511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:14:08.769516137 +0000 UTC m=+319.494532192" watchObservedRunningTime="2026-07-05 00:14:08.770816048 +0000 UTC m=+319.495832127" Jul 05 00:14:08.789279 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:08.789240 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" podStartSLOduration=2.310390227 podStartE2EDuration="4.789228815s" totalImagesPullingTime="2.478838588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:14:08.788712403 +0000 UTC m=+319.513728464" watchObservedRunningTime="2026-07-05 00:14:08.789228815 +0000 UTC m=+319.514244874" Jul 05 00:14:09.301331 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:09.301299 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:14:14.737101 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:14.737073 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-55f858b44-w78ww" Jul 05 00:14:17.484533 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:17.484493 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:17.484932 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:17.484565 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:17.489537 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:17.489511 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:17.770326 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:17.770248 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:14:17.811649 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:17.811619 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c5c6ff8b9-449sv"] Jul 05 00:14:25.113377 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:25.113346 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:25.113852 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:25.113398 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:30.642956 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.642885 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6845f467d-cqzsc" podUID="8f05d3fd-5eed-413a-bc3a-90b63d81ee2f" containerName="registry" containerID="cri-o://016355749a8d1fb2fedffd820f638636ecb69b5af44c62df7ea4d0f6823a3dc9" gracePeriod=30 Jul 05 00:14:30.823042 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.823011 2561 generic.go:356] "Generic (PLEG): container finished" podID="ce97d3ea-0558-47bb-bce3-0aebe2cc7603" containerID="e9f3f954dbe4d479a69d74d1c48ce6824b2165d952d4e5302c6ad1202f840ab7" exitCode=0 Jul 05 00:14:30.823197 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.823097 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" event={"ID":"ce97d3ea-0558-47bb-bce3-0aebe2cc7603","Type":"ContainerDied","Data":"e9f3f954dbe4d479a69d74d1c48ce6824b2165d952d4e5302c6ad1202f840ab7"} Jul 05 00:14:30.823546 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.823528 2561 scope.go:117] "RemoveContainer" containerID="e9f3f954dbe4d479a69d74d1c48ce6824b2165d952d4e5302c6ad1202f840ab7" Jul 05 00:14:30.824723 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.824700 2561 generic.go:356] "Generic (PLEG): container finished" podID="8f05d3fd-5eed-413a-bc3a-90b63d81ee2f" containerID="016355749a8d1fb2fedffd820f638636ecb69b5af44c62df7ea4d0f6823a3dc9" exitCode=0 Jul 05 00:14:30.824833 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.824767 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6845f467d-cqzsc" event={"ID":"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f","Type":"ContainerDied","Data":"016355749a8d1fb2fedffd820f638636ecb69b5af44c62df7ea4d0f6823a3dc9"} Jul 05 00:14:30.891261 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.891241 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:14:30.989749 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.989665 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls\") pod \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " Jul 05 00:14:30.989749 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.989709 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-certificates\") pod \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " Jul 05 00:14:30.989749 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.989747 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-ca-trust-extracted\") pod \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " Jul 05 00:14:30.990030 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.989817 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-bound-sa-token\") pod \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " Jul 05 00:14:30.990030 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.989858 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-image-registry-private-configuration\") pod \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " Jul 05 00:14:30.990030 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.989883 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-trusted-ca\") pod \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " Jul 05 00:14:30.990030 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.989923 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-installation-pull-secrets\") pod \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " Jul 05 00:14:30.990030 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.989958 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lrnd\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-kube-api-access-7lrnd\") pod \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\" (UID: \"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f\") " Jul 05 00:14:30.990257 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.990225 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f" (UID: "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:14:30.990361 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.990342 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-certificates\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:14:30.991263 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.990897 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f" (UID: "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:14:30.992919 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.992892 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-kube-api-access-7lrnd" (OuterVolumeSpecName: "kube-api-access-7lrnd") pod "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f" (UID: "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f"). InnerVolumeSpecName "kube-api-access-7lrnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:14:30.993006 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.992936 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f" (UID: "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:14:30.993006 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.992926 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f" (UID: "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 00:14:30.993006 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.992960 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f" (UID: "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:14:30.993581 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.993559 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f" (UID: "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 00:14:30.998519 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:30.998495 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f" (UID: "8f05d3fd-5eed-413a-bc3a-90b63d81ee2f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:14:31.092122 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:31.092079 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-installation-pull-secrets\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:14:31.092122 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:31.092121 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lrnd\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-kube-api-access-7lrnd\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:14:31.092321 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:31.092136 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-registry-tls\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:14:31.092321 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:31.092150 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-ca-trust-extracted\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:14:31.092321 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:31.092166 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-bound-sa-token\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:14:31.092321 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:31.092180 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-image-registry-private-configuration\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:14:31.092321 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:31.092194 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f-trusted-ca\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:14:31.831602 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:31.831564 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-j4rbf" event={"ID":"ce97d3ea-0558-47bb-bce3-0aebe2cc7603","Type":"ContainerStarted","Data":"4210defc43d02d3b67341cabd060e1211f69dc75c176c64c912e94390c9f1e66"} Jul 05 00:14:31.833110 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:31.833067 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6845f467d-cqzsc" event={"ID":"8f05d3fd-5eed-413a-bc3a-90b63d81ee2f","Type":"ContainerDied","Data":"08157091e8dbce3def84ced21eb8c3afaa2b01d2e96d8b597bd9cac3d46c7ccb"} Jul 05 00:14:31.833245 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:31.833120 2561 scope.go:117] "RemoveContainer" containerID="016355749a8d1fb2fedffd820f638636ecb69b5af44c62df7ea4d0f6823a3dc9" Jul 05 00:14:31.833245 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:31.833120 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6845f467d-cqzsc" Jul 05 00:14:31.862762 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:31.862734 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6845f467d-cqzsc"] Jul 05 00:14:31.867031 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:31.867005 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6845f467d-cqzsc"] Jul 05 00:14:32.167655 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.167587 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-9b894d9c8-vcn9x" podUID="74250274-ed33-4573-a6b3-2e47dd1568f6" containerName="console" containerID="cri-o://dcb78ed44ef8439c35c6b281c2c7d7124fe03306f9643b2532093b9d6651a7a6" gracePeriod=15 Jul 05 00:14:32.409031 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.409010 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:14:32.503736 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.503682 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-trusted-ca-bundle\") pod \"74250274-ed33-4573-a6b3-2e47dd1568f6\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " Jul 05 00:14:32.503736 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.503729 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-oauth-serving-cert\") pod \"74250274-ed33-4573-a6b3-2e47dd1568f6\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " Jul 05 00:14:32.503948 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.503773 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9zg9\" (UniqueName: \"kubernetes.io/projected/74250274-ed33-4573-a6b3-2e47dd1568f6-kube-api-access-w9zg9\") pod \"74250274-ed33-4573-a6b3-2e47dd1568f6\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " Jul 05 00:14:32.503948 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.503816 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74250274-ed33-4573-a6b3-2e47dd1568f6-console-oauth-config\") pod \"74250274-ed33-4573-a6b3-2e47dd1568f6\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " Jul 05 00:14:32.503948 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.503855 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-service-ca\") pod \"74250274-ed33-4573-a6b3-2e47dd1568f6\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " Jul 05 00:14:32.503948 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.503891 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-console-config\") pod \"74250274-ed33-4573-a6b3-2e47dd1568f6\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " Jul 05 00:14:32.503948 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.503927 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74250274-ed33-4573-a6b3-2e47dd1568f6-console-serving-cert\") pod \"74250274-ed33-4573-a6b3-2e47dd1568f6\" (UID: \"74250274-ed33-4573-a6b3-2e47dd1568f6\") " Jul 05 00:14:32.504220 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.504117 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "74250274-ed33-4573-a6b3-2e47dd1568f6" (UID: "74250274-ed33-4573-a6b3-2e47dd1568f6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:14:32.504284 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.504222 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "74250274-ed33-4573-a6b3-2e47dd1568f6" (UID: "74250274-ed33-4573-a6b3-2e47dd1568f6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:14:32.504344 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.504313 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-service-ca" (OuterVolumeSpecName: "service-ca") pod "74250274-ed33-4573-a6b3-2e47dd1568f6" (UID: "74250274-ed33-4573-a6b3-2e47dd1568f6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:14:32.504344 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.504316 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-console-config" (OuterVolumeSpecName: "console-config") pod "74250274-ed33-4573-a6b3-2e47dd1568f6" (UID: "74250274-ed33-4573-a6b3-2e47dd1568f6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:14:32.506123 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.506098 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74250274-ed33-4573-a6b3-2e47dd1568f6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "74250274-ed33-4573-a6b3-2e47dd1568f6" (UID: "74250274-ed33-4573-a6b3-2e47dd1568f6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 00:14:32.506212 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.506136 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74250274-ed33-4573-a6b3-2e47dd1568f6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "74250274-ed33-4573-a6b3-2e47dd1568f6" (UID: "74250274-ed33-4573-a6b3-2e47dd1568f6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 00:14:32.506212 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.506178 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74250274-ed33-4573-a6b3-2e47dd1568f6-kube-api-access-w9zg9" (OuterVolumeSpecName: "kube-api-access-w9zg9") pod "74250274-ed33-4573-a6b3-2e47dd1568f6" (UID: "74250274-ed33-4573-a6b3-2e47dd1568f6"). InnerVolumeSpecName "kube-api-access-w9zg9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:14:32.605484 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.605454 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-oauth-serving-cert\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:14:32.605484 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.605481 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9zg9\" (UniqueName: \"kubernetes.io/projected/74250274-ed33-4573-a6b3-2e47dd1568f6-kube-api-access-w9zg9\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:14:32.605642 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.605495 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/74250274-ed33-4573-a6b3-2e47dd1568f6-console-oauth-config\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:14:32.605642 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.605510 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-service-ca\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:14:32.605642 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.605522 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-console-config\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:14:32.605642 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.605533 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/74250274-ed33-4573-a6b3-2e47dd1568f6-console-serving-cert\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:14:32.605642 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.605546 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74250274-ed33-4573-a6b3-2e47dd1568f6-trusted-ca-bundle\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:14:32.838658 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.838623 2561 generic.go:356] "Generic (PLEG): container finished" podID="74250274-ed33-4573-a6b3-2e47dd1568f6" containerID="dcb78ed44ef8439c35c6b281c2c7d7124fe03306f9643b2532093b9d6651a7a6" exitCode=0 Jul 05 00:14:32.839094 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.838664 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b894d9c8-vcn9x" Jul 05 00:14:32.839094 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.838686 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b894d9c8-vcn9x" event={"ID":"74250274-ed33-4573-a6b3-2e47dd1568f6","Type":"ContainerDied","Data":"dcb78ed44ef8439c35c6b281c2c7d7124fe03306f9643b2532093b9d6651a7a6"} Jul 05 00:14:32.839094 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.838731 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b894d9c8-vcn9x" event={"ID":"74250274-ed33-4573-a6b3-2e47dd1568f6","Type":"ContainerDied","Data":"b6963f92ce37cc040af2a704ae7051bd8f5047a0e09fd924e4a0c6b47a16ed88"} Jul 05 00:14:32.839094 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.838753 2561 scope.go:117] "RemoveContainer" containerID="dcb78ed44ef8439c35c6b281c2c7d7124fe03306f9643b2532093b9d6651a7a6" Jul 05 00:14:32.847128 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.847109 2561 scope.go:117] "RemoveContainer" containerID="dcb78ed44ef8439c35c6b281c2c7d7124fe03306f9643b2532093b9d6651a7a6" Jul 05 00:14:32.847371 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:14:32.847352 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcb78ed44ef8439c35c6b281c2c7d7124fe03306f9643b2532093b9d6651a7a6\": container with ID starting with dcb78ed44ef8439c35c6b281c2c7d7124fe03306f9643b2532093b9d6651a7a6 not found: ID does not exist" containerID="dcb78ed44ef8439c35c6b281c2c7d7124fe03306f9643b2532093b9d6651a7a6" Jul 05 00:14:32.847421 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.847378 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcb78ed44ef8439c35c6b281c2c7d7124fe03306f9643b2532093b9d6651a7a6"} err="failed to get container status \"dcb78ed44ef8439c35c6b281c2c7d7124fe03306f9643b2532093b9d6651a7a6\": rpc error: code = NotFound desc = could not find container \"dcb78ed44ef8439c35c6b281c2c7d7124fe03306f9643b2532093b9d6651a7a6\": container with ID starting with dcb78ed44ef8439c35c6b281c2c7d7124fe03306f9643b2532093b9d6651a7a6 not found: ID does not exist" Jul 05 00:14:32.858942 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.858922 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9b894d9c8-vcn9x"] Jul 05 00:14:32.864571 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:32.864552 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9b894d9c8-vcn9x"] Jul 05 00:14:33.776373 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:33.776332 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74250274-ed33-4573-a6b3-2e47dd1568f6" path="/var/lib/kubelet/pods/74250274-ed33-4573-a6b3-2e47dd1568f6/volumes" Jul 05 00:14:33.776844 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:33.776824 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f05d3fd-5eed-413a-bc3a-90b63d81ee2f" path="/var/lib/kubelet/pods/8f05d3fd-5eed-413a-bc3a-90b63d81ee2f/volumes" Jul 05 00:14:42.833013 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:42.832930 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-c5c6ff8b9-449sv" podUID="cac54bd8-1c40-4d47-964a-6a2dab51a7c6" containerName="console" containerID="cri-o://c8cc5934b80a688d04096fca3efc69d18ccd1f2b2346876275cf7704f8ba65a8" gracePeriod=15 Jul 05 00:14:43.084087 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.084030 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:14:43.192555 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.192522 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-console-serving-cert\") pod \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " Jul 05 00:14:43.192731 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.192575 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-service-ca\") pod \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " Jul 05 00:14:43.192731 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.192592 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-oauth-serving-cert\") pod \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " Jul 05 00:14:43.192731 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.192611 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-console-oauth-config\") pod \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " Jul 05 00:14:43.192731 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.192646 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbm68\" (UniqueName: \"kubernetes.io/projected/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-kube-api-access-mbm68\") pod \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " Jul 05 00:14:43.192731 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.192691 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-console-config\") pod \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\" (UID: \"cac54bd8-1c40-4d47-964a-6a2dab51a7c6\") " Jul 05 00:14:43.193048 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.193013 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cac54bd8-1c40-4d47-964a-6a2dab51a7c6" (UID: "cac54bd8-1c40-4d47-964a-6a2dab51a7c6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:14:43.193048 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.193039 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-service-ca" (OuterVolumeSpecName: "service-ca") pod "cac54bd8-1c40-4d47-964a-6a2dab51a7c6" (UID: "cac54bd8-1c40-4d47-964a-6a2dab51a7c6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:14:43.193191 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.193110 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-console-config" (OuterVolumeSpecName: "console-config") pod "cac54bd8-1c40-4d47-964a-6a2dab51a7c6" (UID: "cac54bd8-1c40-4d47-964a-6a2dab51a7c6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:14:43.195280 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.195238 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-kube-api-access-mbm68" (OuterVolumeSpecName: "kube-api-access-mbm68") pod "cac54bd8-1c40-4d47-964a-6a2dab51a7c6" (UID: "cac54bd8-1c40-4d47-964a-6a2dab51a7c6"). InnerVolumeSpecName "kube-api-access-mbm68". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:14:43.195762 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.195726 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cac54bd8-1c40-4d47-964a-6a2dab51a7c6" (UID: "cac54bd8-1c40-4d47-964a-6a2dab51a7c6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 00:14:43.200910 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.200890 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cac54bd8-1c40-4d47-964a-6a2dab51a7c6" (UID: "cac54bd8-1c40-4d47-964a-6a2dab51a7c6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 00:14:43.294572 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.294449 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-service-ca\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:14:43.294572 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.294486 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-oauth-serving-cert\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:14:43.294572 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.294502 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-console-oauth-config\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:14:43.294572 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.294517 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbm68\" (UniqueName: \"kubernetes.io/projected/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-kube-api-access-mbm68\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:14:43.294572 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.294531 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-console-config\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:14:43.294572 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.294546 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cac54bd8-1c40-4d47-964a-6a2dab51a7c6-console-serving-cert\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:14:43.888510 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.888459 2561 generic.go:356] "Generic (PLEG): container finished" podID="cac54bd8-1c40-4d47-964a-6a2dab51a7c6" containerID="c8cc5934b80a688d04096fca3efc69d18ccd1f2b2346876275cf7704f8ba65a8" exitCode=0 Jul 05 00:14:43.888887 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.888522 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c5c6ff8b9-449sv" Jul 05 00:14:43.888887 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.888535 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c5c6ff8b9-449sv" event={"ID":"cac54bd8-1c40-4d47-964a-6a2dab51a7c6","Type":"ContainerDied","Data":"c8cc5934b80a688d04096fca3efc69d18ccd1f2b2346876275cf7704f8ba65a8"} Jul 05 00:14:43.888887 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.888594 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c5c6ff8b9-449sv" event={"ID":"cac54bd8-1c40-4d47-964a-6a2dab51a7c6","Type":"ContainerDied","Data":"a63f464af0723f6433517e42b28d676e2939eaeeb2858aa10b0e79ec509f65bf"} Jul 05 00:14:43.888887 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.888622 2561 scope.go:117] "RemoveContainer" containerID="c8cc5934b80a688d04096fca3efc69d18ccd1f2b2346876275cf7704f8ba65a8" Jul 05 00:14:43.897251 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.897230 2561 scope.go:117] "RemoveContainer" containerID="c8cc5934b80a688d04096fca3efc69d18ccd1f2b2346876275cf7704f8ba65a8" Jul 05 00:14:43.897558 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:14:43.897534 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8cc5934b80a688d04096fca3efc69d18ccd1f2b2346876275cf7704f8ba65a8\": container with ID starting with c8cc5934b80a688d04096fca3efc69d18ccd1f2b2346876275cf7704f8ba65a8 not found: ID does not exist" containerID="c8cc5934b80a688d04096fca3efc69d18ccd1f2b2346876275cf7704f8ba65a8" Jul 05 00:14:43.897645 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.897564 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8cc5934b80a688d04096fca3efc69d18ccd1f2b2346876275cf7704f8ba65a8"} err="failed to get container status \"c8cc5934b80a688d04096fca3efc69d18ccd1f2b2346876275cf7704f8ba65a8\": rpc error: code = NotFound desc = could not find container \"c8cc5934b80a688d04096fca3efc69d18ccd1f2b2346876275cf7704f8ba65a8\": container with ID starting with c8cc5934b80a688d04096fca3efc69d18ccd1f2b2346876275cf7704f8ba65a8 not found: ID does not exist" Jul 05 00:14:43.904307 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.904284 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c5c6ff8b9-449sv"] Jul 05 00:14:43.906136 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:43.906113 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c5c6ff8b9-449sv"] Jul 05 00:14:45.118612 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:45.118575 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:45.122509 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:45.122484 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-86659787cb-9x6pn" Jul 05 00:14:45.776247 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:45.776166 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cac54bd8-1c40-4d47-964a-6a2dab51a7c6" path="/var/lib/kubelet/pods/cac54bd8-1c40-4d47-964a-6a2dab51a7c6/volumes" Jul 05 00:14:45.897906 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:45.897877 2561 generic.go:356] "Generic (PLEG): container finished" podID="e1d14242-819e-4f92-bc54-eeebf3e858f3" containerID="0dd658737cd26ce3b075c9c72cf639e6bca0c72c8bfb3c63e1eaa00d107b5d91" exitCode=0 Jul 05 00:14:45.898047 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:45.897949 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wvd2f" event={"ID":"e1d14242-819e-4f92-bc54-eeebf3e858f3","Type":"ContainerDied","Data":"0dd658737cd26ce3b075c9c72cf639e6bca0c72c8bfb3c63e1eaa00d107b5d91"} Jul 05 00:14:45.898295 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:45.898283 2561 scope.go:117] "RemoveContainer" containerID="0dd658737cd26ce3b075c9c72cf639e6bca0c72c8bfb3c63e1eaa00d107b5d91" Jul 05 00:14:46.903483 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:14:46.903447 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-wvd2f" event={"ID":"e1d14242-819e-4f92-bc54-eeebf3e858f3","Type":"ContainerStarted","Data":"5d2a89ba0314816f6c5a2977e9d4e69cf7e66fce014be127398ff506901121bb"} Jul 05 00:15:03.553221 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:03.553184 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs\") pod \"network-metrics-daemon-tlll9\" (UID: \"107f4ca7-7252-4983-9468-ba558c9e9e58\") " pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:15:03.555475 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:03.555452 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/107f4ca7-7252-4983-9468-ba558c9e9e58-metrics-certs\") pod \"network-metrics-daemon-tlll9\" (UID: \"107f4ca7-7252-4983-9468-ba558c9e9e58\") " pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:15:03.574609 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:03.574583 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m9r6w\"" Jul 05 00:15:03.582585 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:03.582559 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tlll9" Jul 05 00:15:03.705727 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:03.705697 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tlll9"] Jul 05 00:15:03.709175 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:15:03.709152 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod107f4ca7_7252_4983_9468_ba558c9e9e58.slice/crio-9ef97f59d35e4d49c3bee17b2e16643623154b79249ab2d2cd523c203db4dda6 WatchSource:0}: Error finding container 9ef97f59d35e4d49c3bee17b2e16643623154b79249ab2d2cd523c203db4dda6: Status 404 returned error can't find the container with id 9ef97f59d35e4d49c3bee17b2e16643623154b79249ab2d2cd523c203db4dda6 Jul 05 00:15:03.969834 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:03.969780 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tlll9" event={"ID":"107f4ca7-7252-4983-9468-ba558c9e9e58","Type":"ContainerStarted","Data":"9ef97f59d35e4d49c3bee17b2e16643623154b79249ab2d2cd523c203db4dda6"} Jul 05 00:15:05.979250 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:05.979205 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tlll9" event={"ID":"107f4ca7-7252-4983-9468-ba558c9e9e58","Type":"ContainerStarted","Data":"93b05846312847d197a2669083c16ffd26009383fb7400b733277419b56ac9b5"} Jul 05 00:15:05.979603 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:05.979275 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tlll9" event={"ID":"107f4ca7-7252-4983-9468-ba558c9e9e58","Type":"ContainerStarted","Data":"f020bd326129ac8a51b1d08da0e2ffe9e2c9744cd92355c5f7ef373c3199faa0"} Jul 05 00:15:05.995847 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:05.995776 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tlll9" podStartSLOduration=375.651415728 podStartE2EDuration="6m16.995762913s" totalImagesPullingTime="1.344347185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:08:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:15:05.994352352 +0000 UTC m=+376.719368413" watchObservedRunningTime="2026-07-05 00:15:05.995762913 +0000 UTC m=+376.720778973" Jul 05 00:15:28.705440 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.705408 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c86b7587-9cljv"] Jul 05 00:15:28.705897 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.705741 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f05d3fd-5eed-413a-bc3a-90b63d81ee2f" containerName="registry" Jul 05 00:15:28.705897 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.705756 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f05d3fd-5eed-413a-bc3a-90b63d81ee2f" containerName="registry" Jul 05 00:15:28.705897 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.705769 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cac54bd8-1c40-4d47-964a-6a2dab51a7c6" containerName="console" Jul 05 00:15:28.705897 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.705776 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cac54bd8-1c40-4d47-964a-6a2dab51a7c6" containerName="console" Jul 05 00:15:28.705897 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.705788 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74250274-ed33-4573-a6b3-2e47dd1568f6" containerName="console" Jul 05 00:15:28.705897 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.705809 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="74250274-ed33-4573-a6b3-2e47dd1568f6" containerName="console" Jul 05 00:15:28.705897 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.705879 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="74250274-ed33-4573-a6b3-2e47dd1568f6" containerName="console" Jul 05 00:15:28.705897 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.705889 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cac54bd8-1c40-4d47-964a-6a2dab51a7c6" containerName="console" Jul 05 00:15:28.705897 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.705901 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f05d3fd-5eed-413a-bc3a-90b63d81ee2f" containerName="registry" Jul 05 00:15:28.710212 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.710189 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:28.720141 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.720115 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c86b7587-9cljv"] Jul 05 00:15:28.849051 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.849021 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-service-ca\") pod \"console-7c86b7587-9cljv\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:28.849212 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.849071 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-trusted-ca-bundle\") pod \"console-7c86b7587-9cljv\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:28.849212 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.849089 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-oauth-serving-cert\") pod \"console-7c86b7587-9cljv\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:28.849212 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.849176 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06b0d129-93eb-4f19-8097-4fa89ebd070b-console-serving-cert\") pod \"console-7c86b7587-9cljv\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:28.849354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.849211 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06b0d129-93eb-4f19-8097-4fa89ebd070b-console-oauth-config\") pod \"console-7c86b7587-9cljv\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:28.849354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.849234 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-console-config\") pod \"console-7c86b7587-9cljv\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:28.849354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.849287 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sfjp\" (UniqueName: \"kubernetes.io/projected/06b0d129-93eb-4f19-8097-4fa89ebd070b-kube-api-access-8sfjp\") pod \"console-7c86b7587-9cljv\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:28.950275 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.950251 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-trusted-ca-bundle\") pod \"console-7c86b7587-9cljv\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:28.950275 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.950278 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-oauth-serving-cert\") pod \"console-7c86b7587-9cljv\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:28.950437 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.950305 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06b0d129-93eb-4f19-8097-4fa89ebd070b-console-serving-cert\") pod \"console-7c86b7587-9cljv\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:28.950437 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.950321 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06b0d129-93eb-4f19-8097-4fa89ebd070b-console-oauth-config\") pod \"console-7c86b7587-9cljv\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:28.950437 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.950359 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-console-config\") pod \"console-7c86b7587-9cljv\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:28.950437 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.950384 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sfjp\" (UniqueName: \"kubernetes.io/projected/06b0d129-93eb-4f19-8097-4fa89ebd070b-kube-api-access-8sfjp\") pod \"console-7c86b7587-9cljv\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:28.950592 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.950564 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-service-ca\") pod \"console-7c86b7587-9cljv\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:28.951177 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.951149 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-console-config\") pod \"console-7c86b7587-9cljv\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:28.951177 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.951167 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-oauth-serving-cert\") pod \"console-7c86b7587-9cljv\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:28.951357 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.951226 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-service-ca\") pod \"console-7c86b7587-9cljv\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:28.951357 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.951247 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-trusted-ca-bundle\") pod \"console-7c86b7587-9cljv\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:28.952734 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.952717 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06b0d129-93eb-4f19-8097-4fa89ebd070b-console-serving-cert\") pod \"console-7c86b7587-9cljv\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:28.952963 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.952948 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06b0d129-93eb-4f19-8097-4fa89ebd070b-console-oauth-config\") pod \"console-7c86b7587-9cljv\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:28.958020 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:28.957967 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sfjp\" (UniqueName: \"kubernetes.io/projected/06b0d129-93eb-4f19-8097-4fa89ebd070b-kube-api-access-8sfjp\") pod \"console-7c86b7587-9cljv\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:29.020757 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:29.020737 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:29.145896 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:29.145874 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c86b7587-9cljv"] Jul 05 00:15:29.148412 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:15:29.148388 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06b0d129_93eb_4f19_8097_4fa89ebd070b.slice/crio-cfa75be238a876c7f8c0df0606f0d28d13d974c6ad9d77e593144a8564314a79 WatchSource:0}: Error finding container cfa75be238a876c7f8c0df0606f0d28d13d974c6ad9d77e593144a8564314a79: Status 404 returned error can't find the container with id cfa75be238a876c7f8c0df0606f0d28d13d974c6ad9d77e593144a8564314a79 Jul 05 00:15:30.069965 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:30.069928 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c86b7587-9cljv" event={"ID":"06b0d129-93eb-4f19-8097-4fa89ebd070b","Type":"ContainerStarted","Data":"d730a6f5191f218b3af41ae1f28d7f70b16fa1c8325f8f73b84820a36b50542b"} Jul 05 00:15:30.070329 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:30.070003 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c86b7587-9cljv" event={"ID":"06b0d129-93eb-4f19-8097-4fa89ebd070b","Type":"ContainerStarted","Data":"cfa75be238a876c7f8c0df0606f0d28d13d974c6ad9d77e593144a8564314a79"} Jul 05 00:15:30.088416 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:30.088368 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c86b7587-9cljv" podStartSLOduration=2.088353069 podStartE2EDuration="2.088353069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:15:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:15:30.087425137 +0000 UTC m=+400.812441227" watchObservedRunningTime="2026-07-05 00:15:30.088353069 +0000 UTC m=+400.813369177" Jul 05 00:15:38.584397 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.584361 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c86b7587-9cljv"] Jul 05 00:15:38.612153 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.612127 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5549d89b84-94fwt"] Jul 05 00:15:38.616297 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.616277 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:38.623171 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.623149 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5549d89b84-94fwt"] Jul 05 00:15:38.723076 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.723047 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-service-ca\") pod \"console-5549d89b84-94fwt\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:38.723205 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.723106 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-oauth-serving-cert\") pod \"console-5549d89b84-94fwt\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:38.723205 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.723160 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-console-serving-cert\") pod \"console-5549d89b84-94fwt\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:38.723205 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.723180 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-console-oauth-config\") pod \"console-5549d89b84-94fwt\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:38.723328 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.723227 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n22z\" (UniqueName: \"kubernetes.io/projected/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-kube-api-access-5n22z\") pod \"console-5549d89b84-94fwt\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:38.723328 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.723260 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-console-config\") pod \"console-5549d89b84-94fwt\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:38.723328 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.723280 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-trusted-ca-bundle\") pod \"console-5549d89b84-94fwt\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:38.823972 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.823942 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-console-serving-cert\") pod \"console-5549d89b84-94fwt\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:38.823972 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.823971 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-console-oauth-config\") pod \"console-5549d89b84-94fwt\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:38.824209 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.823989 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n22z\" (UniqueName: \"kubernetes.io/projected/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-kube-api-access-5n22z\") pod \"console-5549d89b84-94fwt\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:38.824209 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.824011 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-console-config\") pod \"console-5549d89b84-94fwt\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:38.824209 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.824027 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-trusted-ca-bundle\") pod \"console-5549d89b84-94fwt\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:38.824209 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.824065 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-service-ca\") pod \"console-5549d89b84-94fwt\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:38.824209 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.824106 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-oauth-serving-cert\") pod \"console-5549d89b84-94fwt\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:38.824770 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.824744 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-console-config\") pod \"console-5549d89b84-94fwt\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:38.824891 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.824877 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-service-ca\") pod \"console-5549d89b84-94fwt\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:38.824953 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.824877 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-oauth-serving-cert\") pod \"console-5549d89b84-94fwt\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:38.824953 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.824922 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-trusted-ca-bundle\") pod \"console-5549d89b84-94fwt\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:38.826597 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.826575 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-console-serving-cert\") pod \"console-5549d89b84-94fwt\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:38.826678 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.826604 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-console-oauth-config\") pod \"console-5549d89b84-94fwt\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:38.833106 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.833087 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n22z\" (UniqueName: \"kubernetes.io/projected/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-kube-api-access-5n22z\") pod \"console-5549d89b84-94fwt\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:38.927356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:38.927288 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:39.021081 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:39.021054 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:15:39.058828 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:39.055401 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5549d89b84-94fwt"] Jul 05 00:15:39.106495 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:39.106471 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5549d89b84-94fwt" event={"ID":"e2d2627a-53f8-4e91-ad0e-f34fa54d1792","Type":"ContainerStarted","Data":"84bba0991c053b1eac241f71e6079a5fdd1a718bc39d0c349bbdafd555f49aac"} Jul 05 00:15:40.112188 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:40.112149 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5549d89b84-94fwt" event={"ID":"e2d2627a-53f8-4e91-ad0e-f34fa54d1792","Type":"ContainerStarted","Data":"1753a5ac09f1da3fea3f2949a3182de2ae79c621e8f17c7881d6ecf7ecd67404"} Jul 05 00:15:40.128935 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:40.128887 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5549d89b84-94fwt" podStartSLOduration=2.12887166 podStartE2EDuration="2.12887166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:15:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:15:40.127651352 +0000 UTC m=+410.852667412" watchObservedRunningTime="2026-07-05 00:15:40.12887166 +0000 UTC m=+410.853887719" Jul 05 00:15:48.928356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:48.928319 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:48.928356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:48.928380 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:48.933094 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:48.933076 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:49.150615 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:49.150582 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:15:49.190629 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:15:49.190563 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55df65fb65-mct44"] Jul 05 00:16:03.605513 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:03.605456 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7c86b7587-9cljv" podUID="06b0d129-93eb-4f19-8097-4fa89ebd070b" containerName="console" containerID="cri-o://d730a6f5191f218b3af41ae1f28d7f70b16fa1c8325f8f73b84820a36b50542b" gracePeriod=15 Jul 05 00:16:03.849367 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:03.849343 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:16:03.922596 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:03.922532 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06b0d129-93eb-4f19-8097-4fa89ebd070b-console-oauth-config\") pod \"06b0d129-93eb-4f19-8097-4fa89ebd070b\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " Jul 05 00:16:03.922596 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:03.922581 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8sfjp\" (UniqueName: \"kubernetes.io/projected/06b0d129-93eb-4f19-8097-4fa89ebd070b-kube-api-access-8sfjp\") pod \"06b0d129-93eb-4f19-8097-4fa89ebd070b\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " Jul 05 00:16:03.922732 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:03.922617 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-console-config\") pod \"06b0d129-93eb-4f19-8097-4fa89ebd070b\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " Jul 05 00:16:03.922732 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:03.922652 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-trusted-ca-bundle\") pod \"06b0d129-93eb-4f19-8097-4fa89ebd070b\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " Jul 05 00:16:03.922834 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:03.922791 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-service-ca\") pod \"06b0d129-93eb-4f19-8097-4fa89ebd070b\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " Jul 05 00:16:03.922893 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:03.922851 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-oauth-serving-cert\") pod \"06b0d129-93eb-4f19-8097-4fa89ebd070b\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " Jul 05 00:16:03.922944 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:03.922895 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06b0d129-93eb-4f19-8097-4fa89ebd070b-console-serving-cert\") pod \"06b0d129-93eb-4f19-8097-4fa89ebd070b\" (UID: \"06b0d129-93eb-4f19-8097-4fa89ebd070b\") " Jul 05 00:16:03.923214 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:03.923053 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-console-config" (OuterVolumeSpecName: "console-config") pod "06b0d129-93eb-4f19-8097-4fa89ebd070b" (UID: "06b0d129-93eb-4f19-8097-4fa89ebd070b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:16:03.923214 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:03.923081 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "06b0d129-93eb-4f19-8097-4fa89ebd070b" (UID: "06b0d129-93eb-4f19-8097-4fa89ebd070b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:16:03.923214 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:03.923175 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-console-config\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:16:03.923214 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:03.923130 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-service-ca" (OuterVolumeSpecName: "service-ca") pod "06b0d129-93eb-4f19-8097-4fa89ebd070b" (UID: "06b0d129-93eb-4f19-8097-4fa89ebd070b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:16:03.923433 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:03.923260 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "06b0d129-93eb-4f19-8097-4fa89ebd070b" (UID: "06b0d129-93eb-4f19-8097-4fa89ebd070b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:16:03.924677 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:03.924652 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06b0d129-93eb-4f19-8097-4fa89ebd070b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "06b0d129-93eb-4f19-8097-4fa89ebd070b" (UID: "06b0d129-93eb-4f19-8097-4fa89ebd070b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 00:16:03.924767 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:03.924712 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06b0d129-93eb-4f19-8097-4fa89ebd070b-kube-api-access-8sfjp" (OuterVolumeSpecName: "kube-api-access-8sfjp") pod "06b0d129-93eb-4f19-8097-4fa89ebd070b" (UID: "06b0d129-93eb-4f19-8097-4fa89ebd070b"). InnerVolumeSpecName "kube-api-access-8sfjp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:16:03.924922 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:03.924901 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06b0d129-93eb-4f19-8097-4fa89ebd070b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "06b0d129-93eb-4f19-8097-4fa89ebd070b" (UID: "06b0d129-93eb-4f19-8097-4fa89ebd070b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 00:16:04.023560 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:04.023527 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06b0d129-93eb-4f19-8097-4fa89ebd070b-console-serving-cert\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:16:04.023560 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:04.023555 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06b0d129-93eb-4f19-8097-4fa89ebd070b-console-oauth-config\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:16:04.023737 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:04.023568 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sfjp\" (UniqueName: \"kubernetes.io/projected/06b0d129-93eb-4f19-8097-4fa89ebd070b-kube-api-access-8sfjp\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:16:04.023737 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:04.023582 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-trusted-ca-bundle\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:16:04.023737 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:04.023594 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-service-ca\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:16:04.023737 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:04.023605 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06b0d129-93eb-4f19-8097-4fa89ebd070b-oauth-serving-cert\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:16:04.207289 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:04.207214 2561 generic.go:356] "Generic (PLEG): container finished" podID="06b0d129-93eb-4f19-8097-4fa89ebd070b" containerID="d730a6f5191f218b3af41ae1f28d7f70b16fa1c8325f8f73b84820a36b50542b" exitCode=0 Jul 05 00:16:04.207289 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:04.207255 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c86b7587-9cljv" Jul 05 00:16:04.207289 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:04.207271 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c86b7587-9cljv" event={"ID":"06b0d129-93eb-4f19-8097-4fa89ebd070b","Type":"ContainerDied","Data":"d730a6f5191f218b3af41ae1f28d7f70b16fa1c8325f8f73b84820a36b50542b"} Jul 05 00:16:04.207498 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:04.207309 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c86b7587-9cljv" event={"ID":"06b0d129-93eb-4f19-8097-4fa89ebd070b","Type":"ContainerDied","Data":"cfa75be238a876c7f8c0df0606f0d28d13d974c6ad9d77e593144a8564314a79"} Jul 05 00:16:04.207498 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:04.207328 2561 scope.go:117] "RemoveContainer" containerID="d730a6f5191f218b3af41ae1f28d7f70b16fa1c8325f8f73b84820a36b50542b" Jul 05 00:16:04.215909 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:04.215891 2561 scope.go:117] "RemoveContainer" containerID="d730a6f5191f218b3af41ae1f28d7f70b16fa1c8325f8f73b84820a36b50542b" Jul 05 00:16:04.216143 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:16:04.216127 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d730a6f5191f218b3af41ae1f28d7f70b16fa1c8325f8f73b84820a36b50542b\": container with ID starting with d730a6f5191f218b3af41ae1f28d7f70b16fa1c8325f8f73b84820a36b50542b not found: ID does not exist" containerID="d730a6f5191f218b3af41ae1f28d7f70b16fa1c8325f8f73b84820a36b50542b" Jul 05 00:16:04.216187 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:04.216150 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d730a6f5191f218b3af41ae1f28d7f70b16fa1c8325f8f73b84820a36b50542b"} err="failed to get container status \"d730a6f5191f218b3af41ae1f28d7f70b16fa1c8325f8f73b84820a36b50542b\": rpc error: code = NotFound desc = could not find container \"d730a6f5191f218b3af41ae1f28d7f70b16fa1c8325f8f73b84820a36b50542b\": container with ID starting with d730a6f5191f218b3af41ae1f28d7f70b16fa1c8325f8f73b84820a36b50542b not found: ID does not exist" Jul 05 00:16:04.226997 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:04.226974 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c86b7587-9cljv"] Jul 05 00:16:04.230520 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:04.230497 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c86b7587-9cljv"] Jul 05 00:16:05.775986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:05.775953 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06b0d129-93eb-4f19-8097-4fa89ebd070b" path="/var/lib/kubelet/pods/06b0d129-93eb-4f19-8097-4fa89ebd070b/volumes" Jul 05 00:16:14.214351 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:14.214256 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-55df65fb65-mct44" podUID="ed1a169d-a717-4beb-9b10-48dc324eeb4b" containerName="console" containerID="cri-o://1768b3e3cf33851ed830ea5975d8b483018793d75be2af3c921bd9929d23ab6e" gracePeriod=15 Jul 05 00:16:14.449729 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:14.449705 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:16:14.505587 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:14.505522 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed1a169d-a717-4beb-9b10-48dc324eeb4b-console-serving-cert\") pod \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " Jul 05 00:16:14.505587 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:14.505555 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-oauth-serving-cert\") pod \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " Jul 05 00:16:14.505744 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:14.505694 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-trusted-ca-bundle\") pod \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " Jul 05 00:16:14.505786 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:14.505745 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed1a169d-a717-4beb-9b10-48dc324eeb4b-console-oauth-config\") pod \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " Jul 05 00:16:14.505786 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:14.505774 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-service-ca\") pod \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " Jul 05 00:16:14.505927 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:14.505821 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-console-config\") pod \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " Jul 05 00:16:14.505927 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:14.505854 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vh2g\" (UniqueName: \"kubernetes.io/projected/ed1a169d-a717-4beb-9b10-48dc324eeb4b-kube-api-access-4vh2g\") pod \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\" (UID: \"ed1a169d-a717-4beb-9b10-48dc324eeb4b\") " Jul 05 00:16:14.506124 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:14.506092 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ed1a169d-a717-4beb-9b10-48dc324eeb4b" (UID: "ed1a169d-a717-4beb-9b10-48dc324eeb4b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:16:14.506124 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:14.506110 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ed1a169d-a717-4beb-9b10-48dc324eeb4b" (UID: "ed1a169d-a717-4beb-9b10-48dc324eeb4b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:16:14.506267 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:14.506232 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-console-config" (OuterVolumeSpecName: "console-config") pod "ed1a169d-a717-4beb-9b10-48dc324eeb4b" (UID: "ed1a169d-a717-4beb-9b10-48dc324eeb4b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:16:14.506380 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:14.506360 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-service-ca" (OuterVolumeSpecName: "service-ca") pod "ed1a169d-a717-4beb-9b10-48dc324eeb4b" (UID: "ed1a169d-a717-4beb-9b10-48dc324eeb4b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:16:14.507661 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:14.507640 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed1a169d-a717-4beb-9b10-48dc324eeb4b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ed1a169d-a717-4beb-9b10-48dc324eeb4b" (UID: "ed1a169d-a717-4beb-9b10-48dc324eeb4b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 00:16:14.507929 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:14.507908 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed1a169d-a717-4beb-9b10-48dc324eeb4b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ed1a169d-a717-4beb-9b10-48dc324eeb4b" (UID: "ed1a169d-a717-4beb-9b10-48dc324eeb4b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 00:16:14.508001 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:14.507931 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed1a169d-a717-4beb-9b10-48dc324eeb4b-kube-api-access-4vh2g" (OuterVolumeSpecName: "kube-api-access-4vh2g") pod "ed1a169d-a717-4beb-9b10-48dc324eeb4b" (UID: "ed1a169d-a717-4beb-9b10-48dc324eeb4b"). InnerVolumeSpecName "kube-api-access-4vh2g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:16:14.606547 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:14.606524 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-trusted-ca-bundle\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:16:14.606547 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:14.606546 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed1a169d-a717-4beb-9b10-48dc324eeb4b-console-oauth-config\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:16:14.606686 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:14.606555 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-service-ca\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:16:14.606686 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:14.606564 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-console-config\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:16:14.606686 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:14.606572 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vh2g\" (UniqueName: \"kubernetes.io/projected/ed1a169d-a717-4beb-9b10-48dc324eeb4b-kube-api-access-4vh2g\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:16:14.606686 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:14.606580 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed1a169d-a717-4beb-9b10-48dc324eeb4b-console-serving-cert\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:16:14.606686 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:14.606589 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed1a169d-a717-4beb-9b10-48dc324eeb4b-oauth-serving-cert\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:16:15.253814 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:15.253763 2561 generic.go:356] "Generic (PLEG): container finished" podID="ed1a169d-a717-4beb-9b10-48dc324eeb4b" containerID="1768b3e3cf33851ed830ea5975d8b483018793d75be2af3c921bd9929d23ab6e" exitCode=0 Jul 05 00:16:15.254284 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:15.253821 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55df65fb65-mct44" Jul 05 00:16:15.254284 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:15.253831 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55df65fb65-mct44" event={"ID":"ed1a169d-a717-4beb-9b10-48dc324eeb4b","Type":"ContainerDied","Data":"1768b3e3cf33851ed830ea5975d8b483018793d75be2af3c921bd9929d23ab6e"} Jul 05 00:16:15.254284 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:15.253883 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55df65fb65-mct44" event={"ID":"ed1a169d-a717-4beb-9b10-48dc324eeb4b","Type":"ContainerDied","Data":"d134980a2edb4083689b2694b6711b56098e867fb85a1b477df34f35b840470e"} Jul 05 00:16:15.254284 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:15.253903 2561 scope.go:117] "RemoveContainer" containerID="1768b3e3cf33851ed830ea5975d8b483018793d75be2af3c921bd9929d23ab6e" Jul 05 00:16:15.262215 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:15.262194 2561 scope.go:117] "RemoveContainer" containerID="1768b3e3cf33851ed830ea5975d8b483018793d75be2af3c921bd9929d23ab6e" Jul 05 00:16:15.262459 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:16:15.262440 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1768b3e3cf33851ed830ea5975d8b483018793d75be2af3c921bd9929d23ab6e\": container with ID starting with 1768b3e3cf33851ed830ea5975d8b483018793d75be2af3c921bd9929d23ab6e not found: ID does not exist" containerID="1768b3e3cf33851ed830ea5975d8b483018793d75be2af3c921bd9929d23ab6e" Jul 05 00:16:15.262527 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:15.262467 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1768b3e3cf33851ed830ea5975d8b483018793d75be2af3c921bd9929d23ab6e"} err="failed to get container status \"1768b3e3cf33851ed830ea5975d8b483018793d75be2af3c921bd9929d23ab6e\": rpc error: code = NotFound desc = could not find container \"1768b3e3cf33851ed830ea5975d8b483018793d75be2af3c921bd9929d23ab6e\": container with ID starting with 1768b3e3cf33851ed830ea5975d8b483018793d75be2af3c921bd9929d23ab6e not found: ID does not exist" Jul 05 00:16:15.274123 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:15.274101 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55df65fb65-mct44"] Jul 05 00:16:15.277543 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:15.277522 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55df65fb65-mct44"] Jul 05 00:16:15.775551 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:16:15.775517 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed1a169d-a717-4beb-9b10-48dc324eeb4b" path="/var/lib/kubelet/pods/ed1a169d-a717-4beb-9b10-48dc324eeb4b/volumes" Jul 05 00:17:09.962741 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:09.962706 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd"] Jul 05 00:17:09.963138 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:09.963022 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed1a169d-a717-4beb-9b10-48dc324eeb4b" containerName="console" Jul 05 00:17:09.963138 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:09.963033 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed1a169d-a717-4beb-9b10-48dc324eeb4b" containerName="console" Jul 05 00:17:09.963138 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:09.963041 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06b0d129-93eb-4f19-8097-4fa89ebd070b" containerName="console" Jul 05 00:17:09.963138 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:09.963047 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="06b0d129-93eb-4f19-8097-4fa89ebd070b" containerName="console" Jul 05 00:17:09.963138 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:09.963103 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed1a169d-a717-4beb-9b10-48dc324eeb4b" containerName="console" Jul 05 00:17:09.963138 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:09.963115 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="06b0d129-93eb-4f19-8097-4fa89ebd070b" containerName="console" Jul 05 00:17:09.967260 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:09.967242 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd" Jul 05 00:17:09.969817 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:09.969785 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 05 00:17:09.970882 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:09.970864 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vgz9g\"" Jul 05 00:17:09.970882 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:09.970875 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 05 00:17:09.974589 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:09.974467 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd"] Jul 05 00:17:10.027147 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:10.027112 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91e204cf-900a-4fda-956e-6afa85a25272-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd\" (UID: \"91e204cf-900a-4fda-956e-6afa85a25272\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd" Jul 05 00:17:10.027274 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:10.027179 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91e204cf-900a-4fda-956e-6afa85a25272-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd\" (UID: \"91e204cf-900a-4fda-956e-6afa85a25272\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd" Jul 05 00:17:10.027274 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:10.027205 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm82n\" (UniqueName: \"kubernetes.io/projected/91e204cf-900a-4fda-956e-6afa85a25272-kube-api-access-cm82n\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd\" (UID: \"91e204cf-900a-4fda-956e-6afa85a25272\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd" Jul 05 00:17:10.128341 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:10.128315 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91e204cf-900a-4fda-956e-6afa85a25272-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd\" (UID: \"91e204cf-900a-4fda-956e-6afa85a25272\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd" Jul 05 00:17:10.128443 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:10.128374 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91e204cf-900a-4fda-956e-6afa85a25272-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd\" (UID: \"91e204cf-900a-4fda-956e-6afa85a25272\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd" Jul 05 00:17:10.128443 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:10.128394 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm82n\" (UniqueName: \"kubernetes.io/projected/91e204cf-900a-4fda-956e-6afa85a25272-kube-api-access-cm82n\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd\" (UID: \"91e204cf-900a-4fda-956e-6afa85a25272\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd" Jul 05 00:17:10.128714 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:10.128695 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91e204cf-900a-4fda-956e-6afa85a25272-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd\" (UID: \"91e204cf-900a-4fda-956e-6afa85a25272\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd" Jul 05 00:17:10.128774 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:10.128722 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91e204cf-900a-4fda-956e-6afa85a25272-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd\" (UID: \"91e204cf-900a-4fda-956e-6afa85a25272\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd" Jul 05 00:17:10.136004 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:10.135979 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm82n\" (UniqueName: \"kubernetes.io/projected/91e204cf-900a-4fda-956e-6afa85a25272-kube-api-access-cm82n\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd\" (UID: \"91e204cf-900a-4fda-956e-6afa85a25272\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd" Jul 05 00:17:10.276695 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:10.276610 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd" Jul 05 00:17:10.399303 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:10.399277 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd"] Jul 05 00:17:10.401731 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:17:10.401696 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e204cf_900a_4fda_956e_6afa85a25272.slice/crio-b8f275a03fda09aeb85e4f86af8463dcb2dd1560ab26abca4e8658ea961c5707 WatchSource:0}: Error finding container b8f275a03fda09aeb85e4f86af8463dcb2dd1560ab26abca4e8658ea961c5707: Status 404 returned error can't find the container with id b8f275a03fda09aeb85e4f86af8463dcb2dd1560ab26abca4e8658ea961c5707 Jul 05 00:17:10.472552 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:10.472525 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd" event={"ID":"91e204cf-900a-4fda-956e-6afa85a25272","Type":"ContainerStarted","Data":"b8f275a03fda09aeb85e4f86af8463dcb2dd1560ab26abca4e8658ea961c5707"} Jul 05 00:17:17.504969 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:17.504927 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd" event={"ID":"91e204cf-900a-4fda-956e-6afa85a25272","Type":"ContainerStarted","Data":"466f9b581bd28da0ad3886a84be8cb7d056dc647536ace000ff9d54a88b61c91"} Jul 05 00:17:18.510536 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:18.510500 2561 generic.go:356] "Generic (PLEG): container finished" podID="91e204cf-900a-4fda-956e-6afa85a25272" containerID="466f9b581bd28da0ad3886a84be8cb7d056dc647536ace000ff9d54a88b61c91" exitCode=0 Jul 05 00:17:18.510900 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:18.510557 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd" event={"ID":"91e204cf-900a-4fda-956e-6afa85a25272","Type":"ContainerDied","Data":"466f9b581bd28da0ad3886a84be8cb7d056dc647536ace000ff9d54a88b61c91"} Jul 05 00:17:26.545264 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:26.545170 2561 generic.go:356] "Generic (PLEG): container finished" podID="91e204cf-900a-4fda-956e-6afa85a25272" containerID="9a10cccfc3b486d110edbde0b56138290c303cbaf92f18d3713edba4f6b45654" exitCode=0 Jul 05 00:17:26.545264 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:26.545210 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd" event={"ID":"91e204cf-900a-4fda-956e-6afa85a25272","Type":"ContainerDied","Data":"9a10cccfc3b486d110edbde0b56138290c303cbaf92f18d3713edba4f6b45654"} Jul 05 00:17:34.584425 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:34.584385 2561 generic.go:356] "Generic (PLEG): container finished" podID="91e204cf-900a-4fda-956e-6afa85a25272" containerID="d90c5d04830284778fdff83b58d7d445a3c8114c406a669ce0964cf447af4a26" exitCode=0 Jul 05 00:17:34.584756 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:34.584465 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd" event={"ID":"91e204cf-900a-4fda-956e-6afa85a25272","Type":"ContainerDied","Data":"d90c5d04830284778fdff83b58d7d445a3c8114c406a669ce0964cf447af4a26"} Jul 05 00:17:35.713054 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:35.713027 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd" Jul 05 00:17:35.834788 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:35.834760 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91e204cf-900a-4fda-956e-6afa85a25272-bundle\") pod \"91e204cf-900a-4fda-956e-6afa85a25272\" (UID: \"91e204cf-900a-4fda-956e-6afa85a25272\") " Jul 05 00:17:35.834949 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:35.834820 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cm82n\" (UniqueName: \"kubernetes.io/projected/91e204cf-900a-4fda-956e-6afa85a25272-kube-api-access-cm82n\") pod \"91e204cf-900a-4fda-956e-6afa85a25272\" (UID: \"91e204cf-900a-4fda-956e-6afa85a25272\") " Jul 05 00:17:35.834949 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:35.834848 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91e204cf-900a-4fda-956e-6afa85a25272-util\") pod \"91e204cf-900a-4fda-956e-6afa85a25272\" (UID: \"91e204cf-900a-4fda-956e-6afa85a25272\") " Jul 05 00:17:35.835427 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:35.835400 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91e204cf-900a-4fda-956e-6afa85a25272-bundle" (OuterVolumeSpecName: "bundle") pod "91e204cf-900a-4fda-956e-6afa85a25272" (UID: "91e204cf-900a-4fda-956e-6afa85a25272"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:17:35.836954 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:35.836924 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91e204cf-900a-4fda-956e-6afa85a25272-kube-api-access-cm82n" (OuterVolumeSpecName: "kube-api-access-cm82n") pod "91e204cf-900a-4fda-956e-6afa85a25272" (UID: "91e204cf-900a-4fda-956e-6afa85a25272"). InnerVolumeSpecName "kube-api-access-cm82n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:17:35.839571 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:35.839531 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91e204cf-900a-4fda-956e-6afa85a25272-util" (OuterVolumeSpecName: "util") pod "91e204cf-900a-4fda-956e-6afa85a25272" (UID: "91e204cf-900a-4fda-956e-6afa85a25272"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:17:35.935914 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:35.935889 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/91e204cf-900a-4fda-956e-6afa85a25272-bundle\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:17:35.935914 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:35.935912 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cm82n\" (UniqueName: \"kubernetes.io/projected/91e204cf-900a-4fda-956e-6afa85a25272-kube-api-access-cm82n\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:17:35.936026 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:35.935921 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/91e204cf-900a-4fda-956e-6afa85a25272-util\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:17:36.594318 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:36.594291 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd" Jul 05 00:17:36.594318 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:36.594294 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540k8wxd" event={"ID":"91e204cf-900a-4fda-956e-6afa85a25272","Type":"ContainerDied","Data":"b8f275a03fda09aeb85e4f86af8463dcb2dd1560ab26abca4e8658ea961c5707"} Jul 05 00:17:36.594531 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:36.594370 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b8f275a03fda09aeb85e4f86af8463dcb2dd1560ab26abca4e8658ea961c5707" Jul 05 00:17:43.363018 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:43.362931 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tbssq"] Jul 05 00:17:43.363535 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:43.363416 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91e204cf-900a-4fda-956e-6afa85a25272" containerName="extract" Jul 05 00:17:43.363535 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:43.363438 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="91e204cf-900a-4fda-956e-6afa85a25272" containerName="extract" Jul 05 00:17:43.363535 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:43.363477 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91e204cf-900a-4fda-956e-6afa85a25272" containerName="util" Jul 05 00:17:43.363535 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:43.363486 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="91e204cf-900a-4fda-956e-6afa85a25272" containerName="util" Jul 05 00:17:43.363535 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:43.363497 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91e204cf-900a-4fda-956e-6afa85a25272" containerName="pull" Jul 05 00:17:43.363535 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:43.363506 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="91e204cf-900a-4fda-956e-6afa85a25272" containerName="pull" Jul 05 00:17:43.363854 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:43.363589 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="91e204cf-900a-4fda-956e-6afa85a25272" containerName="extract" Jul 05 00:17:43.365952 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:43.365929 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tbssq" Jul 05 00:17:43.368559 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:43.368535 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 05 00:17:43.368656 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:43.368636 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-6c8mb\"" Jul 05 00:17:43.368718 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:43.368654 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 05 00:17:43.377603 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:43.377583 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tbssq"] Jul 05 00:17:43.498084 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:43.498057 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/159e07e6-7295-4bb0-a76e-c53a5379a5d7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tbssq\" (UID: \"159e07e6-7295-4bb0-a76e-c53a5379a5d7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tbssq" Jul 05 00:17:43.498219 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:43.498116 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc8br\" (UniqueName: \"kubernetes.io/projected/159e07e6-7295-4bb0-a76e-c53a5379a5d7-kube-api-access-rc8br\") pod \"cert-manager-operator-controller-manager-55c444bf86-tbssq\" (UID: \"159e07e6-7295-4bb0-a76e-c53a5379a5d7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tbssq" Jul 05 00:17:43.599255 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:43.599224 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/159e07e6-7295-4bb0-a76e-c53a5379a5d7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tbssq\" (UID: \"159e07e6-7295-4bb0-a76e-c53a5379a5d7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tbssq" Jul 05 00:17:43.599384 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:43.599291 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc8br\" (UniqueName: \"kubernetes.io/projected/159e07e6-7295-4bb0-a76e-c53a5379a5d7-kube-api-access-rc8br\") pod \"cert-manager-operator-controller-manager-55c444bf86-tbssq\" (UID: \"159e07e6-7295-4bb0-a76e-c53a5379a5d7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tbssq" Jul 05 00:17:43.599590 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:43.599570 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/159e07e6-7295-4bb0-a76e-c53a5379a5d7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tbssq\" (UID: \"159e07e6-7295-4bb0-a76e-c53a5379a5d7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tbssq" Jul 05 00:17:43.607513 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:43.607486 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc8br\" (UniqueName: \"kubernetes.io/projected/159e07e6-7295-4bb0-a76e-c53a5379a5d7-kube-api-access-rc8br\") pod \"cert-manager-operator-controller-manager-55c444bf86-tbssq\" (UID: \"159e07e6-7295-4bb0-a76e-c53a5379a5d7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tbssq" Jul 05 00:17:43.674836 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:43.674766 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tbssq" Jul 05 00:17:43.805692 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:43.805664 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tbssq"] Jul 05 00:17:43.808416 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:17:43.808388 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod159e07e6_7295_4bb0_a76e_c53a5379a5d7.slice/crio-a82507ccba079e329fb5a208f0cc55b08f9626e094d74984dade02273fb6c242 WatchSource:0}: Error finding container a82507ccba079e329fb5a208f0cc55b08f9626e094d74984dade02273fb6c242: Status 404 returned error can't find the container with id a82507ccba079e329fb5a208f0cc55b08f9626e094d74984dade02273fb6c242 Jul 05 00:17:44.628075 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:44.628039 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tbssq" event={"ID":"159e07e6-7295-4bb0-a76e-c53a5379a5d7","Type":"ContainerStarted","Data":"a82507ccba079e329fb5a208f0cc55b08f9626e094d74984dade02273fb6c242"} Jul 05 00:17:45.633739 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:45.633706 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tbssq" event={"ID":"159e07e6-7295-4bb0-a76e-c53a5379a5d7","Type":"ContainerStarted","Data":"ae80be0068557c5d6a8a4568a7213df1f74304024153badf41aa3711acbcf8c7"} Jul 05 00:17:45.658093 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:45.658046 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tbssq" podStartSLOduration=0.949776261 podStartE2EDuration="2.658030242s" totalImagesPullingTime="1.708253981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:17:45.656257472 +0000 UTC m=+536.381273531" watchObservedRunningTime="2026-07-05 00:17:45.658030242 +0000 UTC m=+536.383046301" Jul 05 00:17:46.814321 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:46.814279 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq"] Jul 05 00:17:46.816705 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:46.816682 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq" Jul 05 00:17:46.819579 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:46.819562 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vgz9g\"" Jul 05 00:17:46.819685 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:46.819566 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 05 00:17:46.820686 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:46.820664 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 05 00:17:46.826490 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:46.826469 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq"] Jul 05 00:17:46.925820 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:46.925765 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjz82\" (UniqueName: \"kubernetes.io/projected/bbe049fa-4480-4d4f-9829-20f735c64ab8-kube-api-access-fjz82\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq\" (UID: \"bbe049fa-4480-4d4f-9829-20f735c64ab8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq" Jul 05 00:17:46.925976 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:46.925831 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbe049fa-4480-4d4f-9829-20f735c64ab8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq\" (UID: \"bbe049fa-4480-4d4f-9829-20f735c64ab8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq" Jul 05 00:17:46.925976 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:46.925866 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbe049fa-4480-4d4f-9829-20f735c64ab8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq\" (UID: \"bbe049fa-4480-4d4f-9829-20f735c64ab8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq" Jul 05 00:17:47.027133 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:47.027100 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbe049fa-4480-4d4f-9829-20f735c64ab8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq\" (UID: \"bbe049fa-4480-4d4f-9829-20f735c64ab8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq" Jul 05 00:17:47.027291 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:47.027143 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbe049fa-4480-4d4f-9829-20f735c64ab8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq\" (UID: \"bbe049fa-4480-4d4f-9829-20f735c64ab8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq" Jul 05 00:17:47.027291 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:47.027241 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjz82\" (UniqueName: \"kubernetes.io/projected/bbe049fa-4480-4d4f-9829-20f735c64ab8-kube-api-access-fjz82\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq\" (UID: \"bbe049fa-4480-4d4f-9829-20f735c64ab8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq" Jul 05 00:17:47.027521 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:47.027504 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbe049fa-4480-4d4f-9829-20f735c64ab8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq\" (UID: \"bbe049fa-4480-4d4f-9829-20f735c64ab8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq" Jul 05 00:17:47.027558 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:47.027523 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbe049fa-4480-4d4f-9829-20f735c64ab8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq\" (UID: \"bbe049fa-4480-4d4f-9829-20f735c64ab8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq" Jul 05 00:17:47.035560 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:47.035538 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjz82\" (UniqueName: \"kubernetes.io/projected/bbe049fa-4480-4d4f-9829-20f735c64ab8-kube-api-access-fjz82\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq\" (UID: \"bbe049fa-4480-4d4f-9829-20f735c64ab8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq" Jul 05 00:17:47.125803 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:47.125773 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq" Jul 05 00:17:47.250476 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:47.250450 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq"] Jul 05 00:17:47.252405 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:17:47.252376 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbe049fa_4480_4d4f_9829_20f735c64ab8.slice/crio-e67f2841c3fe54f03eb33575bb5073a3cf99c604bb85be747ec6f6baeb3003ef WatchSource:0}: Error finding container e67f2841c3fe54f03eb33575bb5073a3cf99c604bb85be747ec6f6baeb3003ef: Status 404 returned error can't find the container with id e67f2841c3fe54f03eb33575bb5073a3cf99c604bb85be747ec6f6baeb3003ef Jul 05 00:17:47.643077 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:47.643042 2561 generic.go:356] "Generic (PLEG): container finished" podID="bbe049fa-4480-4d4f-9829-20f735c64ab8" containerID="3c2e8e0cdaf3d5f99d4bc996f4d9267117fd1256eb1ca5254f788d4fc3361d8e" exitCode=0 Jul 05 00:17:47.643233 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:47.643099 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq" event={"ID":"bbe049fa-4480-4d4f-9829-20f735c64ab8","Type":"ContainerDied","Data":"3c2e8e0cdaf3d5f99d4bc996f4d9267117fd1256eb1ca5254f788d4fc3361d8e"} Jul 05 00:17:47.643233 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:47.643143 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq" event={"ID":"bbe049fa-4480-4d4f-9829-20f735c64ab8","Type":"ContainerStarted","Data":"e67f2841c3fe54f03eb33575bb5073a3cf99c604bb85be747ec6f6baeb3003ef"} Jul 05 00:17:48.617401 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:48.617364 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hsz44"] Jul 05 00:17:48.620195 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:48.620176 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hsz44" Jul 05 00:17:48.622789 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:48.622762 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 05 00:17:48.622902 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:48.622873 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 05 00:17:48.623834 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:48.623816 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-hckck\"" Jul 05 00:17:48.629164 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:48.629140 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hsz44"] Jul 05 00:17:48.741544 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:48.741510 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6nlb\" (UniqueName: \"kubernetes.io/projected/e11c3214-7620-47e3-a85a-27e1564b09b9-kube-api-access-x6nlb\") pod \"cert-manager-webhook-6486ffd997-hsz44\" (UID: \"e11c3214-7620-47e3-a85a-27e1564b09b9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hsz44" Jul 05 00:17:48.741698 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:48.741562 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e11c3214-7620-47e3-a85a-27e1564b09b9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hsz44\" (UID: \"e11c3214-7620-47e3-a85a-27e1564b09b9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hsz44" Jul 05 00:17:48.843017 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:48.842986 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6nlb\" (UniqueName: \"kubernetes.io/projected/e11c3214-7620-47e3-a85a-27e1564b09b9-kube-api-access-x6nlb\") pod \"cert-manager-webhook-6486ffd997-hsz44\" (UID: \"e11c3214-7620-47e3-a85a-27e1564b09b9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hsz44" Jul 05 00:17:48.843170 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:48.843042 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e11c3214-7620-47e3-a85a-27e1564b09b9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hsz44\" (UID: \"e11c3214-7620-47e3-a85a-27e1564b09b9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hsz44" Jul 05 00:17:48.851567 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:48.851538 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e11c3214-7620-47e3-a85a-27e1564b09b9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hsz44\" (UID: \"e11c3214-7620-47e3-a85a-27e1564b09b9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hsz44" Jul 05 00:17:48.851673 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:48.851644 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6nlb\" (UniqueName: \"kubernetes.io/projected/e11c3214-7620-47e3-a85a-27e1564b09b9-kube-api-access-x6nlb\") pod \"cert-manager-webhook-6486ffd997-hsz44\" (UID: \"e11c3214-7620-47e3-a85a-27e1564b09b9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hsz44" Jul 05 00:17:48.939377 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:48.939299 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hsz44" Jul 05 00:17:49.069274 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:49.069251 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hsz44"] Jul 05 00:17:49.071277 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:17:49.071249 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode11c3214_7620_47e3_a85a_27e1564b09b9.slice/crio-ae41f662fb89cc2426c3896181df83129a912a197072ab6245daf810287f1c72 WatchSource:0}: Error finding container ae41f662fb89cc2426c3896181df83129a912a197072ab6245daf810287f1c72: Status 404 returned error can't find the container with id ae41f662fb89cc2426c3896181df83129a912a197072ab6245daf810287f1c72 Jul 05 00:17:49.653459 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:49.653419 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hsz44" event={"ID":"e11c3214-7620-47e3-a85a-27e1564b09b9","Type":"ContainerStarted","Data":"ae41f662fb89cc2426c3896181df83129a912a197072ab6245daf810287f1c72"} Jul 05 00:17:52.671855 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:52.671826 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq" event={"ID":"bbe049fa-4480-4d4f-9829-20f735c64ab8","Type":"ContainerStarted","Data":"6fa661048a9ecaa6ad2cf69323228d34ba846ff83bef184465ad1821622bbb9d"} Jul 05 00:17:52.673725 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:52.673700 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hsz44" event={"ID":"e11c3214-7620-47e3-a85a-27e1564b09b9","Type":"ContainerStarted","Data":"ebe3619c673ccdec596542429cf71d0dcf9193129da40c907de98380e2b1fa6a"} Jul 05 00:17:52.674178 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:52.673863 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hsz44" Jul 05 00:17:52.707143 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:52.707090 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-hsz44" podStartSLOduration=1.186207692 podStartE2EDuration="4.707070283s" totalImagesPullingTime="3.520862591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:17:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:17:52.706646737 +0000 UTC m=+543.431662796" watchObservedRunningTime="2026-07-05 00:17:52.707070283 +0000 UTC m=+543.432086345" Jul 05 00:17:53.679968 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:53.679936 2561 generic.go:356] "Generic (PLEG): container finished" podID="bbe049fa-4480-4d4f-9829-20f735c64ab8" containerID="6fa661048a9ecaa6ad2cf69323228d34ba846ff83bef184465ad1821622bbb9d" exitCode=0 Jul 05 00:17:53.680335 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:53.680024 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq" event={"ID":"bbe049fa-4480-4d4f-9829-20f735c64ab8","Type":"ContainerDied","Data":"6fa661048a9ecaa6ad2cf69323228d34ba846ff83bef184465ad1821622bbb9d"} Jul 05 00:17:54.686671 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:54.686640 2561 generic.go:356] "Generic (PLEG): container finished" podID="bbe049fa-4480-4d4f-9829-20f735c64ab8" containerID="8328c5ffc3217c53a2f4aac9e81b64563eeefebc9e56ba6a1893958c527ae853" exitCode=0 Jul 05 00:17:54.687053 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:54.686686 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq" event={"ID":"bbe049fa-4480-4d4f-9829-20f735c64ab8","Type":"ContainerDied","Data":"8328c5ffc3217c53a2f4aac9e81b64563eeefebc9e56ba6a1893958c527ae853"} Jul 05 00:17:55.823416 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:55.823381 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq" Jul 05 00:17:56.007583 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:56.007505 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbe049fa-4480-4d4f-9829-20f735c64ab8-bundle\") pod \"bbe049fa-4480-4d4f-9829-20f735c64ab8\" (UID: \"bbe049fa-4480-4d4f-9829-20f735c64ab8\") " Jul 05 00:17:56.007583 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:56.007541 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbe049fa-4480-4d4f-9829-20f735c64ab8-util\") pod \"bbe049fa-4480-4d4f-9829-20f735c64ab8\" (UID: \"bbe049fa-4480-4d4f-9829-20f735c64ab8\") " Jul 05 00:17:56.007774 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:56.007623 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjz82\" (UniqueName: \"kubernetes.io/projected/bbe049fa-4480-4d4f-9829-20f735c64ab8-kube-api-access-fjz82\") pod \"bbe049fa-4480-4d4f-9829-20f735c64ab8\" (UID: \"bbe049fa-4480-4d4f-9829-20f735c64ab8\") " Jul 05 00:17:56.007985 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:56.007960 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbe049fa-4480-4d4f-9829-20f735c64ab8-bundle" (OuterVolumeSpecName: "bundle") pod "bbe049fa-4480-4d4f-9829-20f735c64ab8" (UID: "bbe049fa-4480-4d4f-9829-20f735c64ab8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:17:56.009702 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:56.009675 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbe049fa-4480-4d4f-9829-20f735c64ab8-kube-api-access-fjz82" (OuterVolumeSpecName: "kube-api-access-fjz82") pod "bbe049fa-4480-4d4f-9829-20f735c64ab8" (UID: "bbe049fa-4480-4d4f-9829-20f735c64ab8"). InnerVolumeSpecName "kube-api-access-fjz82". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:17:56.012510 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:56.012482 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbe049fa-4480-4d4f-9829-20f735c64ab8-util" (OuterVolumeSpecName: "util") pod "bbe049fa-4480-4d4f-9829-20f735c64ab8" (UID: "bbe049fa-4480-4d4f-9829-20f735c64ab8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:17:56.108942 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:56.108916 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbe049fa-4480-4d4f-9829-20f735c64ab8-util\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:17:56.108942 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:56.108938 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjz82\" (UniqueName: \"kubernetes.io/projected/bbe049fa-4480-4d4f-9829-20f735c64ab8-kube-api-access-fjz82\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:17:56.109087 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:56.108948 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbe049fa-4480-4d4f-9829-20f735c64ab8-bundle\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:17:56.697901 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:56.697874 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq" Jul 05 00:17:56.697901 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:56.697886 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5l6mq" event={"ID":"bbe049fa-4480-4d4f-9829-20f735c64ab8","Type":"ContainerDied","Data":"e67f2841c3fe54f03eb33575bb5073a3cf99c604bb85be747ec6f6baeb3003ef"} Jul 05 00:17:56.698142 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:56.697932 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e67f2841c3fe54f03eb33575bb5073a3cf99c604bb85be747ec6f6baeb3003ef" Jul 05 00:17:57.467868 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:57.467830 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dczmj"] Jul 05 00:17:57.468362 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:57.468296 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbe049fa-4480-4d4f-9829-20f735c64ab8" containerName="pull" Jul 05 00:17:57.468362 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:57.468317 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbe049fa-4480-4d4f-9829-20f735c64ab8" containerName="pull" Jul 05 00:17:57.468362 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:57.468329 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbe049fa-4480-4d4f-9829-20f735c64ab8" containerName="extract" Jul 05 00:17:57.468362 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:57.468337 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbe049fa-4480-4d4f-9829-20f735c64ab8" containerName="extract" Jul 05 00:17:57.468576 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:57.468367 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbe049fa-4480-4d4f-9829-20f735c64ab8" containerName="util" Jul 05 00:17:57.468576 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:57.468375 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbe049fa-4480-4d4f-9829-20f735c64ab8" containerName="util" Jul 05 00:17:57.468576 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:57.468471 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbe049fa-4480-4d4f-9829-20f735c64ab8" containerName="extract" Jul 05 00:17:57.472015 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:57.471995 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dczmj" Jul 05 00:17:57.474680 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:57.474661 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-kdmt8\"" Jul 05 00:17:57.478334 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:57.478314 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dczmj"] Jul 05 00:17:57.623257 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:57.623221 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e40b013c-1129-4d26-b08b-fa1e18acc989-bound-sa-token\") pod \"cert-manager-55b4d954d5-dczmj\" (UID: \"e40b013c-1129-4d26-b08b-fa1e18acc989\") " pod="cert-manager/cert-manager-55b4d954d5-dczmj" Jul 05 00:17:57.623408 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:57.623285 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5dbg\" (UniqueName: \"kubernetes.io/projected/e40b013c-1129-4d26-b08b-fa1e18acc989-kube-api-access-f5dbg\") pod \"cert-manager-55b4d954d5-dczmj\" (UID: \"e40b013c-1129-4d26-b08b-fa1e18acc989\") " pod="cert-manager/cert-manager-55b4d954d5-dczmj" Jul 05 00:17:57.724634 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:57.724553 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e40b013c-1129-4d26-b08b-fa1e18acc989-bound-sa-token\") pod \"cert-manager-55b4d954d5-dczmj\" (UID: \"e40b013c-1129-4d26-b08b-fa1e18acc989\") " pod="cert-manager/cert-manager-55b4d954d5-dczmj" Jul 05 00:17:57.724634 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:57.724616 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5dbg\" (UniqueName: \"kubernetes.io/projected/e40b013c-1129-4d26-b08b-fa1e18acc989-kube-api-access-f5dbg\") pod \"cert-manager-55b4d954d5-dczmj\" (UID: \"e40b013c-1129-4d26-b08b-fa1e18acc989\") " pod="cert-manager/cert-manager-55b4d954d5-dczmj" Jul 05 00:17:57.732504 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:57.732462 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e40b013c-1129-4d26-b08b-fa1e18acc989-bound-sa-token\") pod \"cert-manager-55b4d954d5-dczmj\" (UID: \"e40b013c-1129-4d26-b08b-fa1e18acc989\") " pod="cert-manager/cert-manager-55b4d954d5-dczmj" Jul 05 00:17:57.732626 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:57.732578 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5dbg\" (UniqueName: \"kubernetes.io/projected/e40b013c-1129-4d26-b08b-fa1e18acc989-kube-api-access-f5dbg\") pod \"cert-manager-55b4d954d5-dczmj\" (UID: \"e40b013c-1129-4d26-b08b-fa1e18acc989\") " pod="cert-manager/cert-manager-55b4d954d5-dczmj" Jul 05 00:17:57.781345 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:57.781320 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-dczmj" Jul 05 00:17:57.904012 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:57.903985 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-dczmj"] Jul 05 00:17:57.905660 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:17:57.905634 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode40b013c_1129_4d26_b08b_fa1e18acc989.slice/crio-b1b849a58a9337adb1562c74158831256e690ad95ceb141ce520278dda2474a3 WatchSource:0}: Error finding container b1b849a58a9337adb1562c74158831256e690ad95ceb141ce520278dda2474a3: Status 404 returned error can't find the container with id b1b849a58a9337adb1562c74158831256e690ad95ceb141ce520278dda2474a3 Jul 05 00:17:58.681981 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:58.681950 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hsz44" Jul 05 00:17:58.709913 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:58.709876 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dczmj" event={"ID":"e40b013c-1129-4d26-b08b-fa1e18acc989","Type":"ContainerStarted","Data":"94d8f7a17457d40077055df397bc87227c65334665f3dcc8343956747f8f6196"} Jul 05 00:17:58.709913 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:58.709918 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-dczmj" event={"ID":"e40b013c-1129-4d26-b08b-fa1e18acc989","Type":"ContainerStarted","Data":"b1b849a58a9337adb1562c74158831256e690ad95ceb141ce520278dda2474a3"} Jul 05 00:17:58.723555 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:17:58.723338 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-dczmj" podStartSLOduration=1.723320838 podStartE2EDuration="1.723320838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:17:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:17:58.723207656 +0000 UTC m=+549.448223716" watchObservedRunningTime="2026-07-05 00:17:58.723320838 +0000 UTC m=+549.448336898" Jul 05 00:18:41.869155 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:41.869114 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7dcb9fcb66-69h9r"] Jul 05 00:18:41.871347 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:41.871325 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7dcb9fcb66-69h9r" Jul 05 00:18:41.874452 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:41.874424 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 05 00:18:41.875747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:41.875720 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 05 00:18:41.876082 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:41.876063 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 05 00:18:41.876325 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:41.876308 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 05 00:18:41.876560 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:41.876543 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 05 00:18:41.877058 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:41.877033 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hctcz\"" Jul 05 00:18:41.883526 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:41.883502 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7dcb9fcb66-69h9r"] Jul 05 00:18:41.939458 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:41.939423 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd378798-2580-4938-8102-211144a61181-cert\") pod \"lws-controller-manager-7dcb9fcb66-69h9r\" (UID: \"cd378798-2580-4938-8102-211144a61181\") " pod="openshift-lws-operator/lws-controller-manager-7dcb9fcb66-69h9r" Jul 05 00:18:41.939603 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:41.939468 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cd378798-2580-4938-8102-211144a61181-manager-config\") pod \"lws-controller-manager-7dcb9fcb66-69h9r\" (UID: \"cd378798-2580-4938-8102-211144a61181\") " pod="openshift-lws-operator/lws-controller-manager-7dcb9fcb66-69h9r" Jul 05 00:18:41.939603 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:41.939494 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mqs6\" (UniqueName: \"kubernetes.io/projected/cd378798-2580-4938-8102-211144a61181-kube-api-access-5mqs6\") pod \"lws-controller-manager-7dcb9fcb66-69h9r\" (UID: \"cd378798-2580-4938-8102-211144a61181\") " pod="openshift-lws-operator/lws-controller-manager-7dcb9fcb66-69h9r" Jul 05 00:18:41.939603 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:41.939525 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd378798-2580-4938-8102-211144a61181-metrics-cert\") pod \"lws-controller-manager-7dcb9fcb66-69h9r\" (UID: \"cd378798-2580-4938-8102-211144a61181\") " pod="openshift-lws-operator/lws-controller-manager-7dcb9fcb66-69h9r" Jul 05 00:18:42.040740 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:42.040709 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd378798-2580-4938-8102-211144a61181-cert\") pod \"lws-controller-manager-7dcb9fcb66-69h9r\" (UID: \"cd378798-2580-4938-8102-211144a61181\") " pod="openshift-lws-operator/lws-controller-manager-7dcb9fcb66-69h9r" Jul 05 00:18:42.040909 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:42.040751 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cd378798-2580-4938-8102-211144a61181-manager-config\") pod \"lws-controller-manager-7dcb9fcb66-69h9r\" (UID: \"cd378798-2580-4938-8102-211144a61181\") " pod="openshift-lws-operator/lws-controller-manager-7dcb9fcb66-69h9r" Jul 05 00:18:42.040909 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:42.040775 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mqs6\" (UniqueName: \"kubernetes.io/projected/cd378798-2580-4938-8102-211144a61181-kube-api-access-5mqs6\") pod \"lws-controller-manager-7dcb9fcb66-69h9r\" (UID: \"cd378798-2580-4938-8102-211144a61181\") " pod="openshift-lws-operator/lws-controller-manager-7dcb9fcb66-69h9r" Jul 05 00:18:42.040909 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:42.040826 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd378798-2580-4938-8102-211144a61181-metrics-cert\") pod \"lws-controller-manager-7dcb9fcb66-69h9r\" (UID: \"cd378798-2580-4938-8102-211144a61181\") " pod="openshift-lws-operator/lws-controller-manager-7dcb9fcb66-69h9r" Jul 05 00:18:42.041513 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:42.041489 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cd378798-2580-4938-8102-211144a61181-manager-config\") pod \"lws-controller-manager-7dcb9fcb66-69h9r\" (UID: \"cd378798-2580-4938-8102-211144a61181\") " pod="openshift-lws-operator/lws-controller-manager-7dcb9fcb66-69h9r" Jul 05 00:18:42.043330 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:42.043310 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cd378798-2580-4938-8102-211144a61181-cert\") pod \"lws-controller-manager-7dcb9fcb66-69h9r\" (UID: \"cd378798-2580-4938-8102-211144a61181\") " pod="openshift-lws-operator/lws-controller-manager-7dcb9fcb66-69h9r" Jul 05 00:18:42.043330 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:42.043319 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd378798-2580-4938-8102-211144a61181-metrics-cert\") pod \"lws-controller-manager-7dcb9fcb66-69h9r\" (UID: \"cd378798-2580-4938-8102-211144a61181\") " pod="openshift-lws-operator/lws-controller-manager-7dcb9fcb66-69h9r" Jul 05 00:18:42.048699 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:42.048677 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mqs6\" (UniqueName: \"kubernetes.io/projected/cd378798-2580-4938-8102-211144a61181-kube-api-access-5mqs6\") pod \"lws-controller-manager-7dcb9fcb66-69h9r\" (UID: \"cd378798-2580-4938-8102-211144a61181\") " pod="openshift-lws-operator/lws-controller-manager-7dcb9fcb66-69h9r" Jul 05 00:18:42.184497 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:42.184387 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7dcb9fcb66-69h9r" Jul 05 00:18:42.311159 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:42.311135 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7dcb9fcb66-69h9r"] Jul 05 00:18:42.313416 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:18:42.313386 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd378798_2580_4938_8102_211144a61181.slice/crio-16185cfeba22387fceef574fb64b46caa5b5f70f6f9da5b52667a9954d95f767 WatchSource:0}: Error finding container 16185cfeba22387fceef574fb64b46caa5b5f70f6f9da5b52667a9954d95f767: Status 404 returned error can't find the container with id 16185cfeba22387fceef574fb64b46caa5b5f70f6f9da5b52667a9954d95f767 Jul 05 00:18:42.899270 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:42.899233 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7dcb9fcb66-69h9r" event={"ID":"cd378798-2580-4938-8102-211144a61181","Type":"ContainerStarted","Data":"16185cfeba22387fceef574fb64b46caa5b5f70f6f9da5b52667a9954d95f767"} Jul 05 00:18:44.908744 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:44.908709 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7dcb9fcb66-69h9r" event={"ID":"cd378798-2580-4938-8102-211144a61181","Type":"ContainerStarted","Data":"7408942dd26d8259bcdf8faa4ae663762b6ffeef255be21e6c441161d9bc9947"} Jul 05 00:18:44.909120 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:44.908772 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7dcb9fcb66-69h9r" Jul 05 00:18:44.924446 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:44.924393 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7dcb9fcb66-69h9r" podStartSLOduration=2.351038699 podStartE2EDuration="3.924378829s" totalImagesPullingTime="1.57334013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:18:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:18:44.923666065 +0000 UTC m=+595.648682128" watchObservedRunningTime="2026-07-05 00:18:44.924378829 +0000 UTC m=+595.649394888" Jul 05 00:18:49.738832 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:49.738789 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/1.log" Jul 05 00:18:49.739726 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:49.739706 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/1.log" Jul 05 00:18:50.852912 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:50.852875 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x"] Jul 05 00:18:50.855317 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:50.855296 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x" Jul 05 00:18:50.857776 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:50.857745 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 05 00:18:50.857776 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:50.857760 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 05 00:18:50.857962 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:50.857753 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vgz9g\"" Jul 05 00:18:50.865096 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:50.865076 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x"] Jul 05 00:18:51.017731 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:51.017702 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x87f\" (UniqueName: \"kubernetes.io/projected/94f27269-2bf9-4bbe-bc3e-89d6251524d0-kube-api-access-7x87f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x\" (UID: \"94f27269-2bf9-4bbe-bc3e-89d6251524d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x" Jul 05 00:18:51.017731 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:51.017740 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94f27269-2bf9-4bbe-bc3e-89d6251524d0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x\" (UID: \"94f27269-2bf9-4bbe-bc3e-89d6251524d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x" Jul 05 00:18:51.017974 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:51.017760 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94f27269-2bf9-4bbe-bc3e-89d6251524d0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x\" (UID: \"94f27269-2bf9-4bbe-bc3e-89d6251524d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x" Jul 05 00:18:51.118454 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:51.118362 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x87f\" (UniqueName: \"kubernetes.io/projected/94f27269-2bf9-4bbe-bc3e-89d6251524d0-kube-api-access-7x87f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x\" (UID: \"94f27269-2bf9-4bbe-bc3e-89d6251524d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x" Jul 05 00:18:51.118454 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:51.118404 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94f27269-2bf9-4bbe-bc3e-89d6251524d0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x\" (UID: \"94f27269-2bf9-4bbe-bc3e-89d6251524d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x" Jul 05 00:18:51.118454 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:51.118424 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94f27269-2bf9-4bbe-bc3e-89d6251524d0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x\" (UID: \"94f27269-2bf9-4bbe-bc3e-89d6251524d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x" Jul 05 00:18:51.118762 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:51.118744 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94f27269-2bf9-4bbe-bc3e-89d6251524d0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x\" (UID: \"94f27269-2bf9-4bbe-bc3e-89d6251524d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x" Jul 05 00:18:51.118841 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:51.118774 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94f27269-2bf9-4bbe-bc3e-89d6251524d0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x\" (UID: \"94f27269-2bf9-4bbe-bc3e-89d6251524d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x" Jul 05 00:18:51.126759 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:51.126737 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x87f\" (UniqueName: \"kubernetes.io/projected/94f27269-2bf9-4bbe-bc3e-89d6251524d0-kube-api-access-7x87f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x\" (UID: \"94f27269-2bf9-4bbe-bc3e-89d6251524d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x" Jul 05 00:18:51.165432 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:51.165405 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x" Jul 05 00:18:51.300063 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:51.300035 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x"] Jul 05 00:18:51.302359 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:18:51.302333 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f27269_2bf9_4bbe_bc3e_89d6251524d0.slice/crio-177479e187172cb9d2bcbe5f11e1d3b9cee412b2062f5c707b6dea48b822bd42 WatchSource:0}: Error finding container 177479e187172cb9d2bcbe5f11e1d3b9cee412b2062f5c707b6dea48b822bd42: Status 404 returned error can't find the container with id 177479e187172cb9d2bcbe5f11e1d3b9cee412b2062f5c707b6dea48b822bd42 Jul 05 00:18:51.940343 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:51.940307 2561 generic.go:356] "Generic (PLEG): container finished" podID="94f27269-2bf9-4bbe-bc3e-89d6251524d0" containerID="a9ac1b65dfa3f74e3f8d1ab1465875d797227074aba918bba0a0a9940aa9cab3" exitCode=0 Jul 05 00:18:51.940707 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:51.940360 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x" event={"ID":"94f27269-2bf9-4bbe-bc3e-89d6251524d0","Type":"ContainerDied","Data":"a9ac1b65dfa3f74e3f8d1ab1465875d797227074aba918bba0a0a9940aa9cab3"} Jul 05 00:18:51.940707 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:51.940417 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x" event={"ID":"94f27269-2bf9-4bbe-bc3e-89d6251524d0","Type":"ContainerStarted","Data":"177479e187172cb9d2bcbe5f11e1d3b9cee412b2062f5c707b6dea48b822bd42"} Jul 05 00:18:52.946445 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:52.946363 2561 generic.go:356] "Generic (PLEG): container finished" podID="94f27269-2bf9-4bbe-bc3e-89d6251524d0" containerID="11557ddee7f99dd28098dbfd757cf97ca5188295ca5e75cc24b2b72f282433b9" exitCode=0 Jul 05 00:18:52.946445 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:52.946420 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x" event={"ID":"94f27269-2bf9-4bbe-bc3e-89d6251524d0","Type":"ContainerDied","Data":"11557ddee7f99dd28098dbfd757cf97ca5188295ca5e75cc24b2b72f282433b9"} Jul 05 00:18:53.952385 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:53.952351 2561 generic.go:356] "Generic (PLEG): container finished" podID="94f27269-2bf9-4bbe-bc3e-89d6251524d0" containerID="2b9da07853a2c530233ea82bcfbc4534d0c9ab02d4e75f1acf4ed8d8a20ae25d" exitCode=0 Jul 05 00:18:53.952767 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:53.952437 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x" event={"ID":"94f27269-2bf9-4bbe-bc3e-89d6251524d0","Type":"ContainerDied","Data":"2b9da07853a2c530233ea82bcfbc4534d0c9ab02d4e75f1acf4ed8d8a20ae25d"} Jul 05 00:18:55.084573 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:55.084546 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x" Jul 05 00:18:55.253052 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:55.252976 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7x87f\" (UniqueName: \"kubernetes.io/projected/94f27269-2bf9-4bbe-bc3e-89d6251524d0-kube-api-access-7x87f\") pod \"94f27269-2bf9-4bbe-bc3e-89d6251524d0\" (UID: \"94f27269-2bf9-4bbe-bc3e-89d6251524d0\") " Jul 05 00:18:55.253052 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:55.253011 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94f27269-2bf9-4bbe-bc3e-89d6251524d0-bundle\") pod \"94f27269-2bf9-4bbe-bc3e-89d6251524d0\" (UID: \"94f27269-2bf9-4bbe-bc3e-89d6251524d0\") " Jul 05 00:18:55.253052 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:55.253035 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94f27269-2bf9-4bbe-bc3e-89d6251524d0-util\") pod \"94f27269-2bf9-4bbe-bc3e-89d6251524d0\" (UID: \"94f27269-2bf9-4bbe-bc3e-89d6251524d0\") " Jul 05 00:18:55.253735 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:55.253710 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94f27269-2bf9-4bbe-bc3e-89d6251524d0-bundle" (OuterVolumeSpecName: "bundle") pod "94f27269-2bf9-4bbe-bc3e-89d6251524d0" (UID: "94f27269-2bf9-4bbe-bc3e-89d6251524d0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:18:55.255154 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:55.255126 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94f27269-2bf9-4bbe-bc3e-89d6251524d0-kube-api-access-7x87f" (OuterVolumeSpecName: "kube-api-access-7x87f") pod "94f27269-2bf9-4bbe-bc3e-89d6251524d0" (UID: "94f27269-2bf9-4bbe-bc3e-89d6251524d0"). InnerVolumeSpecName "kube-api-access-7x87f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:18:55.258279 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:55.258260 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94f27269-2bf9-4bbe-bc3e-89d6251524d0-util" (OuterVolumeSpecName: "util") pod "94f27269-2bf9-4bbe-bc3e-89d6251524d0" (UID: "94f27269-2bf9-4bbe-bc3e-89d6251524d0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:18:55.354404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:55.354372 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7x87f\" (UniqueName: \"kubernetes.io/projected/94f27269-2bf9-4bbe-bc3e-89d6251524d0-kube-api-access-7x87f\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:18:55.354404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:55.354400 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/94f27269-2bf9-4bbe-bc3e-89d6251524d0-bundle\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:18:55.354404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:55.354410 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/94f27269-2bf9-4bbe-bc3e-89d6251524d0-util\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:18:55.915167 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:55.915138 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7dcb9fcb66-69h9r" Jul 05 00:18:55.964966 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:55.964868 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x" Jul 05 00:18:55.964966 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:55.964890 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf57x" event={"ID":"94f27269-2bf9-4bbe-bc3e-89d6251524d0","Type":"ContainerDied","Data":"177479e187172cb9d2bcbe5f11e1d3b9cee412b2062f5c707b6dea48b822bd42"} Jul 05 00:18:55.964966 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:18:55.964949 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="177479e187172cb9d2bcbe5f11e1d3b9cee412b2062f5c707b6dea48b822bd42" Jul 05 00:19:02.564886 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.564847 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh"] Jul 05 00:19:02.565444 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.565297 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94f27269-2bf9-4bbe-bc3e-89d6251524d0" containerName="pull" Jul 05 00:19:02.565444 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.565316 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="94f27269-2bf9-4bbe-bc3e-89d6251524d0" containerName="pull" Jul 05 00:19:02.565444 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.565346 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94f27269-2bf9-4bbe-bc3e-89d6251524d0" containerName="util" Jul 05 00:19:02.565444 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.565354 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="94f27269-2bf9-4bbe-bc3e-89d6251524d0" containerName="util" Jul 05 00:19:02.565444 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.565380 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94f27269-2bf9-4bbe-bc3e-89d6251524d0" containerName="extract" Jul 05 00:19:02.565444 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.565390 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="94f27269-2bf9-4bbe-bc3e-89d6251524d0" containerName="extract" Jul 05 00:19:02.565863 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.565499 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="94f27269-2bf9-4bbe-bc3e-89d6251524d0" containerName="extract" Jul 05 00:19:02.568071 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.568049 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" Jul 05 00:19:02.571236 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.571214 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5n2nm\"" Jul 05 00:19:02.571343 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.571266 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 05 00:19:02.571343 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.571269 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 05 00:19:02.572117 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.572099 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 05 00:19:02.572215 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.572200 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 05 00:19:02.585555 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.585533 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh"] Jul 05 00:19:02.714659 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.714622 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6efa6c1e-8c73-4334-8420-da97a1a754c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-674c4bd948-crkmh\" (UID: \"6efa6c1e-8c73-4334-8420-da97a1a754c3\") " pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" Jul 05 00:19:02.714846 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.714666 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6efa6c1e-8c73-4334-8420-da97a1a754c3-tmp\") pod \"opendatahub-operator-controller-manager-674c4bd948-crkmh\" (UID: \"6efa6c1e-8c73-4334-8420-da97a1a754c3\") " pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" Jul 05 00:19:02.714846 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.714688 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6efa6c1e-8c73-4334-8420-da97a1a754c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-674c4bd948-crkmh\" (UID: \"6efa6c1e-8c73-4334-8420-da97a1a754c3\") " pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" Jul 05 00:19:02.714846 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.714756 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6efa6c1e-8c73-4334-8420-da97a1a754c3-manifests\") pod \"opendatahub-operator-controller-manager-674c4bd948-crkmh\" (UID: \"6efa6c1e-8c73-4334-8420-da97a1a754c3\") " pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" Jul 05 00:19:02.714846 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.714831 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kxs7\" (UniqueName: \"kubernetes.io/projected/6efa6c1e-8c73-4334-8420-da97a1a754c3-kube-api-access-2kxs7\") pod \"opendatahub-operator-controller-manager-674c4bd948-crkmh\" (UID: \"6efa6c1e-8c73-4334-8420-da97a1a754c3\") " pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" Jul 05 00:19:02.816027 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.815950 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6efa6c1e-8c73-4334-8420-da97a1a754c3-manifests\") pod \"opendatahub-operator-controller-manager-674c4bd948-crkmh\" (UID: \"6efa6c1e-8c73-4334-8420-da97a1a754c3\") " pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" Jul 05 00:19:02.816027 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.815998 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kxs7\" (UniqueName: \"kubernetes.io/projected/6efa6c1e-8c73-4334-8420-da97a1a754c3-kube-api-access-2kxs7\") pod \"opendatahub-operator-controller-manager-674c4bd948-crkmh\" (UID: \"6efa6c1e-8c73-4334-8420-da97a1a754c3\") " pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" Jul 05 00:19:02.816183 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.816047 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6efa6c1e-8c73-4334-8420-da97a1a754c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-674c4bd948-crkmh\" (UID: \"6efa6c1e-8c73-4334-8420-da97a1a754c3\") " pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" Jul 05 00:19:02.816183 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.816076 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6efa6c1e-8c73-4334-8420-da97a1a754c3-tmp\") pod \"opendatahub-operator-controller-manager-674c4bd948-crkmh\" (UID: \"6efa6c1e-8c73-4334-8420-da97a1a754c3\") " pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" Jul 05 00:19:02.816183 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.816100 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6efa6c1e-8c73-4334-8420-da97a1a754c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-674c4bd948-crkmh\" (UID: \"6efa6c1e-8c73-4334-8420-da97a1a754c3\") " pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" Jul 05 00:19:02.816432 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.816399 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6efa6c1e-8c73-4334-8420-da97a1a754c3-manifests\") pod \"opendatahub-operator-controller-manager-674c4bd948-crkmh\" (UID: \"6efa6c1e-8c73-4334-8420-da97a1a754c3\") " pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" Jul 05 00:19:02.818378 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.818350 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6efa6c1e-8c73-4334-8420-da97a1a754c3-tmp\") pod \"opendatahub-operator-controller-manager-674c4bd948-crkmh\" (UID: \"6efa6c1e-8c73-4334-8420-da97a1a754c3\") " pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" Jul 05 00:19:02.818678 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.818657 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6efa6c1e-8c73-4334-8420-da97a1a754c3-webhook-cert\") pod \"opendatahub-operator-controller-manager-674c4bd948-crkmh\" (UID: \"6efa6c1e-8c73-4334-8420-da97a1a754c3\") " pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" Jul 05 00:19:02.818722 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.818707 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6efa6c1e-8c73-4334-8420-da97a1a754c3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-674c4bd948-crkmh\" (UID: \"6efa6c1e-8c73-4334-8420-da97a1a754c3\") " pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" Jul 05 00:19:02.825055 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.825034 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kxs7\" (UniqueName: \"kubernetes.io/projected/6efa6c1e-8c73-4334-8420-da97a1a754c3-kube-api-access-2kxs7\") pod \"opendatahub-operator-controller-manager-674c4bd948-crkmh\" (UID: \"6efa6c1e-8c73-4334-8420-da97a1a754c3\") " pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" Jul 05 00:19:02.878403 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:02.878377 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" Jul 05 00:19:03.015238 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:03.015208 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh"] Jul 05 00:19:03.019206 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:19:03.019004 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6efa6c1e_8c73_4334_8420_da97a1a754c3.slice/crio-c0384594219ca156ef2f5e7635c7f24c45ca746ab4a6170779bf6cc9fc4db762 WatchSource:0}: Error finding container c0384594219ca156ef2f5e7635c7f24c45ca746ab4a6170779bf6cc9fc4db762: Status 404 returned error can't find the container with id c0384594219ca156ef2f5e7635c7f24c45ca746ab4a6170779bf6cc9fc4db762 Jul 05 00:19:03.022645 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:03.022622 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 00:19:04.007042 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:04.007007 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" event={"ID":"6efa6c1e-8c73-4334-8420-da97a1a754c3","Type":"ContainerStarted","Data":"c0384594219ca156ef2f5e7635c7f24c45ca746ab4a6170779bf6cc9fc4db762"} Jul 05 00:19:06.018510 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:06.018466 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" event={"ID":"6efa6c1e-8c73-4334-8420-da97a1a754c3","Type":"ContainerStarted","Data":"f538cf5e77af8a6b35d93d9761eaeb26ae9d6a70da87732dc443f995a8dca486"} Jul 05 00:19:07.024965 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:07.024927 2561 generic.go:356] "Generic (PLEG): container finished" podID="6efa6c1e-8c73-4334-8420-da97a1a754c3" containerID="f538cf5e77af8a6b35d93d9761eaeb26ae9d6a70da87732dc443f995a8dca486" exitCode=0 Jul 05 00:19:07.025318 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:07.025008 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" event={"ID":"6efa6c1e-8c73-4334-8420-da97a1a754c3","Type":"ContainerDied","Data":"f538cf5e77af8a6b35d93d9761eaeb26ae9d6a70da87732dc443f995a8dca486"} Jul 05 00:19:08.031749 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:08.031709 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" event={"ID":"6efa6c1e-8c73-4334-8420-da97a1a754c3","Type":"ContainerStarted","Data":"eb33b244b07b76da7269b2bb3d8d74c8bd2b1205dbcdd28b732843e437a5b63e"} Jul 05 00:19:08.032222 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:08.031911 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" Jul 05 00:19:08.055482 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:08.055438 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" podStartSLOduration=1.723092157 podStartE2EDuration="6.055422483s" totalImagesPullingTime="3.259371286s" totalInitContainerRuntime="1.07295904s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:19:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:19:08.052499635 +0000 UTC m=+618.777515694" watchObservedRunningTime="2026-07-05 00:19:08.055422483 +0000 UTC m=+618.780438542" Jul 05 00:19:19.039057 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:19.038974 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-674c4bd948-crkmh" Jul 05 00:19:39.583640 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.583606 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl"] Jul 05 00:19:39.658086 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.658049 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl"] Jul 05 00:19:39.658233 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.658172 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.661175 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.661156 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 05 00:19:39.661414 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.661396 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-x4hcp\"" Jul 05 00:19:39.720286 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.720249 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa0af251-c3d6-40e3-b489-6a421b06092b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.720459 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.720310 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-852h2\" (UniqueName: \"kubernetes.io/projected/aa0af251-c3d6-40e3-b489-6a421b06092b-kube-api-access-852h2\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.720459 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.720331 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa0af251-c3d6-40e3-b489-6a421b06092b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.720459 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.720357 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa0af251-c3d6-40e3-b489-6a421b06092b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.720459 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.720404 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa0af251-c3d6-40e3-b489-6a421b06092b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.720459 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.720444 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa0af251-c3d6-40e3-b489-6a421b06092b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.720646 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.720470 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa0af251-c3d6-40e3-b489-6a421b06092b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.720646 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.720504 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa0af251-c3d6-40e3-b489-6a421b06092b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.720646 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.720589 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa0af251-c3d6-40e3-b489-6a421b06092b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.821028 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.820992 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa0af251-c3d6-40e3-b489-6a421b06092b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.821028 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.821029 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-852h2\" (UniqueName: \"kubernetes.io/projected/aa0af251-c3d6-40e3-b489-6a421b06092b-kube-api-access-852h2\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.821275 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.821049 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa0af251-c3d6-40e3-b489-6a421b06092b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.821275 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.821189 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa0af251-c3d6-40e3-b489-6a421b06092b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.821389 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.821298 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa0af251-c3d6-40e3-b489-6a421b06092b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.821389 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.821337 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa0af251-c3d6-40e3-b489-6a421b06092b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.821389 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.821375 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa0af251-c3d6-40e3-b489-6a421b06092b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.821543 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.821422 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa0af251-c3d6-40e3-b489-6a421b06092b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.821543 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.821458 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa0af251-c3d6-40e3-b489-6a421b06092b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.821643 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.821545 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa0af251-c3d6-40e3-b489-6a421b06092b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.821700 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.821683 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa0af251-c3d6-40e3-b489-6a421b06092b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.821782 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.821742 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa0af251-c3d6-40e3-b489-6a421b06092b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.821979 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.821957 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa0af251-c3d6-40e3-b489-6a421b06092b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.822156 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.822137 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa0af251-c3d6-40e3-b489-6a421b06092b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.823893 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.823871 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa0af251-c3d6-40e3-b489-6a421b06092b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.824160 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.824142 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa0af251-c3d6-40e3-b489-6a421b06092b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.832921 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.832897 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa0af251-c3d6-40e3-b489-6a421b06092b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.833001 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.832988 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-852h2\" (UniqueName: \"kubernetes.io/projected/aa0af251-c3d6-40e3-b489-6a421b06092b-kube-api-access-852h2\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4j6mwl\" (UID: \"aa0af251-c3d6-40e3-b489-6a421b06092b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:39.969021 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:39.968940 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:40.101739 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:40.101706 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl"] Jul 05 00:19:40.103789 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:19:40.103763 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa0af251_c3d6_40e3_b489_6a421b06092b.slice/crio-407cc65542e1805f376f67eb4286c4011e87ecef80345fb441c197cb47e6f56d WatchSource:0}: Error finding container 407cc65542e1805f376f67eb4286c4011e87ecef80345fb441c197cb47e6f56d: Status 404 returned error can't find the container with id 407cc65542e1805f376f67eb4286c4011e87ecef80345fb441c197cb47e6f56d Jul 05 00:19:40.186175 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:40.186137 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" event={"ID":"aa0af251-c3d6-40e3-b489-6a421b06092b","Type":"ContainerStarted","Data":"407cc65542e1805f376f67eb4286c4011e87ecef80345fb441c197cb47e6f56d"} Jul 05 00:19:42.948823 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:42.948760 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:19:42.949099 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:42.948862 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:19:42.949099 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:42.948893 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:19:43.204022 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:43.203936 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" event={"ID":"aa0af251-c3d6-40e3-b489-6a421b06092b","Type":"ContainerStarted","Data":"9b312980ee52274ab71bcb1dd2fd7ed418f4ef7b6bb8d1fb0a938dd63fd4a9f7"} Jul 05 00:19:43.224608 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:43.224556 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" podStartSLOduration=1.381996327 podStartE2EDuration="4.224543057s" totalImagesPullingTime="2.84254673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:19:43.22204245 +0000 UTC m=+653.947058509" watchObservedRunningTime="2026-07-05 00:19:43.224543057 +0000 UTC m=+653.949559169" Jul 05 00:19:43.969613 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:43.969581 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:44.974546 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:44.974515 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:45.214609 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:45.214578 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:19:45.215504 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:19:45.215480 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4j6mwl" Jul 05 00:20:22.814533 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:22.814500 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8gmtt"] Jul 05 00:20:22.824302 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:22.824275 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8gmtt" Jul 05 00:20:22.828712 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:22.828277 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-r4k5c\"" Jul 05 00:20:22.828712 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:22.828366 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 05 00:20:22.829178 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:22.828958 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 05 00:20:22.830162 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:22.830140 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8gmtt"] Jul 05 00:20:22.874043 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:22.874021 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnzjq\" (UniqueName: \"kubernetes.io/projected/54fa87f1-d154-4bea-991b-93c2337b207c-kube-api-access-qnzjq\") pod \"kuadrant-operator-catalog-8gmtt\" (UID: \"54fa87f1-d154-4bea-991b-93c2337b207c\") " pod="kuadrant-system/kuadrant-operator-catalog-8gmtt" Jul 05 00:20:22.975136 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:22.975103 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnzjq\" (UniqueName: \"kubernetes.io/projected/54fa87f1-d154-4bea-991b-93c2337b207c-kube-api-access-qnzjq\") pod \"kuadrant-operator-catalog-8gmtt\" (UID: \"54fa87f1-d154-4bea-991b-93c2337b207c\") " pod="kuadrant-system/kuadrant-operator-catalog-8gmtt" Jul 05 00:20:22.983440 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:22.983413 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnzjq\" (UniqueName: \"kubernetes.io/projected/54fa87f1-d154-4bea-991b-93c2337b207c-kube-api-access-qnzjq\") pod \"kuadrant-operator-catalog-8gmtt\" (UID: \"54fa87f1-d154-4bea-991b-93c2337b207c\") " pod="kuadrant-system/kuadrant-operator-catalog-8gmtt" Jul 05 00:20:23.136116 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:23.136078 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8gmtt" Jul 05 00:20:23.189862 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:23.189831 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8gmtt"] Jul 05 00:20:23.264350 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:23.264322 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8gmtt"] Jul 05 00:20:23.266217 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:20:23.266191 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54fa87f1_d154_4bea_991b_93c2337b207c.slice/crio-b4c0a28e8026bb899f05b650071ce15622110243e1c033e402f0a3477066e174 WatchSource:0}: Error finding container b4c0a28e8026bb899f05b650071ce15622110243e1c033e402f0a3477066e174: Status 404 returned error can't find the container with id b4c0a28e8026bb899f05b650071ce15622110243e1c033e402f0a3477066e174 Jul 05 00:20:23.397489 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:23.397403 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8gmtt" event={"ID":"54fa87f1-d154-4bea-991b-93c2337b207c","Type":"ContainerStarted","Data":"b4c0a28e8026bb899f05b650071ce15622110243e1c033e402f0a3477066e174"} Jul 05 00:20:23.398547 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:23.398526 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wznts"] Jul 05 00:20:23.403165 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:23.403146 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wznts" Jul 05 00:20:23.414882 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:23.414859 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wznts"] Jul 05 00:20:23.479260 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:23.479238 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q5zd\" (UniqueName: \"kubernetes.io/projected/f9493252-0272-4c76-8f9b-a6a3e0b3448a-kube-api-access-6q5zd\") pod \"kuadrant-operator-catalog-wznts\" (UID: \"f9493252-0272-4c76-8f9b-a6a3e0b3448a\") " pod="kuadrant-system/kuadrant-operator-catalog-wznts" Jul 05 00:20:23.579873 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:23.579839 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q5zd\" (UniqueName: \"kubernetes.io/projected/f9493252-0272-4c76-8f9b-a6a3e0b3448a-kube-api-access-6q5zd\") pod \"kuadrant-operator-catalog-wznts\" (UID: \"f9493252-0272-4c76-8f9b-a6a3e0b3448a\") " pod="kuadrant-system/kuadrant-operator-catalog-wznts" Jul 05 00:20:23.587769 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:23.587741 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q5zd\" (UniqueName: \"kubernetes.io/projected/f9493252-0272-4c76-8f9b-a6a3e0b3448a-kube-api-access-6q5zd\") pod \"kuadrant-operator-catalog-wznts\" (UID: \"f9493252-0272-4c76-8f9b-a6a3e0b3448a\") " pod="kuadrant-system/kuadrant-operator-catalog-wznts" Jul 05 00:20:23.712026 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:23.711959 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wznts" Jul 05 00:20:23.839337 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:23.839312 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wznts"] Jul 05 00:20:23.841067 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:20:23.841039 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9493252_0272_4c76_8f9b_a6a3e0b3448a.slice/crio-ccd1fce6140750c229ee2adb89bbc72e6988f1d4a5c0bc5f6b701a554fb42ad9 WatchSource:0}: Error finding container ccd1fce6140750c229ee2adb89bbc72e6988f1d4a5c0bc5f6b701a554fb42ad9: Status 404 returned error can't find the container with id ccd1fce6140750c229ee2adb89bbc72e6988f1d4a5c0bc5f6b701a554fb42ad9 Jul 05 00:20:24.408101 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:24.408069 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wznts" event={"ID":"f9493252-0272-4c76-8f9b-a6a3e0b3448a","Type":"ContainerStarted","Data":"ccd1fce6140750c229ee2adb89bbc72e6988f1d4a5c0bc5f6b701a554fb42ad9"} Jul 05 00:20:26.421114 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:26.421066 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wznts" event={"ID":"f9493252-0272-4c76-8f9b-a6a3e0b3448a","Type":"ContainerStarted","Data":"080995e0b1ad8cd610dc3dbe547408a7861cd4e4507f4221289aa1d6199dba24"} Jul 05 00:20:26.422538 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:26.422507 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8gmtt" event={"ID":"54fa87f1-d154-4bea-991b-93c2337b207c","Type":"ContainerStarted","Data":"b074c141636958bc8a4dbbec582f6b1cf5033759ed64fa8816723091036b3b29"} Jul 05 00:20:26.422664 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:26.422583 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-8gmtt" podUID="54fa87f1-d154-4bea-991b-93c2337b207c" containerName="registry-server" containerID="cri-o://b074c141636958bc8a4dbbec582f6b1cf5033759ed64fa8816723091036b3b29" gracePeriod=2 Jul 05 00:20:26.436633 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:26.436587 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wznts" podStartSLOduration=1.651548063 podStartE2EDuration="3.436572779s" totalImagesPullingTime="1.785024716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:20:26.435185141 +0000 UTC m=+697.160201201" watchObservedRunningTime="2026-07-05 00:20:26.436572779 +0000 UTC m=+697.161588838" Jul 05 00:20:26.449691 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:26.449649 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8gmtt" podStartSLOduration=2.092443054 podStartE2EDuration="4.44963603s" totalImagesPullingTime="2.357192976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:20:26.448046044 +0000 UTC m=+697.173062104" watchObservedRunningTime="2026-07-05 00:20:26.44963603 +0000 UTC m=+697.174652089" Jul 05 00:20:26.664964 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:26.664935 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8gmtt" Jul 05 00:20:26.708884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:26.708855 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnzjq\" (UniqueName: \"kubernetes.io/projected/54fa87f1-d154-4bea-991b-93c2337b207c-kube-api-access-qnzjq\") pod \"54fa87f1-d154-4bea-991b-93c2337b207c\" (UID: \"54fa87f1-d154-4bea-991b-93c2337b207c\") " Jul 05 00:20:26.710915 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:26.710892 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54fa87f1-d154-4bea-991b-93c2337b207c-kube-api-access-qnzjq" (OuterVolumeSpecName: "kube-api-access-qnzjq") pod "54fa87f1-d154-4bea-991b-93c2337b207c" (UID: "54fa87f1-d154-4bea-991b-93c2337b207c"). InnerVolumeSpecName "kube-api-access-qnzjq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:20:26.810146 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:26.810061 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnzjq\" (UniqueName: \"kubernetes.io/projected/54fa87f1-d154-4bea-991b-93c2337b207c-kube-api-access-qnzjq\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:20:27.428596 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:27.428562 2561 generic.go:356] "Generic (PLEG): container finished" podID="54fa87f1-d154-4bea-991b-93c2337b207c" containerID="b074c141636958bc8a4dbbec582f6b1cf5033759ed64fa8816723091036b3b29" exitCode=0 Jul 05 00:20:27.429057 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:27.428610 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8gmtt" Jul 05 00:20:27.429057 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:27.428612 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8gmtt" event={"ID":"54fa87f1-d154-4bea-991b-93c2337b207c","Type":"ContainerDied","Data":"b074c141636958bc8a4dbbec582f6b1cf5033759ed64fa8816723091036b3b29"} Jul 05 00:20:27.429057 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:27.428669 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8gmtt" event={"ID":"54fa87f1-d154-4bea-991b-93c2337b207c","Type":"ContainerDied","Data":"b4c0a28e8026bb899f05b650071ce15622110243e1c033e402f0a3477066e174"} Jul 05 00:20:27.429057 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:27.428697 2561 scope.go:117] "RemoveContainer" containerID="b074c141636958bc8a4dbbec582f6b1cf5033759ed64fa8816723091036b3b29" Jul 05 00:20:27.438145 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:27.438129 2561 scope.go:117] "RemoveContainer" containerID="b074c141636958bc8a4dbbec582f6b1cf5033759ed64fa8816723091036b3b29" Jul 05 00:20:27.438374 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:20:27.438357 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b074c141636958bc8a4dbbec582f6b1cf5033759ed64fa8816723091036b3b29\": container with ID starting with b074c141636958bc8a4dbbec582f6b1cf5033759ed64fa8816723091036b3b29 not found: ID does not exist" containerID="b074c141636958bc8a4dbbec582f6b1cf5033759ed64fa8816723091036b3b29" Jul 05 00:20:27.438412 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:27.438383 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b074c141636958bc8a4dbbec582f6b1cf5033759ed64fa8816723091036b3b29"} err="failed to get container status \"b074c141636958bc8a4dbbec582f6b1cf5033759ed64fa8816723091036b3b29\": rpc error: code = NotFound desc = could not find container \"b074c141636958bc8a4dbbec582f6b1cf5033759ed64fa8816723091036b3b29\": container with ID starting with b074c141636958bc8a4dbbec582f6b1cf5033759ed64fa8816723091036b3b29 not found: ID does not exist" Jul 05 00:20:27.449858 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:27.449833 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8gmtt"] Jul 05 00:20:27.452997 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:27.452978 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8gmtt"] Jul 05 00:20:27.778737 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:27.778666 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54fa87f1-d154-4bea-991b-93c2337b207c" path="/var/lib/kubelet/pods/54fa87f1-d154-4bea-991b-93c2337b207c/volumes" Jul 05 00:20:33.712941 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:33.712910 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-wznts" Jul 05 00:20:33.713389 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:33.712974 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-wznts" Jul 05 00:20:33.735440 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:33.735408 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-wznts" Jul 05 00:20:34.484026 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:34.484001 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-wznts" Jul 05 00:20:36.405496 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.405460 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59fd6474c-7kvkh"] Jul 05 00:20:36.405990 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.405822 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54fa87f1-d154-4bea-991b-93c2337b207c" containerName="registry-server" Jul 05 00:20:36.405990 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.405835 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="54fa87f1-d154-4bea-991b-93c2337b207c" containerName="registry-server" Jul 05 00:20:36.405990 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.405897 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="54fa87f1-d154-4bea-991b-93c2337b207c" containerName="registry-server" Jul 05 00:20:36.410804 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.410768 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:36.422825 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.422787 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59fd6474c-7kvkh"] Jul 05 00:20:36.491892 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.491860 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b004c51e-79db-43c1-875f-a7ce35850ed4-console-serving-cert\") pod \"console-59fd6474c-7kvkh\" (UID: \"b004c51e-79db-43c1-875f-a7ce35850ed4\") " pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:36.491892 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.491891 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b004c51e-79db-43c1-875f-a7ce35850ed4-console-oauth-config\") pod \"console-59fd6474c-7kvkh\" (UID: \"b004c51e-79db-43c1-875f-a7ce35850ed4\") " pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:36.492090 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.491953 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b004c51e-79db-43c1-875f-a7ce35850ed4-service-ca\") pod \"console-59fd6474c-7kvkh\" (UID: \"b004c51e-79db-43c1-875f-a7ce35850ed4\") " pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:36.492090 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.491987 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b004c51e-79db-43c1-875f-a7ce35850ed4-console-config\") pod \"console-59fd6474c-7kvkh\" (UID: \"b004c51e-79db-43c1-875f-a7ce35850ed4\") " pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:36.492090 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.492002 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw55x\" (UniqueName: \"kubernetes.io/projected/b004c51e-79db-43c1-875f-a7ce35850ed4-kube-api-access-dw55x\") pod \"console-59fd6474c-7kvkh\" (UID: \"b004c51e-79db-43c1-875f-a7ce35850ed4\") " pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:36.492090 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.492045 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b004c51e-79db-43c1-875f-a7ce35850ed4-oauth-serving-cert\") pod \"console-59fd6474c-7kvkh\" (UID: \"b004c51e-79db-43c1-875f-a7ce35850ed4\") " pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:36.492090 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.492078 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b004c51e-79db-43c1-875f-a7ce35850ed4-trusted-ca-bundle\") pod \"console-59fd6474c-7kvkh\" (UID: \"b004c51e-79db-43c1-875f-a7ce35850ed4\") " pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:36.593103 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.593066 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b004c51e-79db-43c1-875f-a7ce35850ed4-service-ca\") pod \"console-59fd6474c-7kvkh\" (UID: \"b004c51e-79db-43c1-875f-a7ce35850ed4\") " pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:36.593103 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.593109 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b004c51e-79db-43c1-875f-a7ce35850ed4-console-config\") pod \"console-59fd6474c-7kvkh\" (UID: \"b004c51e-79db-43c1-875f-a7ce35850ed4\") " pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:36.593343 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.593125 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw55x\" (UniqueName: \"kubernetes.io/projected/b004c51e-79db-43c1-875f-a7ce35850ed4-kube-api-access-dw55x\") pod \"console-59fd6474c-7kvkh\" (UID: \"b004c51e-79db-43c1-875f-a7ce35850ed4\") " pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:36.593343 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.593166 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b004c51e-79db-43c1-875f-a7ce35850ed4-oauth-serving-cert\") pod \"console-59fd6474c-7kvkh\" (UID: \"b004c51e-79db-43c1-875f-a7ce35850ed4\") " pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:36.593343 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.593198 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b004c51e-79db-43c1-875f-a7ce35850ed4-trusted-ca-bundle\") pod \"console-59fd6474c-7kvkh\" (UID: \"b004c51e-79db-43c1-875f-a7ce35850ed4\") " pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:36.593343 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.593224 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b004c51e-79db-43c1-875f-a7ce35850ed4-console-serving-cert\") pod \"console-59fd6474c-7kvkh\" (UID: \"b004c51e-79db-43c1-875f-a7ce35850ed4\") " pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:36.593343 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.593326 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b004c51e-79db-43c1-875f-a7ce35850ed4-console-oauth-config\") pod \"console-59fd6474c-7kvkh\" (UID: \"b004c51e-79db-43c1-875f-a7ce35850ed4\") " pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:36.593962 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.593936 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b004c51e-79db-43c1-875f-a7ce35850ed4-console-config\") pod \"console-59fd6474c-7kvkh\" (UID: \"b004c51e-79db-43c1-875f-a7ce35850ed4\") " pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:36.594096 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.593936 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b004c51e-79db-43c1-875f-a7ce35850ed4-service-ca\") pod \"console-59fd6474c-7kvkh\" (UID: \"b004c51e-79db-43c1-875f-a7ce35850ed4\") " pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:36.594201 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.594175 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b004c51e-79db-43c1-875f-a7ce35850ed4-trusted-ca-bundle\") pod \"console-59fd6474c-7kvkh\" (UID: \"b004c51e-79db-43c1-875f-a7ce35850ed4\") " pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:36.594264 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.594182 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b004c51e-79db-43c1-875f-a7ce35850ed4-oauth-serving-cert\") pod \"console-59fd6474c-7kvkh\" (UID: \"b004c51e-79db-43c1-875f-a7ce35850ed4\") " pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:36.595714 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.595695 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b004c51e-79db-43c1-875f-a7ce35850ed4-console-serving-cert\") pod \"console-59fd6474c-7kvkh\" (UID: \"b004c51e-79db-43c1-875f-a7ce35850ed4\") " pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:36.595826 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.595746 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b004c51e-79db-43c1-875f-a7ce35850ed4-console-oauth-config\") pod \"console-59fd6474c-7kvkh\" (UID: \"b004c51e-79db-43c1-875f-a7ce35850ed4\") " pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:36.600923 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.600899 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw55x\" (UniqueName: \"kubernetes.io/projected/b004c51e-79db-43c1-875f-a7ce35850ed4-kube-api-access-dw55x\") pod \"console-59fd6474c-7kvkh\" (UID: \"b004c51e-79db-43c1-875f-a7ce35850ed4\") " pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:36.721449 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.721364 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:36.858918 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:36.858893 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59fd6474c-7kvkh"] Jul 05 00:20:36.860913 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:20:36.860887 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb004c51e_79db_43c1_875f_a7ce35850ed4.slice/crio-1206a7af841d5d2c932ea2a4a1e50d2e5a0d3910441b04b84929cb5796113ffb WatchSource:0}: Error finding container 1206a7af841d5d2c932ea2a4a1e50d2e5a0d3910441b04b84929cb5796113ffb: Status 404 returned error can't find the container with id 1206a7af841d5d2c932ea2a4a1e50d2e5a0d3910441b04b84929cb5796113ffb Jul 05 00:20:37.477279 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:37.477237 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59fd6474c-7kvkh" event={"ID":"b004c51e-79db-43c1-875f-a7ce35850ed4","Type":"ContainerStarted","Data":"2463a4889465c22fce7e6364fb1935cb9edf7007fb0922fb061af7ab390b6d29"} Jul 05 00:20:37.477664 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:37.477291 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59fd6474c-7kvkh" event={"ID":"b004c51e-79db-43c1-875f-a7ce35850ed4","Type":"ContainerStarted","Data":"1206a7af841d5d2c932ea2a4a1e50d2e5a0d3910441b04b84929cb5796113ffb"} Jul 05 00:20:37.495486 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:37.495439 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59fd6474c-7kvkh" podStartSLOduration=1.495424407 podStartE2EDuration="1.495424407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:20:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:20:37.493077901 +0000 UTC m=+708.218093961" watchObservedRunningTime="2026-07-05 00:20:37.495424407 +0000 UTC m=+708.220440523" Jul 05 00:20:38.596993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:38.596955 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj"] Jul 05 00:20:38.600603 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:38.600586 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj" Jul 05 00:20:38.603057 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:38.603039 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j8vgb\"" Jul 05 00:20:38.609010 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:38.608986 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj"] Jul 05 00:20:38.712966 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:38.712930 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c590c51-f636-4ed9-b10a-743e5eb1520a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj\" (UID: \"3c590c51-f636-4ed9-b10a-743e5eb1520a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj" Jul 05 00:20:38.713133 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:38.713018 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk7jt\" (UniqueName: \"kubernetes.io/projected/3c590c51-f636-4ed9-b10a-743e5eb1520a-kube-api-access-dk7jt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj\" (UID: \"3c590c51-f636-4ed9-b10a-743e5eb1520a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj" Jul 05 00:20:38.713133 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:38.713068 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c590c51-f636-4ed9-b10a-743e5eb1520a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj\" (UID: \"3c590c51-f636-4ed9-b10a-743e5eb1520a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj" Jul 05 00:20:38.813741 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:38.813709 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk7jt\" (UniqueName: \"kubernetes.io/projected/3c590c51-f636-4ed9-b10a-743e5eb1520a-kube-api-access-dk7jt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj\" (UID: \"3c590c51-f636-4ed9-b10a-743e5eb1520a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj" Jul 05 00:20:38.813953 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:38.813755 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c590c51-f636-4ed9-b10a-743e5eb1520a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj\" (UID: \"3c590c51-f636-4ed9-b10a-743e5eb1520a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj" Jul 05 00:20:38.813953 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:38.813791 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c590c51-f636-4ed9-b10a-743e5eb1520a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj\" (UID: \"3c590c51-f636-4ed9-b10a-743e5eb1520a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj" Jul 05 00:20:38.814137 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:38.814116 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c590c51-f636-4ed9-b10a-743e5eb1520a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj\" (UID: \"3c590c51-f636-4ed9-b10a-743e5eb1520a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj" Jul 05 00:20:38.814184 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:38.814164 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c590c51-f636-4ed9-b10a-743e5eb1520a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj\" (UID: \"3c590c51-f636-4ed9-b10a-743e5eb1520a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj" Jul 05 00:20:38.822817 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:38.822781 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk7jt\" (UniqueName: \"kubernetes.io/projected/3c590c51-f636-4ed9-b10a-743e5eb1520a-kube-api-access-dk7jt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj\" (UID: \"3c590c51-f636-4ed9-b10a-743e5eb1520a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj" Jul 05 00:20:38.912625 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:38.912553 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj" Jul 05 00:20:39.039566 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:39.039514 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj"] Jul 05 00:20:39.042205 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:20:39.042171 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c590c51_f636_4ed9_b10a_743e5eb1520a.slice/crio-e62477da1e935c6eb130b10db2d25e411936b646b332da7a12aa857ff6040319 WatchSource:0}: Error finding container e62477da1e935c6eb130b10db2d25e411936b646b332da7a12aa857ff6040319: Status 404 returned error can't find the container with id e62477da1e935c6eb130b10db2d25e411936b646b332da7a12aa857ff6040319 Jul 05 00:20:39.398109 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:39.398073 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs"] Jul 05 00:20:39.401545 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:39.401527 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs" Jul 05 00:20:39.409467 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:39.409442 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs"] Jul 05 00:20:39.488808 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:39.488761 2561 generic.go:356] "Generic (PLEG): container finished" podID="3c590c51-f636-4ed9-b10a-743e5eb1520a" containerID="56c8631862dcba78aee25c024837395f0efc219c337159168af6235ba75be3eb" exitCode=0 Jul 05 00:20:39.488966 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:39.488827 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj" event={"ID":"3c590c51-f636-4ed9-b10a-743e5eb1520a","Type":"ContainerDied","Data":"56c8631862dcba78aee25c024837395f0efc219c337159168af6235ba75be3eb"} Jul 05 00:20:39.488966 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:39.488879 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj" event={"ID":"3c590c51-f636-4ed9-b10a-743e5eb1520a","Type":"ContainerStarted","Data":"e62477da1e935c6eb130b10db2d25e411936b646b332da7a12aa857ff6040319"} Jul 05 00:20:39.522363 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:39.522333 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b358d47b-db93-4fa9-844b-b83ade106500-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs\" (UID: \"b358d47b-db93-4fa9-844b-b83ade106500\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs" Jul 05 00:20:39.522497 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:39.522384 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b358d47b-db93-4fa9-844b-b83ade106500-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs\" (UID: \"b358d47b-db93-4fa9-844b-b83ade106500\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs" Jul 05 00:20:39.522497 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:39.522414 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdt8f\" (UniqueName: \"kubernetes.io/projected/b358d47b-db93-4fa9-844b-b83ade106500-kube-api-access-xdt8f\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs\" (UID: \"b358d47b-db93-4fa9-844b-b83ade106500\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs" Jul 05 00:20:39.623809 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:39.623773 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b358d47b-db93-4fa9-844b-b83ade106500-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs\" (UID: \"b358d47b-db93-4fa9-844b-b83ade106500\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs" Jul 05 00:20:39.624180 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:39.623831 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b358d47b-db93-4fa9-844b-b83ade106500-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs\" (UID: \"b358d47b-db93-4fa9-844b-b83ade106500\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs" Jul 05 00:20:39.624180 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:39.623856 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdt8f\" (UniqueName: \"kubernetes.io/projected/b358d47b-db93-4fa9-844b-b83ade106500-kube-api-access-xdt8f\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs\" (UID: \"b358d47b-db93-4fa9-844b-b83ade106500\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs" Jul 05 00:20:39.624180 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:39.624125 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b358d47b-db93-4fa9-844b-b83ade106500-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs\" (UID: \"b358d47b-db93-4fa9-844b-b83ade106500\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs" Jul 05 00:20:39.624334 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:39.624222 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b358d47b-db93-4fa9-844b-b83ade106500-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs\" (UID: \"b358d47b-db93-4fa9-844b-b83ade106500\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs" Jul 05 00:20:39.633359 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:39.633336 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdt8f\" (UniqueName: \"kubernetes.io/projected/b358d47b-db93-4fa9-844b-b83ade106500-kube-api-access-xdt8f\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs\" (UID: \"b358d47b-db93-4fa9-844b-b83ade106500\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs" Jul 05 00:20:39.712518 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:39.712446 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs" Jul 05 00:20:39.842566 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:39.842541 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs"] Jul 05 00:20:39.844506 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:20:39.844479 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb358d47b_db93_4fa9_844b_b83ade106500.slice/crio-c4444d0ef0a0360825436d712dd6c3611d3ee6b406e87fe88b866f67fce69a48 WatchSource:0}: Error finding container c4444d0ef0a0360825436d712dd6c3611d3ee6b406e87fe88b866f67fce69a48: Status 404 returned error can't find the container with id c4444d0ef0a0360825436d712dd6c3611d3ee6b406e87fe88b866f67fce69a48 Jul 05 00:20:39.997949 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:39.997880 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4"] Jul 05 00:20:40.001629 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.001611 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4" Jul 05 00:20:40.009009 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.008982 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4"] Jul 05 00:20:40.128005 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.127969 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d5w4\" (UniqueName: \"kubernetes.io/projected/26d66d9c-8c24-4b63-9f0d-e524fcc5c96e-kube-api-access-8d5w4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4\" (UID: \"26d66d9c-8c24-4b63-9f0d-e524fcc5c96e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4" Jul 05 00:20:40.128063 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.128012 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26d66d9c-8c24-4b63-9f0d-e524fcc5c96e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4\" (UID: \"26d66d9c-8c24-4b63-9f0d-e524fcc5c96e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4" Jul 05 00:20:40.128104 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.128072 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26d66d9c-8c24-4b63-9f0d-e524fcc5c96e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4\" (UID: \"26d66d9c-8c24-4b63-9f0d-e524fcc5c96e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4" Jul 05 00:20:40.229393 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.229357 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d5w4\" (UniqueName: \"kubernetes.io/projected/26d66d9c-8c24-4b63-9f0d-e524fcc5c96e-kube-api-access-8d5w4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4\" (UID: \"26d66d9c-8c24-4b63-9f0d-e524fcc5c96e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4" Jul 05 00:20:40.229528 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.229414 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26d66d9c-8c24-4b63-9f0d-e524fcc5c96e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4\" (UID: \"26d66d9c-8c24-4b63-9f0d-e524fcc5c96e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4" Jul 05 00:20:40.229528 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.229453 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26d66d9c-8c24-4b63-9f0d-e524fcc5c96e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4\" (UID: \"26d66d9c-8c24-4b63-9f0d-e524fcc5c96e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4" Jul 05 00:20:40.235343 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.230137 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26d66d9c-8c24-4b63-9f0d-e524fcc5c96e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4\" (UID: \"26d66d9c-8c24-4b63-9f0d-e524fcc5c96e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4" Jul 05 00:20:40.235343 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.230313 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26d66d9c-8c24-4b63-9f0d-e524fcc5c96e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4\" (UID: \"26d66d9c-8c24-4b63-9f0d-e524fcc5c96e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4" Jul 05 00:20:40.239883 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.239861 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d5w4\" (UniqueName: \"kubernetes.io/projected/26d66d9c-8c24-4b63-9f0d-e524fcc5c96e-kube-api-access-8d5w4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4\" (UID: \"26d66d9c-8c24-4b63-9f0d-e524fcc5c96e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4" Jul 05 00:20:40.321042 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.320968 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4" Jul 05 00:20:40.398830 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.398780 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr"] Jul 05 00:20:40.403692 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.403671 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr" Jul 05 00:20:40.412504 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.412210 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr"] Jul 05 00:20:40.454596 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.454571 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4"] Jul 05 00:20:40.456866 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:20:40.456840 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26d66d9c_8c24_4b63_9f0d_e524fcc5c96e.slice/crio-626bc8cb0bf946ac80352ada23cadd32fe0f7d0fd69c852483e1ed03935922db WatchSource:0}: Error finding container 626bc8cb0bf946ac80352ada23cadd32fe0f7d0fd69c852483e1ed03935922db: Status 404 returned error can't find the container with id 626bc8cb0bf946ac80352ada23cadd32fe0f7d0fd69c852483e1ed03935922db Jul 05 00:20:40.496223 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.496196 2561 generic.go:356] "Generic (PLEG): container finished" podID="3c590c51-f636-4ed9-b10a-743e5eb1520a" containerID="3219891f54855d6f63bab96f9a84893514f2e638efebe2463e707f8e5001598e" exitCode=0 Jul 05 00:20:40.496316 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.496288 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj" event={"ID":"3c590c51-f636-4ed9-b10a-743e5eb1520a","Type":"ContainerDied","Data":"3219891f54855d6f63bab96f9a84893514f2e638efebe2463e707f8e5001598e"} Jul 05 00:20:40.497637 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.497608 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4" event={"ID":"26d66d9c-8c24-4b63-9f0d-e524fcc5c96e","Type":"ContainerStarted","Data":"626bc8cb0bf946ac80352ada23cadd32fe0f7d0fd69c852483e1ed03935922db"} Jul 05 00:20:40.499351 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.499328 2561 generic.go:356] "Generic (PLEG): container finished" podID="b358d47b-db93-4fa9-844b-b83ade106500" containerID="479c5de40ddc3a39d46cba650485d3ed3afdf0af7c675ecd9c369062b7e06f5c" exitCode=0 Jul 05 00:20:40.499491 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.499393 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs" event={"ID":"b358d47b-db93-4fa9-844b-b83ade106500","Type":"ContainerDied","Data":"479c5de40ddc3a39d46cba650485d3ed3afdf0af7c675ecd9c369062b7e06f5c"} Jul 05 00:20:40.499491 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.499429 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs" event={"ID":"b358d47b-db93-4fa9-844b-b83ade106500","Type":"ContainerStarted","Data":"c4444d0ef0a0360825436d712dd6c3611d3ee6b406e87fe88b866f67fce69a48"} Jul 05 00:20:40.531875 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.531845 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr\" (UID: \"2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr" Jul 05 00:20:40.531972 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.531958 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr\" (UID: \"2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr" Jul 05 00:20:40.532130 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.532112 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdjr6\" (UniqueName: \"kubernetes.io/projected/2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c-kube-api-access-cdjr6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr\" (UID: \"2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr" Jul 05 00:20:40.633266 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.633238 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdjr6\" (UniqueName: \"kubernetes.io/projected/2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c-kube-api-access-cdjr6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr\" (UID: \"2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr" Jul 05 00:20:40.633642 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.633281 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr\" (UID: \"2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr" Jul 05 00:20:40.633642 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.633320 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr\" (UID: \"2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr" Jul 05 00:20:40.633761 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.633738 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr\" (UID: \"2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr" Jul 05 00:20:40.633816 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.633754 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr\" (UID: \"2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr" Jul 05 00:20:40.641403 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.641380 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdjr6\" (UniqueName: \"kubernetes.io/projected/2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c-kube-api-access-cdjr6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr\" (UID: \"2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr" Jul 05 00:20:40.715534 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.715504 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr" Jul 05 00:20:40.849401 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:40.849376 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr"] Jul 05 00:20:40.850846 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:20:40.850824 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f6e6e3e_ff76_4737_99bd_6e2915e6cf9c.slice/crio-226090e59816bec880d6ae221ae55983abb29f17d2adb0aa9360a79c8ad0d4fa WatchSource:0}: Error finding container 226090e59816bec880d6ae221ae55983abb29f17d2adb0aa9360a79c8ad0d4fa: Status 404 returned error can't find the container with id 226090e59816bec880d6ae221ae55983abb29f17d2adb0aa9360a79c8ad0d4fa Jul 05 00:20:41.507296 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:41.507267 2561 generic.go:356] "Generic (PLEG): container finished" podID="3c590c51-f636-4ed9-b10a-743e5eb1520a" containerID="0f7e25715d31301d09b42cb61b8632023604376d9e872d0d28201e1432b61fd7" exitCode=0 Jul 05 00:20:41.507476 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:41.507347 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj" event={"ID":"3c590c51-f636-4ed9-b10a-743e5eb1520a","Type":"ContainerDied","Data":"0f7e25715d31301d09b42cb61b8632023604376d9e872d0d28201e1432b61fd7"} Jul 05 00:20:41.508703 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:41.508680 2561 generic.go:356] "Generic (PLEG): container finished" podID="26d66d9c-8c24-4b63-9f0d-e524fcc5c96e" containerID="2e2b9964bef9c4862b734e378d0121e10983b2e0ae5dadefb0f77d4ab8b7fb8a" exitCode=0 Jul 05 00:20:41.508823 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:41.508774 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4" event={"ID":"26d66d9c-8c24-4b63-9f0d-e524fcc5c96e","Type":"ContainerDied","Data":"2e2b9964bef9c4862b734e378d0121e10983b2e0ae5dadefb0f77d4ab8b7fb8a"} Jul 05 00:20:41.510184 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:41.510142 2561 generic.go:356] "Generic (PLEG): container finished" podID="2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c" containerID="8dee23eef323c5a77c0068a28c86c5a2a32533d630487b3f25cb75876fc121e8" exitCode=0 Jul 05 00:20:41.510304 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:41.510224 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr" event={"ID":"2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c","Type":"ContainerDied","Data":"8dee23eef323c5a77c0068a28c86c5a2a32533d630487b3f25cb75876fc121e8"} Jul 05 00:20:41.510304 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:41.510263 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr" event={"ID":"2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c","Type":"ContainerStarted","Data":"226090e59816bec880d6ae221ae55983abb29f17d2adb0aa9360a79c8ad0d4fa"} Jul 05 00:20:42.518470 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:42.518209 2561 generic.go:356] "Generic (PLEG): container finished" podID="b358d47b-db93-4fa9-844b-b83ade106500" containerID="08a9a90d1f7bdb72973c311773b41fcc9498afaf33885fa41999ee997655120c" exitCode=0 Jul 05 00:20:42.518470 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:42.518293 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs" event={"ID":"b358d47b-db93-4fa9-844b-b83ade106500","Type":"ContainerDied","Data":"08a9a90d1f7bdb72973c311773b41fcc9498afaf33885fa41999ee997655120c"} Jul 05 00:20:42.520403 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:42.520380 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr" event={"ID":"2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c","Type":"ContainerStarted","Data":"1a3e9661d47e3f53c8560a33c2f8545108ccc417928b1a6dfc8276984d868024"} Jul 05 00:20:42.522329 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:42.522309 2561 generic.go:356] "Generic (PLEG): container finished" podID="26d66d9c-8c24-4b63-9f0d-e524fcc5c96e" containerID="00f4358359a362244e0a5b4204b871df07e0507b700fd4210a21347c332bd7df" exitCode=0 Jul 05 00:20:42.522414 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:42.522364 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4" event={"ID":"26d66d9c-8c24-4b63-9f0d-e524fcc5c96e","Type":"ContainerDied","Data":"00f4358359a362244e0a5b4204b871df07e0507b700fd4210a21347c332bd7df"} Jul 05 00:20:42.662692 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:42.662569 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj" Jul 05 00:20:42.751343 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:42.751315 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dk7jt\" (UniqueName: \"kubernetes.io/projected/3c590c51-f636-4ed9-b10a-743e5eb1520a-kube-api-access-dk7jt\") pod \"3c590c51-f636-4ed9-b10a-743e5eb1520a\" (UID: \"3c590c51-f636-4ed9-b10a-743e5eb1520a\") " Jul 05 00:20:42.751509 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:42.751494 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c590c51-f636-4ed9-b10a-743e5eb1520a-bundle\") pod \"3c590c51-f636-4ed9-b10a-743e5eb1520a\" (UID: \"3c590c51-f636-4ed9-b10a-743e5eb1520a\") " Jul 05 00:20:42.751568 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:42.751546 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c590c51-f636-4ed9-b10a-743e5eb1520a-util\") pod \"3c590c51-f636-4ed9-b10a-743e5eb1520a\" (UID: \"3c590c51-f636-4ed9-b10a-743e5eb1520a\") " Jul 05 00:20:42.751945 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:42.751917 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c590c51-f636-4ed9-b10a-743e5eb1520a-bundle" (OuterVolumeSpecName: "bundle") pod "3c590c51-f636-4ed9-b10a-743e5eb1520a" (UID: "3c590c51-f636-4ed9-b10a-743e5eb1520a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:20:42.753219 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:42.753194 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c590c51-f636-4ed9-b10a-743e5eb1520a-kube-api-access-dk7jt" (OuterVolumeSpecName: "kube-api-access-dk7jt") pod "3c590c51-f636-4ed9-b10a-743e5eb1520a" (UID: "3c590c51-f636-4ed9-b10a-743e5eb1520a"). InnerVolumeSpecName "kube-api-access-dk7jt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:20:42.757019 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:42.756996 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c590c51-f636-4ed9-b10a-743e5eb1520a-util" (OuterVolumeSpecName: "util") pod "3c590c51-f636-4ed9-b10a-743e5eb1520a" (UID: "3c590c51-f636-4ed9-b10a-743e5eb1520a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:20:42.852710 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:42.852679 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c590c51-f636-4ed9-b10a-743e5eb1520a-bundle\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:20:42.852710 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:42.852708 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c590c51-f636-4ed9-b10a-743e5eb1520a-util\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:20:42.852870 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:42.852718 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dk7jt\" (UniqueName: \"kubernetes.io/projected/3c590c51-f636-4ed9-b10a-743e5eb1520a-kube-api-access-dk7jt\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:20:43.529980 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:43.529944 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj" Jul 05 00:20:43.530417 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:43.529939 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj" event={"ID":"3c590c51-f636-4ed9-b10a-743e5eb1520a","Type":"ContainerDied","Data":"e62477da1e935c6eb130b10db2d25e411936b646b332da7a12aa857ff6040319"} Jul 05 00:20:43.530417 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:43.530068 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e62477da1e935c6eb130b10db2d25e411936b646b332da7a12aa857ff6040319" Jul 05 00:20:43.532065 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:43.532040 2561 generic.go:356] "Generic (PLEG): container finished" podID="26d66d9c-8c24-4b63-9f0d-e524fcc5c96e" containerID="f20fdddaa18ee0ef28166553a88317dc07c6a78761619362dcd3ee96c4631314" exitCode=0 Jul 05 00:20:43.532173 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:43.532072 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4" event={"ID":"26d66d9c-8c24-4b63-9f0d-e524fcc5c96e","Type":"ContainerDied","Data":"f20fdddaa18ee0ef28166553a88317dc07c6a78761619362dcd3ee96c4631314"} Jul 05 00:20:43.533953 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:43.533928 2561 generic.go:356] "Generic (PLEG): container finished" podID="b358d47b-db93-4fa9-844b-b83ade106500" containerID="4200fc784c90d2ecc3d200735336c68be939d537296782c2062336781b553971" exitCode=0 Jul 05 00:20:43.534048 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:43.534006 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs" event={"ID":"b358d47b-db93-4fa9-844b-b83ade106500","Type":"ContainerDied","Data":"4200fc784c90d2ecc3d200735336c68be939d537296782c2062336781b553971"} Jul 05 00:20:43.535913 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:43.535892 2561 generic.go:356] "Generic (PLEG): container finished" podID="2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c" containerID="1a3e9661d47e3f53c8560a33c2f8545108ccc417928b1a6dfc8276984d868024" exitCode=0 Jul 05 00:20:43.535913 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:43.535910 2561 generic.go:356] "Generic (PLEG): container finished" podID="2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c" containerID="6965416ff6c3ad2617a3e623ac477fd44a2c6d565d26d347a946fb474d6bbe50" exitCode=0 Jul 05 00:20:43.536045 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:43.535969 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr" event={"ID":"2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c","Type":"ContainerDied","Data":"1a3e9661d47e3f53c8560a33c2f8545108ccc417928b1a6dfc8276984d868024"} Jul 05 00:20:43.536045 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:43.536004 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr" event={"ID":"2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c","Type":"ContainerDied","Data":"6965416ff6c3ad2617a3e623ac477fd44a2c6d565d26d347a946fb474d6bbe50"} Jul 05 00:20:44.710450 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.710428 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr" Jul 05 00:20:44.714369 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.714349 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs" Jul 05 00:20:44.750038 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.750015 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4" Jul 05 00:20:44.767667 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.767639 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c-util\") pod \"2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c\" (UID: \"2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c\") " Jul 05 00:20:44.767824 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.767685 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c-bundle\") pod \"2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c\" (UID: \"2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c\") " Jul 05 00:20:44.767824 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.767732 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdjr6\" (UniqueName: \"kubernetes.io/projected/2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c-kube-api-access-cdjr6\") pod \"2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c\" (UID: \"2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c\") " Jul 05 00:20:44.768321 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.768296 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c-bundle" (OuterVolumeSpecName: "bundle") pod "2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c" (UID: "2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:20:44.770127 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.770099 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c-kube-api-access-cdjr6" (OuterVolumeSpecName: "kube-api-access-cdjr6") pod "2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c" (UID: "2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c"). InnerVolumeSpecName "kube-api-access-cdjr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:20:44.775421 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.775395 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c-util" (OuterVolumeSpecName: "util") pod "2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c" (UID: "2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:20:44.868479 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.868453 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8d5w4\" (UniqueName: \"kubernetes.io/projected/26d66d9c-8c24-4b63-9f0d-e524fcc5c96e-kube-api-access-8d5w4\") pod \"26d66d9c-8c24-4b63-9f0d-e524fcc5c96e\" (UID: \"26d66d9c-8c24-4b63-9f0d-e524fcc5c96e\") " Jul 05 00:20:44.868639 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.868501 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b358d47b-db93-4fa9-844b-b83ade106500-util\") pod \"b358d47b-db93-4fa9-844b-b83ade106500\" (UID: \"b358d47b-db93-4fa9-844b-b83ade106500\") " Jul 05 00:20:44.868639 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.868531 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b358d47b-db93-4fa9-844b-b83ade106500-bundle\") pod \"b358d47b-db93-4fa9-844b-b83ade106500\" (UID: \"b358d47b-db93-4fa9-844b-b83ade106500\") " Jul 05 00:20:44.868639 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.868550 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26d66d9c-8c24-4b63-9f0d-e524fcc5c96e-bundle\") pod \"26d66d9c-8c24-4b63-9f0d-e524fcc5c96e\" (UID: \"26d66d9c-8c24-4b63-9f0d-e524fcc5c96e\") " Jul 05 00:20:44.868639 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.868596 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdt8f\" (UniqueName: \"kubernetes.io/projected/b358d47b-db93-4fa9-844b-b83ade106500-kube-api-access-xdt8f\") pod \"b358d47b-db93-4fa9-844b-b83ade106500\" (UID: \"b358d47b-db93-4fa9-844b-b83ade106500\") " Jul 05 00:20:44.868782 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.868670 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26d66d9c-8c24-4b63-9f0d-e524fcc5c96e-util\") pod \"26d66d9c-8c24-4b63-9f0d-e524fcc5c96e\" (UID: \"26d66d9c-8c24-4b63-9f0d-e524fcc5c96e\") " Jul 05 00:20:44.869034 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.868965 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c-util\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:20:44.869034 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.868991 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c-bundle\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:20:44.869034 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.869004 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdjr6\" (UniqueName: \"kubernetes.io/projected/2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c-kube-api-access-cdjr6\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:20:44.869264 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.869081 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b358d47b-db93-4fa9-844b-b83ade106500-bundle" (OuterVolumeSpecName: "bundle") pod "b358d47b-db93-4fa9-844b-b83ade106500" (UID: "b358d47b-db93-4fa9-844b-b83ade106500"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:20:44.869393 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.869360 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26d66d9c-8c24-4b63-9f0d-e524fcc5c96e-bundle" (OuterVolumeSpecName: "bundle") pod "26d66d9c-8c24-4b63-9f0d-e524fcc5c96e" (UID: "26d66d9c-8c24-4b63-9f0d-e524fcc5c96e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:20:44.870693 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.870668 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b358d47b-db93-4fa9-844b-b83ade106500-kube-api-access-xdt8f" (OuterVolumeSpecName: "kube-api-access-xdt8f") pod "b358d47b-db93-4fa9-844b-b83ade106500" (UID: "b358d47b-db93-4fa9-844b-b83ade106500"). InnerVolumeSpecName "kube-api-access-xdt8f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:20:44.870945 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.870926 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26d66d9c-8c24-4b63-9f0d-e524fcc5c96e-kube-api-access-8d5w4" (OuterVolumeSpecName: "kube-api-access-8d5w4") pod "26d66d9c-8c24-4b63-9f0d-e524fcc5c96e" (UID: "26d66d9c-8c24-4b63-9f0d-e524fcc5c96e"). InnerVolumeSpecName "kube-api-access-8d5w4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:20:44.874373 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.874341 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b358d47b-db93-4fa9-844b-b83ade106500-util" (OuterVolumeSpecName: "util") pod "b358d47b-db93-4fa9-844b-b83ade106500" (UID: "b358d47b-db93-4fa9-844b-b83ade106500"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:20:44.875231 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.875205 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26d66d9c-8c24-4b63-9f0d-e524fcc5c96e-util" (OuterVolumeSpecName: "util") pod "26d66d9c-8c24-4b63-9f0d-e524fcc5c96e" (UID: "26d66d9c-8c24-4b63-9f0d-e524fcc5c96e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:20:44.969984 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.969937 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdt8f\" (UniqueName: \"kubernetes.io/projected/b358d47b-db93-4fa9-844b-b83ade106500-kube-api-access-xdt8f\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:20:44.969984 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.969980 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26d66d9c-8c24-4b63-9f0d-e524fcc5c96e-util\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:20:44.969984 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.969991 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8d5w4\" (UniqueName: \"kubernetes.io/projected/26d66d9c-8c24-4b63-9f0d-e524fcc5c96e-kube-api-access-8d5w4\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:20:44.969984 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.970000 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b358d47b-db93-4fa9-844b-b83ade106500-util\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:20:44.970199 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.970009 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b358d47b-db93-4fa9-844b-b83ade106500-bundle\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:20:44.970199 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:44.970017 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26d66d9c-8c24-4b63-9f0d-e524fcc5c96e-bundle\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:20:45.548248 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:45.548214 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4" Jul 05 00:20:45.548248 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:45.548228 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4" event={"ID":"26d66d9c-8c24-4b63-9f0d-e524fcc5c96e","Type":"ContainerDied","Data":"626bc8cb0bf946ac80352ada23cadd32fe0f7d0fd69c852483e1ed03935922db"} Jul 05 00:20:45.548513 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:45.548271 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="626bc8cb0bf946ac80352ada23cadd32fe0f7d0fd69c852483e1ed03935922db" Jul 05 00:20:45.550010 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:45.549989 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs" Jul 05 00:20:45.550139 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:45.549985 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs" event={"ID":"b358d47b-db93-4fa9-844b-b83ade106500","Type":"ContainerDied","Data":"c4444d0ef0a0360825436d712dd6c3611d3ee6b406e87fe88b866f67fce69a48"} Jul 05 00:20:45.550139 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:45.550107 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4444d0ef0a0360825436d712dd6c3611d3ee6b406e87fe88b866f67fce69a48" Jul 05 00:20:45.551957 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:45.551933 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr" event={"ID":"2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c","Type":"ContainerDied","Data":"226090e59816bec880d6ae221ae55983abb29f17d2adb0aa9360a79c8ad0d4fa"} Jul 05 00:20:45.552029 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:45.551974 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="226090e59816bec880d6ae221ae55983abb29f17d2adb0aa9360a79c8ad0d4fa" Jul 05 00:20:45.552029 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:45.551944 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr" Jul 05 00:20:46.722075 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:46.722038 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:46.722502 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:46.722119 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:46.726768 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:46.726745 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:47.571659 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:47.571629 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59fd6474c-7kvkh" Jul 05 00:20:47.615607 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:47.615572 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5549d89b84-94fwt"] Jul 05 00:20:55.731926 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.731892 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8zz99"] Jul 05 00:20:55.732291 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732239 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c590c51-f636-4ed9-b10a-743e5eb1520a" containerName="pull" Jul 05 00:20:55.732291 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732250 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c590c51-f636-4ed9-b10a-743e5eb1520a" containerName="pull" Jul 05 00:20:55.732291 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732260 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b358d47b-db93-4fa9-844b-b83ade106500" containerName="extract" Jul 05 00:20:55.732291 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732266 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b358d47b-db93-4fa9-844b-b83ade106500" containerName="extract" Jul 05 00:20:55.732291 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732275 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b358d47b-db93-4fa9-844b-b83ade106500" containerName="util" Jul 05 00:20:55.732291 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732280 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b358d47b-db93-4fa9-844b-b83ade106500" containerName="util" Jul 05 00:20:55.732291 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732287 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c590c51-f636-4ed9-b10a-743e5eb1520a" containerName="extract" Jul 05 00:20:55.732291 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732293 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c590c51-f636-4ed9-b10a-743e5eb1520a" containerName="extract" Jul 05 00:20:55.732564 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732300 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c" containerName="pull" Jul 05 00:20:55.732564 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732305 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c" containerName="pull" Jul 05 00:20:55.732564 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732311 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c" containerName="extract" Jul 05 00:20:55.732564 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732316 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c" containerName="extract" Jul 05 00:20:55.732564 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732325 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b358d47b-db93-4fa9-844b-b83ade106500" containerName="pull" Jul 05 00:20:55.732564 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732330 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b358d47b-db93-4fa9-844b-b83ade106500" containerName="pull" Jul 05 00:20:55.732564 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732336 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c590c51-f636-4ed9-b10a-743e5eb1520a" containerName="util" Jul 05 00:20:55.732564 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732342 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c590c51-f636-4ed9-b10a-743e5eb1520a" containerName="util" Jul 05 00:20:55.732564 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732352 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26d66d9c-8c24-4b63-9f0d-e524fcc5c96e" containerName="util" Jul 05 00:20:55.732564 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732357 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="26d66d9c-8c24-4b63-9f0d-e524fcc5c96e" containerName="util" Jul 05 00:20:55.732564 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732365 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26d66d9c-8c24-4b63-9f0d-e524fcc5c96e" containerName="extract" Jul 05 00:20:55.732564 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732370 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="26d66d9c-8c24-4b63-9f0d-e524fcc5c96e" containerName="extract" Jul 05 00:20:55.732564 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732377 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c" containerName="util" Jul 05 00:20:55.732564 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732382 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c" containerName="util" Jul 05 00:20:55.732564 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732389 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26d66d9c-8c24-4b63-9f0d-e524fcc5c96e" containerName="pull" Jul 05 00:20:55.732564 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732394 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="26d66d9c-8c24-4b63-9f0d-e524fcc5c96e" containerName="pull" Jul 05 00:20:55.732564 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732458 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b358d47b-db93-4fa9-844b-b83ade106500" containerName="extract" Jul 05 00:20:55.732564 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732469 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c" containerName="extract" Jul 05 00:20:55.732564 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732478 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="26d66d9c-8c24-4b63-9f0d-e524fcc5c96e" containerName="extract" Jul 05 00:20:55.732564 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.732484 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c590c51-f636-4ed9-b10a-743e5eb1520a" containerName="extract" Jul 05 00:20:55.736674 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.736657 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8zz99" Jul 05 00:20:55.739704 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.739684 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-w5r5v\"" Jul 05 00:20:55.746728 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.746702 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8zz99"] Jul 05 00:20:55.857395 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.857367 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8cjs\" (UniqueName: \"kubernetes.io/projected/a1e725b6-9155-4f8f-984c-de8d10153671-kube-api-access-n8cjs\") pod \"authorino-operator-75cc8d5cb7-8zz99\" (UID: \"a1e725b6-9155-4f8f-984c-de8d10153671\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8zz99" Jul 05 00:20:55.958540 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.958512 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8cjs\" (UniqueName: \"kubernetes.io/projected/a1e725b6-9155-4f8f-984c-de8d10153671-kube-api-access-n8cjs\") pod \"authorino-operator-75cc8d5cb7-8zz99\" (UID: \"a1e725b6-9155-4f8f-984c-de8d10153671\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8zz99" Jul 05 00:20:55.966219 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:55.966200 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8cjs\" (UniqueName: \"kubernetes.io/projected/a1e725b6-9155-4f8f-984c-de8d10153671-kube-api-access-n8cjs\") pod \"authorino-operator-75cc8d5cb7-8zz99\" (UID: \"a1e725b6-9155-4f8f-984c-de8d10153671\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8zz99" Jul 05 00:20:56.047323 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:56.047258 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8zz99" Jul 05 00:20:56.177814 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:56.177767 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8zz99"] Jul 05 00:20:56.180979 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:20:56.180947 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e725b6_9155_4f8f_984c_de8d10153671.slice/crio-185a5d62ef36ad1430e42bcce55b166102448acee1b250553ccbc55aa0f55072 WatchSource:0}: Error finding container 185a5d62ef36ad1430e42bcce55b166102448acee1b250553ccbc55aa0f55072: Status 404 returned error can't find the container with id 185a5d62ef36ad1430e42bcce55b166102448acee1b250553ccbc55aa0f55072 Jul 05 00:20:56.615767 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:56.615730 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8zz99" event={"ID":"a1e725b6-9155-4f8f-984c-de8d10153671","Type":"ContainerStarted","Data":"185a5d62ef36ad1430e42bcce55b166102448acee1b250553ccbc55aa0f55072"} Jul 05 00:20:59.633235 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:59.633196 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8zz99" event={"ID":"a1e725b6-9155-4f8f-984c-de8d10153671","Type":"ContainerStarted","Data":"654df77d5b172403318b76a014f8307edfbd3c944f8162793aa0f169e2fa1df6"} Jul 05 00:20:59.633680 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:59.633278 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8zz99" Jul 05 00:20:59.658300 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:20:59.658247 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8zz99" podStartSLOduration=2.21242799 podStartE2EDuration="4.658234084s" totalImagesPullingTime="2.445806094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:20:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:20:59.656833914 +0000 UTC m=+730.381849973" watchObservedRunningTime="2026-07-05 00:20:59.658234084 +0000 UTC m=+730.383250142" Jul 05 00:21:02.491528 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:02.491485 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc"] Jul 05 00:21:02.498281 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:02.498258 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc" Jul 05 00:21:02.501211 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:02.501178 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-56rtb\"" Jul 05 00:21:02.507233 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:02.507205 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc"] Jul 05 00:21:02.618704 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:02.618682 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hvl8\" (UniqueName: \"kubernetes.io/projected/2a657556-f0f5-4dea-980d-ff2035699a62-kube-api-access-8hvl8\") pod \"limitador-operator-controller-manager-859d7b78bd-4w5fc\" (UID: \"2a657556-f0f5-4dea-980d-ff2035699a62\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc" Jul 05 00:21:02.719978 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:02.719954 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hvl8\" (UniqueName: \"kubernetes.io/projected/2a657556-f0f5-4dea-980d-ff2035699a62-kube-api-access-8hvl8\") pod \"limitador-operator-controller-manager-859d7b78bd-4w5fc\" (UID: \"2a657556-f0f5-4dea-980d-ff2035699a62\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc" Jul 05 00:21:02.727687 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:02.727665 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hvl8\" (UniqueName: \"kubernetes.io/projected/2a657556-f0f5-4dea-980d-ff2035699a62-kube-api-access-8hvl8\") pod \"limitador-operator-controller-manager-859d7b78bd-4w5fc\" (UID: \"2a657556-f0f5-4dea-980d-ff2035699a62\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc" Jul 05 00:21:02.808630 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:02.808570 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc" Jul 05 00:21:02.942292 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:02.942266 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc"] Jul 05 00:21:02.943729 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:21:02.943702 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a657556_f0f5_4dea_980d_ff2035699a62.slice/crio-0f7b1b9a3e5d471745fa7c113c14df4f5aa54cf8e363d13ade94e1b0a161e3cb WatchSource:0}: Error finding container 0f7b1b9a3e5d471745fa7c113c14df4f5aa54cf8e363d13ade94e1b0a161e3cb: Status 404 returned error can't find the container with id 0f7b1b9a3e5d471745fa7c113c14df4f5aa54cf8e363d13ade94e1b0a161e3cb Jul 05 00:21:03.661568 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:03.661521 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc" event={"ID":"2a657556-f0f5-4dea-980d-ff2035699a62","Type":"ContainerStarted","Data":"0f7b1b9a3e5d471745fa7c113c14df4f5aa54cf8e363d13ade94e1b0a161e3cb"} Jul 05 00:21:05.673955 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:05.673917 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc" event={"ID":"2a657556-f0f5-4dea-980d-ff2035699a62","Type":"ContainerStarted","Data":"f7db0703037f52b325df462c89adebdee259e9d810bd0460ed5303bd9c0aa98f"} Jul 05 00:21:05.674377 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:05.674056 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc" Jul 05 00:21:05.689790 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:05.689732 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc" podStartSLOduration=1.8951100840000001 podStartE2EDuration="3.68971909s" totalImagesPullingTime="1.794609006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:21:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:21:05.689406913 +0000 UTC m=+736.414422974" watchObservedRunningTime="2026-07-05 00:21:05.68971909 +0000 UTC m=+736.414735149" Jul 05 00:21:10.641087 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:10.641055 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8zz99" Jul 05 00:21:12.643092 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:12.643053 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5549d89b84-94fwt" podUID="e2d2627a-53f8-4e91-ad0e-f34fa54d1792" containerName="console" containerID="cri-o://1753a5ac09f1da3fea3f2949a3182de2ae79c621e8f17c7881d6ecf7ecd67404" gracePeriod=15 Jul 05 00:21:12.890885 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:12.890861 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:21:13.010622 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.010556 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-console-oauth-config\") pod \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " Jul 05 00:21:13.010622 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.010598 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5n22z\" (UniqueName: \"kubernetes.io/projected/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-kube-api-access-5n22z\") pod \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " Jul 05 00:21:13.010847 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.010631 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-trusted-ca-bundle\") pod \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " Jul 05 00:21:13.010847 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.010651 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-oauth-serving-cert\") pod \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " Jul 05 00:21:13.010847 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.010680 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-service-ca\") pod \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " Jul 05 00:21:13.010847 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.010704 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-console-serving-cert\") pod \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " Jul 05 00:21:13.010847 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.010744 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-console-config\") pod \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\" (UID: \"e2d2627a-53f8-4e91-ad0e-f34fa54d1792\") " Jul 05 00:21:13.011231 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.011201 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e2d2627a-53f8-4e91-ad0e-f34fa54d1792" (UID: "e2d2627a-53f8-4e91-ad0e-f34fa54d1792"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:21:13.011231 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.011214 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-service-ca" (OuterVolumeSpecName: "service-ca") pod "e2d2627a-53f8-4e91-ad0e-f34fa54d1792" (UID: "e2d2627a-53f8-4e91-ad0e-f34fa54d1792"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:21:13.011364 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.011266 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-console-config" (OuterVolumeSpecName: "console-config") pod "e2d2627a-53f8-4e91-ad0e-f34fa54d1792" (UID: "e2d2627a-53f8-4e91-ad0e-f34fa54d1792"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:21:13.011423 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.011381 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e2d2627a-53f8-4e91-ad0e-f34fa54d1792" (UID: "e2d2627a-53f8-4e91-ad0e-f34fa54d1792"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:21:13.012820 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.012780 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e2d2627a-53f8-4e91-ad0e-f34fa54d1792" (UID: "e2d2627a-53f8-4e91-ad0e-f34fa54d1792"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 00:21:13.012937 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.012817 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e2d2627a-53f8-4e91-ad0e-f34fa54d1792" (UID: "e2d2627a-53f8-4e91-ad0e-f34fa54d1792"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 00:21:13.012937 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.012925 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-kube-api-access-5n22z" (OuterVolumeSpecName: "kube-api-access-5n22z") pod "e2d2627a-53f8-4e91-ad0e-f34fa54d1792" (UID: "e2d2627a-53f8-4e91-ad0e-f34fa54d1792"). InnerVolumeSpecName "kube-api-access-5n22z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:21:13.111497 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.111473 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-console-oauth-config\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:21:13.111497 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.111495 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5n22z\" (UniqueName: \"kubernetes.io/projected/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-kube-api-access-5n22z\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:21:13.111631 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.111505 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-trusted-ca-bundle\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:21:13.111631 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.111513 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-oauth-serving-cert\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:21:13.111631 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.111522 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-service-ca\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:21:13.111631 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.111530 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-console-serving-cert\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:21:13.111631 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.111537 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2d2627a-53f8-4e91-ad0e-f34fa54d1792-console-config\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:21:13.730635 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.730604 2561 generic.go:356] "Generic (PLEG): container finished" podID="e2d2627a-53f8-4e91-ad0e-f34fa54d1792" containerID="1753a5ac09f1da3fea3f2949a3182de2ae79c621e8f17c7881d6ecf7ecd67404" exitCode=0 Jul 05 00:21:13.731112 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.730657 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5549d89b84-94fwt" Jul 05 00:21:13.731112 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.730695 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5549d89b84-94fwt" event={"ID":"e2d2627a-53f8-4e91-ad0e-f34fa54d1792","Type":"ContainerDied","Data":"1753a5ac09f1da3fea3f2949a3182de2ae79c621e8f17c7881d6ecf7ecd67404"} Jul 05 00:21:13.731112 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.730777 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5549d89b84-94fwt" event={"ID":"e2d2627a-53f8-4e91-ad0e-f34fa54d1792","Type":"ContainerDied","Data":"84bba0991c053b1eac241f71e6079a5fdd1a718bc39d0c349bbdafd555f49aac"} Jul 05 00:21:13.731112 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.730829 2561 scope.go:117] "RemoveContainer" containerID="1753a5ac09f1da3fea3f2949a3182de2ae79c621e8f17c7881d6ecf7ecd67404" Jul 05 00:21:13.740780 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.740767 2561 scope.go:117] "RemoveContainer" containerID="1753a5ac09f1da3fea3f2949a3182de2ae79c621e8f17c7881d6ecf7ecd67404" Jul 05 00:21:13.741036 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:21:13.741017 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1753a5ac09f1da3fea3f2949a3182de2ae79c621e8f17c7881d6ecf7ecd67404\": container with ID starting with 1753a5ac09f1da3fea3f2949a3182de2ae79c621e8f17c7881d6ecf7ecd67404 not found: ID does not exist" containerID="1753a5ac09f1da3fea3f2949a3182de2ae79c621e8f17c7881d6ecf7ecd67404" Jul 05 00:21:13.741102 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.741048 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1753a5ac09f1da3fea3f2949a3182de2ae79c621e8f17c7881d6ecf7ecd67404"} err="failed to get container status \"1753a5ac09f1da3fea3f2949a3182de2ae79c621e8f17c7881d6ecf7ecd67404\": rpc error: code = NotFound desc = could not find container \"1753a5ac09f1da3fea3f2949a3182de2ae79c621e8f17c7881d6ecf7ecd67404\": container with ID starting with 1753a5ac09f1da3fea3f2949a3182de2ae79c621e8f17c7881d6ecf7ecd67404 not found: ID does not exist" Jul 05 00:21:13.755136 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.755115 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5549d89b84-94fwt"] Jul 05 00:21:13.760790 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.760768 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5549d89b84-94fwt"] Jul 05 00:21:13.776549 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:13.776526 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2d2627a-53f8-4e91-ad0e-f34fa54d1792" path="/var/lib/kubelet/pods/e2d2627a-53f8-4e91-ad0e-f34fa54d1792/volumes" Jul 05 00:21:16.665368 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:16.665332 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-twztc"] Jul 05 00:21:16.665716 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:16.665698 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2d2627a-53f8-4e91-ad0e-f34fa54d1792" containerName="console" Jul 05 00:21:16.665716 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:16.665710 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2d2627a-53f8-4e91-ad0e-f34fa54d1792" containerName="console" Jul 05 00:21:16.665787 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:16.665778 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2d2627a-53f8-4e91-ad0e-f34fa54d1792" containerName="console" Jul 05 00:21:16.668771 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:16.668751 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-twztc" Jul 05 00:21:16.671140 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:16.671120 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 05 00:21:16.671553 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:16.671534 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j8vgb\"" Jul 05 00:21:16.671618 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:16.671584 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 05 00:21:16.675439 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:16.675417 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-twztc"] Jul 05 00:21:16.682300 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:16.682280 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc" Jul 05 00:21:16.740003 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:16.739973 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cdd498e3-5e18-4f1a-b097-eb5ced1f035a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-twztc\" (UID: \"cdd498e3-5e18-4f1a-b097-eb5ced1f035a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-twztc" Jul 05 00:21:16.740177 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:16.740051 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghsjw\" (UniqueName: \"kubernetes.io/projected/cdd498e3-5e18-4f1a-b097-eb5ced1f035a-kube-api-access-ghsjw\") pod \"kuadrant-console-plugin-66b5774985-twztc\" (UID: \"cdd498e3-5e18-4f1a-b097-eb5ced1f035a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-twztc" Jul 05 00:21:16.740177 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:16.740155 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdd498e3-5e18-4f1a-b097-eb5ced1f035a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-twztc\" (UID: \"cdd498e3-5e18-4f1a-b097-eb5ced1f035a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-twztc" Jul 05 00:21:16.841509 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:16.841474 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghsjw\" (UniqueName: \"kubernetes.io/projected/cdd498e3-5e18-4f1a-b097-eb5ced1f035a-kube-api-access-ghsjw\") pod \"kuadrant-console-plugin-66b5774985-twztc\" (UID: \"cdd498e3-5e18-4f1a-b097-eb5ced1f035a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-twztc" Jul 05 00:21:16.841693 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:16.841532 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdd498e3-5e18-4f1a-b097-eb5ced1f035a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-twztc\" (UID: \"cdd498e3-5e18-4f1a-b097-eb5ced1f035a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-twztc" Jul 05 00:21:16.841693 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:16.841589 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cdd498e3-5e18-4f1a-b097-eb5ced1f035a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-twztc\" (UID: \"cdd498e3-5e18-4f1a-b097-eb5ced1f035a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-twztc" Jul 05 00:21:16.841693 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:21:16.841630 2561 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 05 00:21:16.841693 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:21:16.841693 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdd498e3-5e18-4f1a-b097-eb5ced1f035a-plugin-serving-cert podName:cdd498e3-5e18-4f1a-b097-eb5ced1f035a nodeName:}" failed. No retries permitted until 2026-07-05 00:21:17.341677044 +0000 UTC m=+748.066693089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/cdd498e3-5e18-4f1a-b097-eb5ced1f035a-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-twztc" (UID: "cdd498e3-5e18-4f1a-b097-eb5ced1f035a") : secret "plugin-serving-cert" not found Jul 05 00:21:16.842245 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:16.842227 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cdd498e3-5e18-4f1a-b097-eb5ced1f035a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-twztc\" (UID: \"cdd498e3-5e18-4f1a-b097-eb5ced1f035a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-twztc" Jul 05 00:21:16.849602 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:16.849579 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghsjw\" (UniqueName: \"kubernetes.io/projected/cdd498e3-5e18-4f1a-b097-eb5ced1f035a-kube-api-access-ghsjw\") pod \"kuadrant-console-plugin-66b5774985-twztc\" (UID: \"cdd498e3-5e18-4f1a-b097-eb5ced1f035a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-twztc" Jul 05 00:21:17.345478 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:17.345440 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdd498e3-5e18-4f1a-b097-eb5ced1f035a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-twztc\" (UID: \"cdd498e3-5e18-4f1a-b097-eb5ced1f035a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-twztc" Jul 05 00:21:17.347840 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:17.347819 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdd498e3-5e18-4f1a-b097-eb5ced1f035a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-twztc\" (UID: \"cdd498e3-5e18-4f1a-b097-eb5ced1f035a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-twztc" Jul 05 00:21:17.578946 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:17.578916 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-twztc" Jul 05 00:21:17.704634 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:17.704605 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-twztc"] Jul 05 00:21:17.705827 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:21:17.705775 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcdd498e3_5e18_4f1a_b097_eb5ced1f035a.slice/crio-cb475bb43eaa1f1109fc88c4a97dc98436f4767463f81a3bc1270c47ad6e31a9 WatchSource:0}: Error finding container cb475bb43eaa1f1109fc88c4a97dc98436f4767463f81a3bc1270c47ad6e31a9: Status 404 returned error can't find the container with id cb475bb43eaa1f1109fc88c4a97dc98436f4767463f81a3bc1270c47ad6e31a9 Jul 05 00:21:17.753262 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:17.753234 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-twztc" event={"ID":"cdd498e3-5e18-4f1a-b097-eb5ced1f035a","Type":"ContainerStarted","Data":"cb475bb43eaa1f1109fc88c4a97dc98436f4767463f81a3bc1270c47ad6e31a9"} Jul 05 00:21:27.574089 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:27.574059 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc"] Jul 05 00:21:27.574540 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:27.574409 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc" podUID="2a657556-f0f5-4dea-980d-ff2035699a62" containerName="manager" containerID="cri-o://f7db0703037f52b325df462c89adebdee259e9d810bd0460ed5303bd9c0aa98f" gracePeriod=2 Jul 05 00:21:27.584338 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:27.584308 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc"] Jul 05 00:21:27.602285 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:27.602074 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gzbjl"] Jul 05 00:21:27.602824 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:27.602787 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a657556-f0f5-4dea-980d-ff2035699a62" containerName="manager" Jul 05 00:21:27.602980 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:27.602949 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a657556-f0f5-4dea-980d-ff2035699a62" containerName="manager" Jul 05 00:21:27.603097 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:27.603082 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a657556-f0f5-4dea-980d-ff2035699a62" containerName="manager" Jul 05 00:21:27.615463 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:27.615071 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gzbjl" Jul 05 00:21:27.616533 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:27.616466 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gzbjl"] Jul 05 00:21:27.634301 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:21:27.634265 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4w5fc\" is forbidden: User \"system:node:ip-10-0-142-188.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-188.ec2.internal' and this object" podUID="2a657556-f0f5-4dea-980d-ff2035699a62" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc" Jul 05 00:21:27.754135 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:27.754099 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nl66\" (UniqueName: \"kubernetes.io/projected/fcc333ae-1d94-4bab-96aa-9f54e66bf955-kube-api-access-5nl66\") pod \"limitador-operator-controller-manager-859d7b78bd-gzbjl\" (UID: \"fcc333ae-1d94-4bab-96aa-9f54e66bf955\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gzbjl" Jul 05 00:21:27.855180 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:27.855093 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nl66\" (UniqueName: \"kubernetes.io/projected/fcc333ae-1d94-4bab-96aa-9f54e66bf955-kube-api-access-5nl66\") pod \"limitador-operator-controller-manager-859d7b78bd-gzbjl\" (UID: \"fcc333ae-1d94-4bab-96aa-9f54e66bf955\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gzbjl" Jul 05 00:21:27.863861 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:27.863834 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nl66\" (UniqueName: \"kubernetes.io/projected/fcc333ae-1d94-4bab-96aa-9f54e66bf955-kube-api-access-5nl66\") pod \"limitador-operator-controller-manager-859d7b78bd-gzbjl\" (UID: \"fcc333ae-1d94-4bab-96aa-9f54e66bf955\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gzbjl" Jul 05 00:21:27.979004 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:27.978959 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gzbjl" Jul 05 00:21:39.189413 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:39.189391 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gzbjl"] Jul 05 00:21:39.190165 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:39.190143 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc" Jul 05 00:21:39.192421 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:21:39.192395 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4w5fc\" is forbidden: User \"system:node:ip-10-0-142-188.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-188.ec2.internal' and this object" podUID="2a657556-f0f5-4dea-980d-ff2035699a62" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc" Jul 05 00:21:39.200814 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:21:39.200771 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcc333ae_1d94_4bab_96aa_9f54e66bf955.slice/crio-0079e64fb1a2ca5d41d544714495d0d03374e9f242f1de7066cec63b8304715d WatchSource:0}: Error finding container 0079e64fb1a2ca5d41d544714495d0d03374e9f242f1de7066cec63b8304715d: Status 404 returned error can't find the container with id 0079e64fb1a2ca5d41d544714495d0d03374e9f242f1de7066cec63b8304715d Jul 05 00:21:39.361698 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:39.361672 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hvl8\" (UniqueName: \"kubernetes.io/projected/2a657556-f0f5-4dea-980d-ff2035699a62-kube-api-access-8hvl8\") pod \"2a657556-f0f5-4dea-980d-ff2035699a62\" (UID: \"2a657556-f0f5-4dea-980d-ff2035699a62\") " Jul 05 00:21:39.363723 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:39.363699 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a657556-f0f5-4dea-980d-ff2035699a62-kube-api-access-8hvl8" (OuterVolumeSpecName: "kube-api-access-8hvl8") pod "2a657556-f0f5-4dea-980d-ff2035699a62" (UID: "2a657556-f0f5-4dea-980d-ff2035699a62"). InnerVolumeSpecName "kube-api-access-8hvl8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:21:39.462226 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:39.462202 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hvl8\" (UniqueName: \"kubernetes.io/projected/2a657556-f0f5-4dea-980d-ff2035699a62-kube-api-access-8hvl8\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:21:39.776001 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:21:39.775918 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4w5fc\" is forbidden: User \"system:node:ip-10-0-142-188.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-188.ec2.internal' and this object" podUID="2a657556-f0f5-4dea-980d-ff2035699a62" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc" Jul 05 00:21:39.777413 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:39.777388 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a657556-f0f5-4dea-980d-ff2035699a62" path="/var/lib/kubelet/pods/2a657556-f0f5-4dea-980d-ff2035699a62/volumes" Jul 05 00:21:39.893246 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:39.893214 2561 generic.go:356] "Generic (PLEG): container finished" podID="2a657556-f0f5-4dea-980d-ff2035699a62" containerID="f7db0703037f52b325df462c89adebdee259e9d810bd0460ed5303bd9c0aa98f" exitCode=0 Jul 05 00:21:39.893383 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:39.893263 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc" Jul 05 00:21:39.893383 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:39.893297 2561 scope.go:117] "RemoveContainer" containerID="f7db0703037f52b325df462c89adebdee259e9d810bd0460ed5303bd9c0aa98f" Jul 05 00:21:39.894965 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:39.894937 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-twztc" event={"ID":"cdd498e3-5e18-4f1a-b097-eb5ced1f035a","Type":"ContainerStarted","Data":"6b9deebc12d433ca2aff0b585d363cd2d4f7070632d54d4736e77e2b5bb50c42"} Jul 05 00:21:39.895853 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:21:39.895815 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4w5fc\" is forbidden: User \"system:node:ip-10-0-142-188.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-188.ec2.internal' and this object" podUID="2a657556-f0f5-4dea-980d-ff2035699a62" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc" Jul 05 00:21:39.896674 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:39.896651 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gzbjl" event={"ID":"fcc333ae-1d94-4bab-96aa-9f54e66bf955","Type":"ContainerStarted","Data":"bdfe5a2608a7d8009cff6b82d22882316918bde29cc207dc35c662189616e1c1"} Jul 05 00:21:39.896754 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:39.896695 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gzbjl" event={"ID":"fcc333ae-1d94-4bab-96aa-9f54e66bf955","Type":"ContainerStarted","Data":"0079e64fb1a2ca5d41d544714495d0d03374e9f242f1de7066cec63b8304715d"} Jul 05 00:21:39.896837 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:39.896818 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gzbjl" Jul 05 00:21:39.897839 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:21:39.897790 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4w5fc\" is forbidden: User \"system:node:ip-10-0-142-188.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-188.ec2.internal' and this object" podUID="2a657556-f0f5-4dea-980d-ff2035699a62" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc" Jul 05 00:21:39.902823 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:39.902710 2561 scope.go:117] "RemoveContainer" containerID="f7db0703037f52b325df462c89adebdee259e9d810bd0460ed5303bd9c0aa98f" Jul 05 00:21:39.903012 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:21:39.902989 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7db0703037f52b325df462c89adebdee259e9d810bd0460ed5303bd9c0aa98f\": container with ID starting with f7db0703037f52b325df462c89adebdee259e9d810bd0460ed5303bd9c0aa98f not found: ID does not exist" containerID="f7db0703037f52b325df462c89adebdee259e9d810bd0460ed5303bd9c0aa98f" Jul 05 00:21:39.903062 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:39.903019 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7db0703037f52b325df462c89adebdee259e9d810bd0460ed5303bd9c0aa98f"} err="failed to get container status \"f7db0703037f52b325df462c89adebdee259e9d810bd0460ed5303bd9c0aa98f\": rpc error: code = NotFound desc = could not find container \"f7db0703037f52b325df462c89adebdee259e9d810bd0460ed5303bd9c0aa98f\": container with ID starting with f7db0703037f52b325df462c89adebdee259e9d810bd0460ed5303bd9c0aa98f not found: ID does not exist" Jul 05 00:21:39.914445 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:39.914407 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-twztc" podStartSLOduration=2.479798465 podStartE2EDuration="23.914394373s" totalImagesPullingTime="21.434595908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:21:39.913524177 +0000 UTC m=+770.638540233" watchObservedRunningTime="2026-07-05 00:21:39.914394373 +0000 UTC m=+770.639410431" Jul 05 00:21:39.915396 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:21:39.915376 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4w5fc\" is forbidden: User \"system:node:ip-10-0-142-188.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-188.ec2.internal' and this object" podUID="2a657556-f0f5-4dea-980d-ff2035699a62" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4w5fc" Jul 05 00:21:39.940849 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:39.940787 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gzbjl" podStartSLOduration=12.940767805 podStartE2EDuration="12.940767805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:21:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:21:39.936730694 +0000 UTC m=+770.661746753" watchObservedRunningTime="2026-07-05 00:21:39.940767805 +0000 UTC m=+770.665783866" Jul 05 00:21:43.715244 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:43.715213 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89"] Jul 05 00:21:43.720331 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:43.720309 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89" Jul 05 00:21:43.723045 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:43.723023 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-r8hkz\"" Jul 05 00:21:43.732476 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:43.732456 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89"] Jul 05 00:21:43.899781 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:43.899753 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4dln\" (UniqueName: \"kubernetes.io/projected/87c1ca05-ea68-42dd-9765-d2a9b0eb2b34-kube-api-access-k4dln\") pod \"kuadrant-operator-controller-manager-86878c769f-n6g89\" (UID: \"87c1ca05-ea68-42dd-9765-d2a9b0eb2b34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89" Jul 05 00:21:43.899928 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:43.899895 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87c1ca05-ea68-42dd-9765-d2a9b0eb2b34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n6g89\" (UID: \"87c1ca05-ea68-42dd-9765-d2a9b0eb2b34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89" Jul 05 00:21:44.001008 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:44.000925 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87c1ca05-ea68-42dd-9765-d2a9b0eb2b34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n6g89\" (UID: \"87c1ca05-ea68-42dd-9765-d2a9b0eb2b34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89" Jul 05 00:21:44.001008 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:44.000983 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4dln\" (UniqueName: \"kubernetes.io/projected/87c1ca05-ea68-42dd-9765-d2a9b0eb2b34-kube-api-access-k4dln\") pod \"kuadrant-operator-controller-manager-86878c769f-n6g89\" (UID: \"87c1ca05-ea68-42dd-9765-d2a9b0eb2b34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89" Jul 05 00:21:44.001314 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:44.001296 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87c1ca05-ea68-42dd-9765-d2a9b0eb2b34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n6g89\" (UID: \"87c1ca05-ea68-42dd-9765-d2a9b0eb2b34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89" Jul 05 00:21:44.010041 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:44.010012 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4dln\" (UniqueName: \"kubernetes.io/projected/87c1ca05-ea68-42dd-9765-d2a9b0eb2b34-kube-api-access-k4dln\") pod \"kuadrant-operator-controller-manager-86878c769f-n6g89\" (UID: \"87c1ca05-ea68-42dd-9765-d2a9b0eb2b34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89" Jul 05 00:21:44.032330 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:44.032306 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89" Jul 05 00:21:44.166015 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:44.165983 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89"] Jul 05 00:21:44.167383 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:21:44.167360 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87c1ca05_ea68_42dd_9765_d2a9b0eb2b34.slice/crio-a6a9a8e69e73b9c424ea733ab1aeb77a72143123716b8eee81bd52b67951797e WatchSource:0}: Error finding container a6a9a8e69e73b9c424ea733ab1aeb77a72143123716b8eee81bd52b67951797e: Status 404 returned error can't find the container with id a6a9a8e69e73b9c424ea733ab1aeb77a72143123716b8eee81bd52b67951797e Jul 05 00:21:44.925847 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:44.925791 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89" event={"ID":"87c1ca05-ea68-42dd-9765-d2a9b0eb2b34","Type":"ContainerStarted","Data":"a6a9a8e69e73b9c424ea733ab1aeb77a72143123716b8eee81bd52b67951797e"} Jul 05 00:21:48.952501 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:48.952468 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89" event={"ID":"87c1ca05-ea68-42dd-9765-d2a9b0eb2b34","Type":"ContainerStarted","Data":"d0501927a4664ec8c349da2c4174587166f5196063f3d5e72b3dd9a0d29bc47c"} Jul 05 00:21:48.952872 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:48.952635 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89" Jul 05 00:21:48.974153 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:48.974086 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89" podStartSLOduration=2.109888892 podStartE2EDuration="5.974070922s" totalImagesPullingTime="3.86418203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:21:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:21:48.970195194 +0000 UTC m=+779.695211253" watchObservedRunningTime="2026-07-05 00:21:48.974070922 +0000 UTC m=+779.699086980" Jul 05 00:21:50.906095 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:50.906064 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gzbjl" Jul 05 00:21:59.959864 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:21:59.959836 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89" Jul 05 00:23:49.774023 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:23:49.773990 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/1.log" Jul 05 00:23:49.777209 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:23:49.777181 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/1.log" Jul 05 00:24:13.101579 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.101532 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk"] Jul 05 00:24:13.108508 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.107220 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:24:13.110616 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.110592 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 05 00:24:13.110766 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.110709 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 05 00:24:13.110766 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.110725 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk"] Jul 05 00:24:13.111661 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.111643 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 05 00:24:13.111762 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.111658 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vz78f\"" Jul 05 00:24:13.233487 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.233457 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/967b3ec9-09d1-496a-ac76-453a2be34d4c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6xvk\" (UID: \"967b3ec9-09d1-496a-ac76-453a2be34d4c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:24:13.233651 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.233495 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/967b3ec9-09d1-496a-ac76-453a2be34d4c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6xvk\" (UID: \"967b3ec9-09d1-496a-ac76-453a2be34d4c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:24:13.233651 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.233569 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffbsm\" (UniqueName: \"kubernetes.io/projected/967b3ec9-09d1-496a-ac76-453a2be34d4c-kube-api-access-ffbsm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6xvk\" (UID: \"967b3ec9-09d1-496a-ac76-453a2be34d4c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:24:13.233651 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.233619 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/967b3ec9-09d1-496a-ac76-453a2be34d4c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6xvk\" (UID: \"967b3ec9-09d1-496a-ac76-453a2be34d4c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:24:13.233651 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.233650 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/967b3ec9-09d1-496a-ac76-453a2be34d4c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6xvk\" (UID: \"967b3ec9-09d1-496a-ac76-453a2be34d4c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:24:13.233839 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.233743 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/967b3ec9-09d1-496a-ac76-453a2be34d4c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6xvk\" (UID: \"967b3ec9-09d1-496a-ac76-453a2be34d4c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:24:13.334446 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.334418 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/967b3ec9-09d1-496a-ac76-453a2be34d4c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6xvk\" (UID: \"967b3ec9-09d1-496a-ac76-453a2be34d4c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:24:13.334604 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.334467 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/967b3ec9-09d1-496a-ac76-453a2be34d4c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6xvk\" (UID: \"967b3ec9-09d1-496a-ac76-453a2be34d4c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:24:13.334604 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.334483 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/967b3ec9-09d1-496a-ac76-453a2be34d4c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6xvk\" (UID: \"967b3ec9-09d1-496a-ac76-453a2be34d4c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:24:13.334604 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.334522 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffbsm\" (UniqueName: \"kubernetes.io/projected/967b3ec9-09d1-496a-ac76-453a2be34d4c-kube-api-access-ffbsm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6xvk\" (UID: \"967b3ec9-09d1-496a-ac76-453a2be34d4c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:24:13.334604 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.334587 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/967b3ec9-09d1-496a-ac76-453a2be34d4c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6xvk\" (UID: \"967b3ec9-09d1-496a-ac76-453a2be34d4c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:24:13.334820 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.334624 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/967b3ec9-09d1-496a-ac76-453a2be34d4c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6xvk\" (UID: \"967b3ec9-09d1-496a-ac76-453a2be34d4c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:24:13.334890 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.334865 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/967b3ec9-09d1-496a-ac76-453a2be34d4c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6xvk\" (UID: \"967b3ec9-09d1-496a-ac76-453a2be34d4c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:24:13.334941 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.334918 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/967b3ec9-09d1-496a-ac76-453a2be34d4c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6xvk\" (UID: \"967b3ec9-09d1-496a-ac76-453a2be34d4c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:24:13.335042 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.335023 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/967b3ec9-09d1-496a-ac76-453a2be34d4c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6xvk\" (UID: \"967b3ec9-09d1-496a-ac76-453a2be34d4c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:24:13.336758 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.336720 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/967b3ec9-09d1-496a-ac76-453a2be34d4c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6xvk\" (UID: \"967b3ec9-09d1-496a-ac76-453a2be34d4c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:24:13.337104 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.337087 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/967b3ec9-09d1-496a-ac76-453a2be34d4c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6xvk\" (UID: \"967b3ec9-09d1-496a-ac76-453a2be34d4c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:24:13.341751 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.341731 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffbsm\" (UniqueName: \"kubernetes.io/projected/967b3ec9-09d1-496a-ac76-453a2be34d4c-kube-api-access-ffbsm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v6xvk\" (UID: \"967b3ec9-09d1-496a-ac76-453a2be34d4c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:24:13.422130 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.422078 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:24:13.553896 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.553869 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk"] Jul 05 00:24:13.555929 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:24:13.555898 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod967b3ec9_09d1_496a_ac76_453a2be34d4c.slice/crio-17b859e3f034a0b4b64a91d15e64761cb834ad84158dd41076ab4bad534ecd98 WatchSource:0}: Error finding container 17b859e3f034a0b4b64a91d15e64761cb834ad84158dd41076ab4bad534ecd98: Status 404 returned error can't find the container with id 17b859e3f034a0b4b64a91d15e64761cb834ad84158dd41076ab4bad534ecd98 Jul 05 00:24:13.557307 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.557287 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 00:24:13.705805 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:13.705727 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" event={"ID":"967b3ec9-09d1-496a-ac76-453a2be34d4c","Type":"ContainerStarted","Data":"17b859e3f034a0b4b64a91d15e64761cb834ad84158dd41076ab4bad534ecd98"} Jul 05 00:24:14.712473 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:14.712438 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" event={"ID":"967b3ec9-09d1-496a-ac76-453a2be34d4c","Type":"ContainerStarted","Data":"ddb21cbd63ee3f5c8df1e0953e2f38dbb068ac5e269f846fd263d95b94f2539e"} Jul 05 00:24:14.731459 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:14.731411 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" podStartSLOduration=0.718286909 podStartE2EDuration="1.731396097s" totalImagesPullingTime="1.013109188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:24:14.728621744 +0000 UTC m=+925.453637804" watchObservedRunningTime="2026-07-05 00:24:14.731396097 +0000 UTC m=+925.456412156" Jul 05 00:24:23.422388 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:23.422349 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:24:23.422878 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:23.422408 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:24:23.434928 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:23.434900 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:24:23.777212 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:24:23.777133 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v6xvk" Jul 05 00:28:49.811144 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:28:49.811116 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/1.log" Jul 05 00:28:49.815193 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:28:49.815174 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/1.log" Jul 05 00:31:22.798446 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:31:22.798366 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89"] Jul 05 00:31:22.798944 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:31:22.798569 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89" podUID="87c1ca05-ea68-42dd-9765-d2a9b0eb2b34" containerName="manager" containerID="cri-o://d0501927a4664ec8c349da2c4174587166f5196063f3d5e72b3dd9a0d29bc47c" gracePeriod=10 Jul 05 00:31:24.545576 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:31:24.545552 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89" Jul 05 00:31:24.627764 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:31:24.627739 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4dln\" (UniqueName: \"kubernetes.io/projected/87c1ca05-ea68-42dd-9765-d2a9b0eb2b34-kube-api-access-k4dln\") pod \"87c1ca05-ea68-42dd-9765-d2a9b0eb2b34\" (UID: \"87c1ca05-ea68-42dd-9765-d2a9b0eb2b34\") " Jul 05 00:31:24.627916 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:31:24.627779 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87c1ca05-ea68-42dd-9765-d2a9b0eb2b34-extensions-socket-volume\") pod \"87c1ca05-ea68-42dd-9765-d2a9b0eb2b34\" (UID: \"87c1ca05-ea68-42dd-9765-d2a9b0eb2b34\") " Jul 05 00:31:24.628231 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:31:24.628200 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87c1ca05-ea68-42dd-9765-d2a9b0eb2b34-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "87c1ca05-ea68-42dd-9765-d2a9b0eb2b34" (UID: "87c1ca05-ea68-42dd-9765-d2a9b0eb2b34"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:31:24.629734 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:31:24.629711 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87c1ca05-ea68-42dd-9765-d2a9b0eb2b34-kube-api-access-k4dln" (OuterVolumeSpecName: "kube-api-access-k4dln") pod "87c1ca05-ea68-42dd-9765-d2a9b0eb2b34" (UID: "87c1ca05-ea68-42dd-9765-d2a9b0eb2b34"). InnerVolumeSpecName "kube-api-access-k4dln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:31:24.728630 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:31:24.728591 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4dln\" (UniqueName: \"kubernetes.io/projected/87c1ca05-ea68-42dd-9765-d2a9b0eb2b34-kube-api-access-k4dln\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:31:24.728630 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:31:24.728627 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87c1ca05-ea68-42dd-9765-d2a9b0eb2b34-extensions-socket-volume\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:31:25.032264 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:31:25.032182 2561 generic.go:356] "Generic (PLEG): container finished" podID="87c1ca05-ea68-42dd-9765-d2a9b0eb2b34" containerID="d0501927a4664ec8c349da2c4174587166f5196063f3d5e72b3dd9a0d29bc47c" exitCode=0 Jul 05 00:31:25.032264 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:31:25.032225 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89" Jul 05 00:31:25.032437 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:31:25.032268 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89" event={"ID":"87c1ca05-ea68-42dd-9765-d2a9b0eb2b34","Type":"ContainerDied","Data":"d0501927a4664ec8c349da2c4174587166f5196063f3d5e72b3dd9a0d29bc47c"} Jul 05 00:31:25.032437 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:31:25.032319 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89" event={"ID":"87c1ca05-ea68-42dd-9765-d2a9b0eb2b34","Type":"ContainerDied","Data":"a6a9a8e69e73b9c424ea733ab1aeb77a72143123716b8eee81bd52b67951797e"} Jul 05 00:31:25.032437 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:31:25.032341 2561 scope.go:117] "RemoveContainer" containerID="d0501927a4664ec8c349da2c4174587166f5196063f3d5e72b3dd9a0d29bc47c" Jul 05 00:31:25.042147 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:31:25.042127 2561 scope.go:117] "RemoveContainer" containerID="d0501927a4664ec8c349da2c4174587166f5196063f3d5e72b3dd9a0d29bc47c" Jul 05 00:31:25.042379 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:31:25.042361 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0501927a4664ec8c349da2c4174587166f5196063f3d5e72b3dd9a0d29bc47c\": container with ID starting with d0501927a4664ec8c349da2c4174587166f5196063f3d5e72b3dd9a0d29bc47c not found: ID does not exist" containerID="d0501927a4664ec8c349da2c4174587166f5196063f3d5e72b3dd9a0d29bc47c" Jul 05 00:31:25.042428 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:31:25.042388 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0501927a4664ec8c349da2c4174587166f5196063f3d5e72b3dd9a0d29bc47c"} err="failed to get container status \"d0501927a4664ec8c349da2c4174587166f5196063f3d5e72b3dd9a0d29bc47c\": rpc error: code = NotFound desc = could not find container \"d0501927a4664ec8c349da2c4174587166f5196063f3d5e72b3dd9a0d29bc47c\": container with ID starting with d0501927a4664ec8c349da2c4174587166f5196063f3d5e72b3dd9a0d29bc47c not found: ID does not exist" Jul 05 00:31:25.054148 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:31:25.054126 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89"] Jul 05 00:31:25.059094 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:31:25.059070 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6g89"] Jul 05 00:31:25.777556 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:31:25.777525 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87c1ca05-ea68-42dd-9765-d2a9b0eb2b34" path="/var/lib/kubelet/pods/87c1ca05-ea68-42dd-9765-d2a9b0eb2b34/volumes" Jul 05 00:32:23.911722 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:32:23.911685 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2zw"] Jul 05 00:32:23.912350 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:32:23.912328 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87c1ca05-ea68-42dd-9765-d2a9b0eb2b34" containerName="manager" Jul 05 00:32:23.912450 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:32:23.912353 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="87c1ca05-ea68-42dd-9765-d2a9b0eb2b34" containerName="manager" Jul 05 00:32:23.912506 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:32:23.912456 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="87c1ca05-ea68-42dd-9765-d2a9b0eb2b34" containerName="manager" Jul 05 00:32:23.915255 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:32:23.915233 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2zw" Jul 05 00:32:23.918084 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:32:23.918066 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-r8hkz\"" Jul 05 00:32:23.926179 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:32:23.926159 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2zw"] Jul 05 00:32:24.002466 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:32:24.002440 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0aeaea78-756d-4ac3-bee6-03ed58c44c88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xf2zw\" (UID: \"0aeaea78-756d-4ac3-bee6-03ed58c44c88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2zw" Jul 05 00:32:24.002580 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:32:24.002488 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrjjl\" (UniqueName: \"kubernetes.io/projected/0aeaea78-756d-4ac3-bee6-03ed58c44c88-kube-api-access-lrjjl\") pod \"kuadrant-operator-controller-manager-86878c769f-xf2zw\" (UID: \"0aeaea78-756d-4ac3-bee6-03ed58c44c88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2zw" Jul 05 00:32:24.103658 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:32:24.103627 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0aeaea78-756d-4ac3-bee6-03ed58c44c88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xf2zw\" (UID: \"0aeaea78-756d-4ac3-bee6-03ed58c44c88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2zw" Jul 05 00:32:24.103750 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:32:24.103675 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrjjl\" (UniqueName: \"kubernetes.io/projected/0aeaea78-756d-4ac3-bee6-03ed58c44c88-kube-api-access-lrjjl\") pod \"kuadrant-operator-controller-manager-86878c769f-xf2zw\" (UID: \"0aeaea78-756d-4ac3-bee6-03ed58c44c88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2zw" Jul 05 00:32:24.104003 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:32:24.103987 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0aeaea78-756d-4ac3-bee6-03ed58c44c88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xf2zw\" (UID: \"0aeaea78-756d-4ac3-bee6-03ed58c44c88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2zw" Jul 05 00:32:24.115109 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:32:24.115084 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrjjl\" (UniqueName: \"kubernetes.io/projected/0aeaea78-756d-4ac3-bee6-03ed58c44c88-kube-api-access-lrjjl\") pod \"kuadrant-operator-controller-manager-86878c769f-xf2zw\" (UID: \"0aeaea78-756d-4ac3-bee6-03ed58c44c88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2zw" Jul 05 00:32:24.226854 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:32:24.226779 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2zw" Jul 05 00:32:24.364162 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:32:24.364137 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2zw"] Jul 05 00:32:24.366339 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:32:24.366311 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aeaea78_756d_4ac3_bee6_03ed58c44c88.slice/crio-54030b9a036af01648bacede78990cdc7e409140c22bd80146b75c113ac8f2ff WatchSource:0}: Error finding container 54030b9a036af01648bacede78990cdc7e409140c22bd80146b75c113ac8f2ff: Status 404 returned error can't find the container with id 54030b9a036af01648bacede78990cdc7e409140c22bd80146b75c113ac8f2ff Jul 05 00:32:25.353213 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:32:25.353178 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2zw" event={"ID":"0aeaea78-756d-4ac3-bee6-03ed58c44c88","Type":"ContainerStarted","Data":"5a16d1fcb8434c8388a1a773b7d71bc2a53bb09eb1cd3af0af9d71c0995ab8d6"} Jul 05 00:32:25.353587 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:32:25.353229 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2zw" event={"ID":"0aeaea78-756d-4ac3-bee6-03ed58c44c88","Type":"ContainerStarted","Data":"54030b9a036af01648bacede78990cdc7e409140c22bd80146b75c113ac8f2ff"} Jul 05 00:32:25.353587 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:32:25.353286 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2zw" Jul 05 00:32:25.384589 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:32:25.384537 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2zw" podStartSLOduration=2.384520288 podStartE2EDuration="2.384520288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:32:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:32:25.382476976 +0000 UTC m=+1416.107493035" watchObservedRunningTime="2026-07-05 00:32:25.384520288 +0000 UTC m=+1416.109536348" Jul 05 00:32:36.361467 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:32:36.361437 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xf2zw" Jul 05 00:33:49.844636 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:33:49.844604 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/1.log" Jul 05 00:33:49.851214 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:33:49.851192 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/1.log" Jul 05 00:38:49.878373 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:38:49.878347 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/1.log" Jul 05 00:38:49.887226 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:38:49.887188 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/1.log" Jul 05 00:39:03.659951 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.659914 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9"] Jul 05 00:39:03.664204 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.664182 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.666979 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.666954 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-84731c49-openshift-default-dockercfg-m27sp\"" Jul 05 00:39:03.686196 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.686168 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9"] Jul 05 00:39:03.832629 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.832595 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-workload-certs\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.832629 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.832628 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-podinfo\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.832859 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.832652 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-credential-socket\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.832859 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.832711 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-workload-socket\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.832859 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.832746 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8lw9\" (UniqueName: \"kubernetes.io/projected/7476d43f-084b-4edb-92eb-f079cc3f9cc1-kube-api-access-n8lw9\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.832859 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.832782 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-token\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.832859 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.832853 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-data\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.833052 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.832907 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-envoy\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.833052 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.832924 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istiod-ca-cert\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.933742 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.933679 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-token\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.933742 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.933712 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-data\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.933742 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.933744 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-envoy\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.934021 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.933758 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istiod-ca-cert\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.934021 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.933818 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-workload-certs\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.934021 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.933833 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-podinfo\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.934021 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.933856 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-credential-socket\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.934021 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.933883 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-workload-socket\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.934021 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.933910 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8lw9\" (UniqueName: \"kubernetes.io/projected/7476d43f-084b-4edb-92eb-f079cc3f9cc1-kube-api-access-n8lw9\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.934302 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.934172 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-data\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.934302 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.934198 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-workload-certs\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.934414 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.934314 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-credential-socket\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.934476 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.934448 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-workload-socket\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.934595 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.934578 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istiod-ca-cert\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.936194 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.936173 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-envoy\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.936349 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.936329 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-podinfo\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.942053 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.942029 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-token\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.942232 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.942214 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8lw9\" (UniqueName: \"kubernetes.io/projected/7476d43f-084b-4edb-92eb-f079cc3f9cc1-kube-api-access-n8lw9\") pod \"e2e-ait-84731c49-openshift-default-64475f4849-pm2p9\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:03.975598 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:03.975578 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:04.119436 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:04.119403 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9"] Jul 05 00:39:04.120661 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:39:04.120633 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7476d43f_084b_4edb_92eb_f079cc3f9cc1.slice/crio-4d6b1c09e50d1014e4fb3c8601412423b57f3e2009677e70df920de63c45de32 WatchSource:0}: Error finding container 4d6b1c09e50d1014e4fb3c8601412423b57f3e2009677e70df920de63c45de32: Status 404 returned error can't find the container with id 4d6b1c09e50d1014e4fb3c8601412423b57f3e2009677e70df920de63c45de32 Jul 05 00:39:04.122919 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:04.122876 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:39:04.122993 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:04.122971 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:39:04.123037 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:04.123015 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:39:04.482007 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:04.481969 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" event={"ID":"7476d43f-084b-4edb-92eb-f079cc3f9cc1","Type":"ContainerStarted","Data":"47eb4e1aa43ef742a7869b3335076b97b75922f220bfd2f53cbcd3faec860757"} Jul 05 00:39:04.482187 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:04.482038 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" event={"ID":"7476d43f-084b-4edb-92eb-f079cc3f9cc1","Type":"ContainerStarted","Data":"4d6b1c09e50d1014e4fb3c8601412423b57f3e2009677e70df920de63c45de32"} Jul 05 00:39:04.506526 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:04.506481 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" podStartSLOduration=1.506466905 podStartE2EDuration="1.506466905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:39:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:39:04.503104677 +0000 UTC m=+1815.228120737" watchObservedRunningTime="2026-07-05 00:39:04.506466905 +0000 UTC m=+1815.231482965" Jul 05 00:39:04.976474 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:04.976439 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:05.981375 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:05.981343 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:06.496214 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:06.496181 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:06.497042 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:06.497021 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:13.118908 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:13.118871 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9"] Jul 05 00:39:13.119318 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:13.119102 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" podUID="7476d43f-084b-4edb-92eb-f079cc3f9cc1" containerName="istio-proxy" containerID="cri-o://47eb4e1aa43ef742a7869b3335076b97b75922f220bfd2f53cbcd3faec860757" gracePeriod=30 Jul 05 00:39:16.072593 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.072542 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:16.152165 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.152081 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-credential-socket\") pod \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " Jul 05 00:39:16.152165 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.152131 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-workload-certs\") pod \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " Jul 05 00:39:16.152165 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.152150 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istiod-ca-cert\") pod \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " Jul 05 00:39:16.152165 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.152173 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-podinfo\") pod \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " Jul 05 00:39:16.152521 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.152196 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8lw9\" (UniqueName: \"kubernetes.io/projected/7476d43f-084b-4edb-92eb-f079cc3f9cc1-kube-api-access-n8lw9\") pod \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " Jul 05 00:39:16.152521 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.152259 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-envoy\") pod \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " Jul 05 00:39:16.152521 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.152307 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-data\") pod \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " Jul 05 00:39:16.152521 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.152352 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-workload-socket\") pod \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " Jul 05 00:39:16.152521 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.152356 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7476d43f-084b-4edb-92eb-f079cc3f9cc1" (UID: "7476d43f-084b-4edb-92eb-f079cc3f9cc1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:39:16.152521 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.152382 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-token\") pod \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\" (UID: \"7476d43f-084b-4edb-92eb-f079cc3f9cc1\") " Jul 05 00:39:16.152521 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.152390 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7476d43f-084b-4edb-92eb-f079cc3f9cc1" (UID: "7476d43f-084b-4edb-92eb-f079cc3f9cc1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:39:16.152917 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.152560 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7476d43f-084b-4edb-92eb-f079cc3f9cc1" (UID: "7476d43f-084b-4edb-92eb-f079cc3f9cc1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:39:16.152917 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.152617 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7476d43f-084b-4edb-92eb-f079cc3f9cc1" (UID: "7476d43f-084b-4edb-92eb-f079cc3f9cc1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:39:16.152917 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.152732 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-workload-socket\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:16.152917 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.152750 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-credential-socket\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:16.152917 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.152764 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-workload-certs\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:16.152917 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.152777 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istiod-ca-cert\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:16.153255 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.153223 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-data" (OuterVolumeSpecName: "istio-data") pod "7476d43f-084b-4edb-92eb-f079cc3f9cc1" (UID: "7476d43f-084b-4edb-92eb-f079cc3f9cc1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:39:16.154650 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.154621 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7476d43f-084b-4edb-92eb-f079cc3f9cc1-kube-api-access-n8lw9" (OuterVolumeSpecName: "kube-api-access-n8lw9") pod "7476d43f-084b-4edb-92eb-f079cc3f9cc1" (UID: "7476d43f-084b-4edb-92eb-f079cc3f9cc1"). InnerVolumeSpecName "kube-api-access-n8lw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:39:16.154650 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.154644 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7476d43f-084b-4edb-92eb-f079cc3f9cc1" (UID: "7476d43f-084b-4edb-92eb-f079cc3f9cc1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:39:16.154771 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.154634 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7476d43f-084b-4edb-92eb-f079cc3f9cc1" (UID: "7476d43f-084b-4edb-92eb-f079cc3f9cc1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 00:39:16.154771 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.154719 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-token" (OuterVolumeSpecName: "istio-token") pod "7476d43f-084b-4edb-92eb-f079cc3f9cc1" (UID: "7476d43f-084b-4edb-92eb-f079cc3f9cc1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:39:16.254173 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.254138 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-podinfo\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:16.254173 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.254170 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8lw9\" (UniqueName: \"kubernetes.io/projected/7476d43f-084b-4edb-92eb-f079cc3f9cc1-kube-api-access-n8lw9\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:16.254323 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.254182 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-envoy\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:16.254323 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.254196 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-data\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:16.254323 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.254205 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7476d43f-084b-4edb-92eb-f079cc3f9cc1-istio-token\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:16.559019 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.558933 2561 generic.go:356] "Generic (PLEG): container finished" podID="7476d43f-084b-4edb-92eb-f079cc3f9cc1" containerID="47eb4e1aa43ef742a7869b3335076b97b75922f220bfd2f53cbcd3faec860757" exitCode=0 Jul 05 00:39:16.559019 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.559001 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" Jul 05 00:39:16.559196 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.559017 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" event={"ID":"7476d43f-084b-4edb-92eb-f079cc3f9cc1","Type":"ContainerDied","Data":"47eb4e1aa43ef742a7869b3335076b97b75922f220bfd2f53cbcd3faec860757"} Jul 05 00:39:16.559196 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.559094 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9" event={"ID":"7476d43f-084b-4edb-92eb-f079cc3f9cc1","Type":"ContainerDied","Data":"4d6b1c09e50d1014e4fb3c8601412423b57f3e2009677e70df920de63c45de32"} Jul 05 00:39:16.559196 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.559117 2561 scope.go:117] "RemoveContainer" containerID="47eb4e1aa43ef742a7869b3335076b97b75922f220bfd2f53cbcd3faec860757" Jul 05 00:39:16.569199 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.569184 2561 scope.go:117] "RemoveContainer" containerID="47eb4e1aa43ef742a7869b3335076b97b75922f220bfd2f53cbcd3faec860757" Jul 05 00:39:16.569420 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:39:16.569402 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47eb4e1aa43ef742a7869b3335076b97b75922f220bfd2f53cbcd3faec860757\": container with ID starting with 47eb4e1aa43ef742a7869b3335076b97b75922f220bfd2f53cbcd3faec860757 not found: ID does not exist" containerID="47eb4e1aa43ef742a7869b3335076b97b75922f220bfd2f53cbcd3faec860757" Jul 05 00:39:16.569466 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.569428 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47eb4e1aa43ef742a7869b3335076b97b75922f220bfd2f53cbcd3faec860757"} err="failed to get container status \"47eb4e1aa43ef742a7869b3335076b97b75922f220bfd2f53cbcd3faec860757\": rpc error: code = NotFound desc = could not find container \"47eb4e1aa43ef742a7869b3335076b97b75922f220bfd2f53cbcd3faec860757\": container with ID starting with 47eb4e1aa43ef742a7869b3335076b97b75922f220bfd2f53cbcd3faec860757 not found: ID does not exist" Jul 05 00:39:16.580448 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.580427 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9"] Jul 05 00:39:16.584846 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:16.584826 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-84731c49-openshift-default-64475f4849-pm2p9"] Jul 05 00:39:17.777016 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:17.776983 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7476d43f-084b-4edb-92eb-f079cc3f9cc1" path="/var/lib/kubelet/pods/7476d43f-084b-4edb-92eb-f079cc3f9cc1/volumes" Jul 05 00:39:19.038395 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.038114 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95"] Jul 05 00:39:19.038988 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.038694 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7476d43f-084b-4edb-92eb-f079cc3f9cc1" containerName="istio-proxy" Jul 05 00:39:19.038988 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.038711 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7476d43f-084b-4edb-92eb-f079cc3f9cc1" containerName="istio-proxy" Jul 05 00:39:19.038988 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.038852 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7476d43f-084b-4edb-92eb-f079cc3f9cc1" containerName="istio-proxy" Jul 05 00:39:19.043431 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.043408 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.046072 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.046054 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8c1a3081-openshift-default-dockercfg-kn987\"" Jul 05 00:39:19.055271 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.055247 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95"] Jul 05 00:39:19.079274 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.079254 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-workload-socket\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.079361 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.079280 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-workload-certs\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.079361 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.079318 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-token\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.079503 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.079405 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-credential-socket\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.079503 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.079441 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istiod-ca-cert\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.079503 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.079495 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxxs4\" (UniqueName: \"kubernetes.io/projected/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-kube-api-access-rxxs4\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.079648 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.079524 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-data\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.079648 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.079579 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-podinfo\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.079648 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.079625 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-envoy\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.180755 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.180719 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-token\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.180755 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.180759 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-credential-socket\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.181048 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.180776 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istiod-ca-cert\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.181048 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.180827 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxxs4\" (UniqueName: \"kubernetes.io/projected/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-kube-api-access-rxxs4\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.181048 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.180855 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-data\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.181048 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.180911 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-podinfo\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.181048 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.180963 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-envoy\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.181048 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.180995 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-workload-socket\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.181048 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.181020 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-workload-certs\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.181430 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.181239 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-credential-socket\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.181430 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.181384 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-workload-certs\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.181528 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.181449 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-workload-socket\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.181585 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.181537 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-data\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.181665 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.181642 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istiod-ca-cert\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.183352 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.183330 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-envoy\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.183441 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.183393 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-podinfo\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.188087 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.188068 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-token\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.188402 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.188380 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxxs4\" (UniqueName: \"kubernetes.io/projected/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-kube-api-access-rxxs4\") pod \"e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.357194 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.357157 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:19.494706 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.494678 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95"] Jul 05 00:39:19.496156 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:39:19.496132 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb97a09e_fa70_46f7_a3ef_1e6aaf58543e.slice/crio-fee25fca3d4c25ec7245aa70e70e980d7c630cfa93e0b20eb55718a72df7c2d0 WatchSource:0}: Error finding container fee25fca3d4c25ec7245aa70e70e980d7c630cfa93e0b20eb55718a72df7c2d0: Status 404 returned error can't find the container with id fee25fca3d4c25ec7245aa70e70e980d7c630cfa93e0b20eb55718a72df7c2d0 Jul 05 00:39:19.498385 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.498354 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:39:19.498466 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.498416 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:39:19.498466 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.498448 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:39:19.582029 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.581986 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" event={"ID":"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e","Type":"ContainerStarted","Data":"17c4790943e3bacbb524751310c7814ef48d9f4ec345e1956b7a110ab02ee4da"} Jul 05 00:39:19.582392 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.582066 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" event={"ID":"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e","Type":"ContainerStarted","Data":"fee25fca3d4c25ec7245aa70e70e980d7c630cfa93e0b20eb55718a72df7c2d0"} Jul 05 00:39:19.601440 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:19.601395 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" podStartSLOduration=0.601379924 podStartE2EDuration="601.379924ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:39:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:39:19.598788231 +0000 UTC m=+1830.323804294" watchObservedRunningTime="2026-07-05 00:39:19.601379924 +0000 UTC m=+1830.326396027" Jul 05 00:39:20.358051 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:20.358014 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:20.362942 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:20.362916 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:20.587118 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:20.587080 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:20.588059 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:20.588037 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:29.537963 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:29.537927 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95"] Jul 05 00:39:29.538341 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:29.538185 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" podUID="eb97a09e-fa70-46f7-a3ef-1e6aaf58543e" containerName="istio-proxy" containerID="cri-o://17c4790943e3bacbb524751310c7814ef48d9f4ec345e1956b7a110ab02ee4da" gracePeriod=30 Jul 05 00:39:30.893231 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:30.893204 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:30.998721 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:30.998690 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-envoy\") pod \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " Jul 05 00:39:30.998880 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:30.998734 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-workload-socket\") pod \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " Jul 05 00:39:30.998880 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:30.998774 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-credential-socket\") pod \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " Jul 05 00:39:30.998880 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:30.998851 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-workload-certs\") pod \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " Jul 05 00:39:30.999085 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:30.998906 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istiod-ca-cert\") pod \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " Jul 05 00:39:30.999085 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:30.998939 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxxs4\" (UniqueName: \"kubernetes.io/projected/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-kube-api-access-rxxs4\") pod \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " Jul 05 00:39:30.999085 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:30.998962 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-data\") pod \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " Jul 05 00:39:30.999085 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:30.999022 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-token\") pod \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " Jul 05 00:39:30.999085 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:30.999042 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eb97a09e-fa70-46f7-a3ef-1e6aaf58543e" (UID: "eb97a09e-fa70-46f7-a3ef-1e6aaf58543e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:39:30.999085 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:30.999084 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-podinfo\") pod \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\" (UID: \"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e\") " Jul 05 00:39:30.999423 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:30.999125 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eb97a09e-fa70-46f7-a3ef-1e6aaf58543e" (UID: "eb97a09e-fa70-46f7-a3ef-1e6aaf58543e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:39:30.999423 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:30.999159 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eb97a09e-fa70-46f7-a3ef-1e6aaf58543e" (UID: "eb97a09e-fa70-46f7-a3ef-1e6aaf58543e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:39:30.999423 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:30.999333 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eb97a09e-fa70-46f7-a3ef-1e6aaf58543e" (UID: "eb97a09e-fa70-46f7-a3ef-1e6aaf58543e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:39:30.999571 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:30.999429 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istiod-ca-cert\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:30.999571 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:30.999447 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-workload-socket\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:30.999571 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:30.999460 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-credential-socket\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:30.999571 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:30.999475 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-workload-certs\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:31.000067 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:31.000042 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-data" (OuterVolumeSpecName: "istio-data") pod "eb97a09e-fa70-46f7-a3ef-1e6aaf58543e" (UID: "eb97a09e-fa70-46f7-a3ef-1e6aaf58543e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:39:31.001396 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:31.001364 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eb97a09e-fa70-46f7-a3ef-1e6aaf58543e" (UID: "eb97a09e-fa70-46f7-a3ef-1e6aaf58543e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:39:31.001396 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:31.001377 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-token" (OuterVolumeSpecName: "istio-token") pod "eb97a09e-fa70-46f7-a3ef-1e6aaf58543e" (UID: "eb97a09e-fa70-46f7-a3ef-1e6aaf58543e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:39:31.001531 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:31.001506 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eb97a09e-fa70-46f7-a3ef-1e6aaf58543e" (UID: "eb97a09e-fa70-46f7-a3ef-1e6aaf58543e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 00:39:31.001599 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:31.001578 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-kube-api-access-rxxs4" (OuterVolumeSpecName: "kube-api-access-rxxs4") pod "eb97a09e-fa70-46f7-a3ef-1e6aaf58543e" (UID: "eb97a09e-fa70-46f7-a3ef-1e6aaf58543e"). InnerVolumeSpecName "kube-api-access-rxxs4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:39:31.100392 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:31.100351 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxxs4\" (UniqueName: \"kubernetes.io/projected/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-kube-api-access-rxxs4\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:31.100392 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:31.100386 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-data\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:31.100392 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:31.100395 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-token\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:31.100635 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:31.100403 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-podinfo\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:31.100635 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:31.100411 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e-istio-envoy\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:31.650294 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:31.650258 2561 generic.go:356] "Generic (PLEG): container finished" podID="eb97a09e-fa70-46f7-a3ef-1e6aaf58543e" containerID="17c4790943e3bacbb524751310c7814ef48d9f4ec345e1956b7a110ab02ee4da" exitCode=0 Jul 05 00:39:31.650466 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:31.650308 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" Jul 05 00:39:31.650466 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:31.650346 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" event={"ID":"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e","Type":"ContainerDied","Data":"17c4790943e3bacbb524751310c7814ef48d9f4ec345e1956b7a110ab02ee4da"} Jul 05 00:39:31.650466 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:31.650404 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95" event={"ID":"eb97a09e-fa70-46f7-a3ef-1e6aaf58543e","Type":"ContainerDied","Data":"fee25fca3d4c25ec7245aa70e70e980d7c630cfa93e0b20eb55718a72df7c2d0"} Jul 05 00:39:31.650466 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:31.650433 2561 scope.go:117] "RemoveContainer" containerID="17c4790943e3bacbb524751310c7814ef48d9f4ec345e1956b7a110ab02ee4da" Jul 05 00:39:31.661945 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:31.661927 2561 scope.go:117] "RemoveContainer" containerID="17c4790943e3bacbb524751310c7814ef48d9f4ec345e1956b7a110ab02ee4da" Jul 05 00:39:31.662336 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:39:31.662311 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17c4790943e3bacbb524751310c7814ef48d9f4ec345e1956b7a110ab02ee4da\": container with ID starting with 17c4790943e3bacbb524751310c7814ef48d9f4ec345e1956b7a110ab02ee4da not found: ID does not exist" containerID="17c4790943e3bacbb524751310c7814ef48d9f4ec345e1956b7a110ab02ee4da" Jul 05 00:39:31.662415 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:31.662346 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17c4790943e3bacbb524751310c7814ef48d9f4ec345e1956b7a110ab02ee4da"} err="failed to get container status \"17c4790943e3bacbb524751310c7814ef48d9f4ec345e1956b7a110ab02ee4da\": rpc error: code = NotFound desc = could not find container \"17c4790943e3bacbb524751310c7814ef48d9f4ec345e1956b7a110ab02ee4da\": container with ID starting with 17c4790943e3bacbb524751310c7814ef48d9f4ec345e1956b7a110ab02ee4da not found: ID does not exist" Jul 05 00:39:31.672657 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:31.672609 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95"] Jul 05 00:39:31.675981 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:31.675961 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8c1a3081-openshift-default-6966f4678f-ljt95"] Jul 05 00:39:31.777502 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:31.777469 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb97a09e-fa70-46f7-a3ef-1e6aaf58543e" path="/var/lib/kubelet/pods/eb97a09e-fa70-46f7-a3ef-1e6aaf58543e/volumes" Jul 05 00:39:35.571461 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.571432 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5"] Jul 05 00:39:35.571848 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.571835 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb97a09e-fa70-46f7-a3ef-1e6aaf58543e" containerName="istio-proxy" Jul 05 00:39:35.571904 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.571850 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb97a09e-fa70-46f7-a3ef-1e6aaf58543e" containerName="istio-proxy" Jul 05 00:39:35.571942 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.571916 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb97a09e-fa70-46f7-a3ef-1e6aaf58543e" containerName="istio-proxy" Jul 05 00:39:35.575193 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.575174 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.578516 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.578498 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-e1765800-openshift-default-dockercfg-5xdfs\"" Jul 05 00:39:35.602902 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.602878 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5"] Jul 05 00:39:35.738379 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.738349 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-workload-certs\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.738544 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.738385 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99p6m\" (UniqueName: \"kubernetes.io/projected/79341637-ad21-4287-8d28-8c667526b882-kube-api-access-99p6m\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.738544 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.738409 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-credential-socket\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.738544 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.738480 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79341637-ad21-4287-8d28-8c667526b882-istio-token\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.738654 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.738558 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79341637-ad21-4287-8d28-8c667526b882-istio-podinfo\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.738654 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.738594 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-workload-socket\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.738654 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.738611 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-istio-data\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.738654 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.738625 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79341637-ad21-4287-8d28-8c667526b882-istiod-ca-cert\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.738776 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.738715 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-istio-envoy\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.839537 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.839502 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-workload-certs\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.839710 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.839540 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99p6m\" (UniqueName: \"kubernetes.io/projected/79341637-ad21-4287-8d28-8c667526b882-kube-api-access-99p6m\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.839710 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.839566 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-credential-socket\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.839710 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.839601 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79341637-ad21-4287-8d28-8c667526b882-istio-token\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.839710 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.839633 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79341637-ad21-4287-8d28-8c667526b882-istio-podinfo\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.839710 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.839669 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-workload-socket\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.839990 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.839814 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-istio-data\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.839990 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.839858 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79341637-ad21-4287-8d28-8c667526b882-istiod-ca-cert\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.839990 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.839948 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-istio-envoy\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.840156 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.840033 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-credential-socket\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.840156 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.840053 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-workload-socket\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.840156 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.840115 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-istio-data\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.840270 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.840188 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-workload-certs\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.840511 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.840490 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79341637-ad21-4287-8d28-8c667526b882-istiod-ca-cert\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.842141 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.842119 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-istio-envoy\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.842424 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.842405 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79341637-ad21-4287-8d28-8c667526b882-istio-podinfo\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.847305 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.847284 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79341637-ad21-4287-8d28-8c667526b882-istio-token\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.847470 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.847453 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99p6m\" (UniqueName: \"kubernetes.io/projected/79341637-ad21-4287-8d28-8c667526b882-kube-api-access-99p6m\") pod \"e2e-derive-e1765800-openshift-default-849496b455-szpz5\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:35.885987 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:35.885970 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:36.021593 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:36.021569 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5"] Jul 05 00:39:36.023206 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:39:36.023179 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79341637_ad21_4287_8d28_8c667526b882.slice/crio-f6b6c4ac57b2c427fd9ed2faf8f5d1fa8ab8b3aea9aef9a5247deb81734f9703 WatchSource:0}: Error finding container f6b6c4ac57b2c427fd9ed2faf8f5d1fa8ab8b3aea9aef9a5247deb81734f9703: Status 404 returned error can't find the container with id f6b6c4ac57b2c427fd9ed2faf8f5d1fa8ab8b3aea9aef9a5247deb81734f9703 Jul 05 00:39:36.025333 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:36.025289 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:39:36.025430 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:36.025411 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:39:36.025475 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:36.025461 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:39:36.680857 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:36.680820 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" event={"ID":"79341637-ad21-4287-8d28-8c667526b882","Type":"ContainerStarted","Data":"a35c38db0a20f8e64fc2b624a081e6ae20d8c269915ac542a905387d277642fb"} Jul 05 00:39:36.681287 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:36.680880 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" event={"ID":"79341637-ad21-4287-8d28-8c667526b882","Type":"ContainerStarted","Data":"f6b6c4ac57b2c427fd9ed2faf8f5d1fa8ab8b3aea9aef9a5247deb81734f9703"} Jul 05 00:39:36.702468 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:36.702420 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" podStartSLOduration=1.702406501 podStartE2EDuration="1.702406501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:39:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:39:36.699909318 +0000 UTC m=+1847.424925389" watchObservedRunningTime="2026-07-05 00:39:36.702406501 +0000 UTC m=+1847.427422559" Jul 05 00:39:36.886348 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:36.886305 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:37.891718 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:37.891693 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:38.692628 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:38.692592 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:38.693552 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:38.693534 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:44.360382 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:44.360345 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5"] Jul 05 00:39:44.360841 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:44.360599 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" podUID="79341637-ad21-4287-8d28-8c667526b882" containerName="istio-proxy" containerID="cri-o://a35c38db0a20f8e64fc2b624a081e6ae20d8c269915ac542a905387d277642fb" gracePeriod=30 Jul 05 00:39:50.763443 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:50.763411 2561 generic.go:356] "Generic (PLEG): container finished" podID="79341637-ad21-4287-8d28-8c667526b882" containerID="a35c38db0a20f8e64fc2b624a081e6ae20d8c269915ac542a905387d277642fb" exitCode=0 Jul 05 00:39:50.763922 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:50.763486 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" event={"ID":"79341637-ad21-4287-8d28-8c667526b882","Type":"ContainerDied","Data":"a35c38db0a20f8e64fc2b624a081e6ae20d8c269915ac542a905387d277642fb"} Jul 05 00:39:50.810101 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:50.810080 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:50.978586 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:50.978511 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79341637-ad21-4287-8d28-8c667526b882-istio-token\") pod \"79341637-ad21-4287-8d28-8c667526b882\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " Jul 05 00:39:50.978586 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:50.978548 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79341637-ad21-4287-8d28-8c667526b882-istio-podinfo\") pod \"79341637-ad21-4287-8d28-8c667526b882\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " Jul 05 00:39:50.978586 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:50.978577 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-credential-socket\") pod \"79341637-ad21-4287-8d28-8c667526b882\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " Jul 05 00:39:50.978868 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:50.978627 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-workload-socket\") pod \"79341637-ad21-4287-8d28-8c667526b882\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " Jul 05 00:39:50.978868 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:50.978659 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-workload-certs\") pod \"79341637-ad21-4287-8d28-8c667526b882\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " Jul 05 00:39:50.978868 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:50.978683 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-istio-data\") pod \"79341637-ad21-4287-8d28-8c667526b882\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " Jul 05 00:39:50.978868 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:50.978726 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-istio-envoy\") pod \"79341637-ad21-4287-8d28-8c667526b882\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " Jul 05 00:39:50.978868 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:50.978771 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79341637-ad21-4287-8d28-8c667526b882-istiod-ca-cert\") pod \"79341637-ad21-4287-8d28-8c667526b882\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " Jul 05 00:39:50.978868 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:50.978835 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99p6m\" (UniqueName: \"kubernetes.io/projected/79341637-ad21-4287-8d28-8c667526b882-kube-api-access-99p6m\") pod \"79341637-ad21-4287-8d28-8c667526b882\" (UID: \"79341637-ad21-4287-8d28-8c667526b882\") " Jul 05 00:39:50.979190 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:50.979012 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "79341637-ad21-4287-8d28-8c667526b882" (UID: "79341637-ad21-4287-8d28-8c667526b882"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:39:50.979190 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:50.979057 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "79341637-ad21-4287-8d28-8c667526b882" (UID: "79341637-ad21-4287-8d28-8c667526b882"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:39:50.979301 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:50.979259 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-credential-socket\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:50.979301 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:50.979265 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79341637-ad21-4287-8d28-8c667526b882-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "79341637-ad21-4287-8d28-8c667526b882" (UID: "79341637-ad21-4287-8d28-8c667526b882"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:39:50.979301 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:50.979279 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-workload-certs\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:50.979482 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:50.979452 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "79341637-ad21-4287-8d28-8c667526b882" (UID: "79341637-ad21-4287-8d28-8c667526b882"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:39:50.979639 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:50.979597 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-istio-data" (OuterVolumeSpecName: "istio-data") pod "79341637-ad21-4287-8d28-8c667526b882" (UID: "79341637-ad21-4287-8d28-8c667526b882"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:39:50.980849 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:50.980823 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/79341637-ad21-4287-8d28-8c667526b882-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "79341637-ad21-4287-8d28-8c667526b882" (UID: "79341637-ad21-4287-8d28-8c667526b882"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 00:39:50.980943 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:50.980926 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "79341637-ad21-4287-8d28-8c667526b882" (UID: "79341637-ad21-4287-8d28-8c667526b882"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:39:50.981053 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:50.981038 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79341637-ad21-4287-8d28-8c667526b882-istio-token" (OuterVolumeSpecName: "istio-token") pod "79341637-ad21-4287-8d28-8c667526b882" (UID: "79341637-ad21-4287-8d28-8c667526b882"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:39:50.981370 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:50.981342 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79341637-ad21-4287-8d28-8c667526b882-kube-api-access-99p6m" (OuterVolumeSpecName: "kube-api-access-99p6m") pod "79341637-ad21-4287-8d28-8c667526b882" (UID: "79341637-ad21-4287-8d28-8c667526b882"). InnerVolumeSpecName "kube-api-access-99p6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:39:51.080713 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:51.080682 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79341637-ad21-4287-8d28-8c667526b882-istio-token\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:51.080713 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:51.080708 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79341637-ad21-4287-8d28-8c667526b882-istio-podinfo\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:51.080713 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:51.080717 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-workload-socket\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:51.080974 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:51.080727 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-istio-data\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:51.080974 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:51.080737 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79341637-ad21-4287-8d28-8c667526b882-istio-envoy\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:51.080974 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:51.080745 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79341637-ad21-4287-8d28-8c667526b882-istiod-ca-cert\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:51.080974 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:51.080753 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99p6m\" (UniqueName: \"kubernetes.io/projected/79341637-ad21-4287-8d28-8c667526b882-kube-api-access-99p6m\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:39:51.770235 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:51.770207 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" Jul 05 00:39:51.770620 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:51.770231 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5" event={"ID":"79341637-ad21-4287-8d28-8c667526b882","Type":"ContainerDied","Data":"f6b6c4ac57b2c427fd9ed2faf8f5d1fa8ab8b3aea9aef9a5247deb81734f9703"} Jul 05 00:39:51.770620 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:51.770287 2561 scope.go:117] "RemoveContainer" containerID="a35c38db0a20f8e64fc2b624a081e6ae20d8c269915ac542a905387d277642fb" Jul 05 00:39:51.795668 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:51.795639 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5"] Jul 05 00:39:51.801477 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:51.801454 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-e1765800-openshift-default-849496b455-szpz5"] Jul 05 00:39:53.777240 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:39:53.777207 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79341637-ad21-4287-8d28-8c667526b882" path="/var/lib/kubelet/pods/79341637-ad21-4287-8d28-8c667526b882/volumes" Jul 05 00:41:24.191779 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.191743 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v"] Jul 05 00:41:24.192266 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.192140 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79341637-ad21-4287-8d28-8c667526b882" containerName="istio-proxy" Jul 05 00:41:24.192266 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.192152 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="79341637-ad21-4287-8d28-8c667526b882" containerName="istio-proxy" Jul 05 00:41:24.192266 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.192211 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="79341637-ad21-4287-8d28-8c667526b882" containerName="istio-proxy" Jul 05 00:41:24.195357 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.195331 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.198406 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.198387 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-125bebca-openshift-default-dockercfg-rzkb6\"" Jul 05 00:41:24.214265 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.214241 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v"] Jul 05 00:41:24.335811 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.335776 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-workload-socket\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.335964 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.335842 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br4dk\" (UniqueName: \"kubernetes.io/projected/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-kube-api-access-br4dk\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.335964 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.335896 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-podinfo\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.335964 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.335936 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-data\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.336070 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.336017 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-credential-socket\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.336070 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.336038 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-envoy\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.336149 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.336094 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-workload-certs\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.336149 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.336111 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-token\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.336149 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.336129 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istiod-ca-cert\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.437458 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.437427 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-workload-certs\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.437458 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.437457 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-token\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.437666 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.437472 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istiod-ca-cert\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.437666 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.437500 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-workload-socket\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.437666 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.437523 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br4dk\" (UniqueName: \"kubernetes.io/projected/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-kube-api-access-br4dk\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.437666 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.437544 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-podinfo\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.437666 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.437567 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-data\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.437666 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.437653 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-credential-socket\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.438013 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.437921 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-workload-socket\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.438073 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.438027 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-data\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.438073 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.438060 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-workload-certs\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.438153 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.437855 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-envoy\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.438153 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.438098 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-credential-socket\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.438316 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.438293 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istiod-ca-cert\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.439945 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.439923 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-envoy\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.440157 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.440138 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-podinfo\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.445135 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.445077 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-token\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.445748 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.445728 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-br4dk\" (UniqueName: \"kubernetes.io/projected/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-kube-api-access-br4dk\") pod \"e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.507981 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.507956 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:24.643784 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.643759 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v"] Jul 05 00:41:24.645481 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:41:24.645455 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ab7948e_e7f9_4111_a6d1_cbfe4f6839a4.slice/crio-b700e4847f419cef063f5c9fbeca5f46b8bfdf7a710f495c67daeb5dc052725e WatchSource:0}: Error finding container b700e4847f419cef063f5c9fbeca5f46b8bfdf7a710f495c67daeb5dc052725e: Status 404 returned error can't find the container with id b700e4847f419cef063f5c9fbeca5f46b8bfdf7a710f495c67daeb5dc052725e Jul 05 00:41:24.647478 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.647440 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:41:24.647569 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.647500 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:41:24.647569 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:24.647527 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:41:25.281242 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:25.281209 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" event={"ID":"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4","Type":"ContainerStarted","Data":"f80e5940f64d110aa1611178eb8d6cc8a9a15c395d4762a1ef2cc02ad2befacb"} Jul 05 00:41:25.281620 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:25.281260 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" event={"ID":"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4","Type":"ContainerStarted","Data":"b700e4847f419cef063f5c9fbeca5f46b8bfdf7a710f495c67daeb5dc052725e"} Jul 05 00:41:25.301123 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:25.301074 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" podStartSLOduration=1.301057788 podStartE2EDuration="1.301057788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:41:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:41:25.298920122 +0000 UTC m=+1956.023936188" watchObservedRunningTime="2026-07-05 00:41:25.301057788 +0000 UTC m=+1956.026073848" Jul 05 00:41:25.508407 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:25.508369 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:25.513276 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:25.513251 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:26.286861 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:26.286828 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:26.287851 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:26.287832 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:41.288403 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:41.288364 2561 patch_prober.go:28] interesting pod/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 05 00:41:41.288834 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:41.288439 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" podUID="4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 05 00:41:41.374961 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:41.374932 2561 generic.go:356] "Generic (PLEG): container finished" podID="4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4" containerID="f80e5940f64d110aa1611178eb8d6cc8a9a15c395d4762a1ef2cc02ad2befacb" exitCode=0 Jul 05 00:41:41.375099 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:41.374973 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" event={"ID":"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4","Type":"ContainerDied","Data":"f80e5940f64d110aa1611178eb8d6cc8a9a15c395d4762a1ef2cc02ad2befacb"} Jul 05 00:41:41.375335 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:41.375320 2561 scope.go:117] "RemoveContainer" containerID="f80e5940f64d110aa1611178eb8d6cc8a9a15c395d4762a1ef2cc02ad2befacb" Jul 05 00:41:41.376452 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:41.376405 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:41:41.376527 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:41.376511 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:41:41.376567 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:41.376551 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:41:42.388734 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:42.388619 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" event={"ID":"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4","Type":"ContainerStarted","Data":"b56122cd4c98093f33bae5d86b327a72f0d2a8ce7c0bc4918a3ee217bac5fcc7"} Jul 05 00:41:42.508614 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:42.508584 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:42.508827 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:42.508786 2561 patch_prober.go:28] interesting pod/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 05 00:41:42.508880 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:42.508854 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" podUID="4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 05 00:41:43.508713 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:43.508675 2561 patch_prober.go:28] interesting pod/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 05 00:41:43.509116 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:43.508741 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" podUID="4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 05 00:41:44.508299 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:44.508269 2561 patch_prober.go:28] interesting pod/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 05 00:41:44.508504 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:44.508330 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" podUID="4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 05 00:41:45.211392 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:45.211341 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v"] Jul 05 00:41:45.212213 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:45.212175 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" podUID="4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4" containerName="istio-proxy" containerID="cri-o://b56122cd4c98093f33bae5d86b327a72f0d2a8ce7c0bc4918a3ee217bac5fcc7" gracePeriod=30 Jul 05 00:41:51.448590 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.448554 2561 generic.go:356] "Generic (PLEG): container finished" podID="4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4" containerID="b56122cd4c98093f33bae5d86b327a72f0d2a8ce7c0bc4918a3ee217bac5fcc7" exitCode=0 Jul 05 00:41:51.448940 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.448626 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" event={"ID":"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4","Type":"ContainerDied","Data":"b56122cd4c98093f33bae5d86b327a72f0d2a8ce7c0bc4918a3ee217bac5fcc7"} Jul 05 00:41:51.448940 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.448711 2561 scope.go:117] "RemoveContainer" containerID="f80e5940f64d110aa1611178eb8d6cc8a9a15c395d4762a1ef2cc02ad2befacb" Jul 05 00:41:51.483871 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.483848 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:51.574846 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.574819 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-podinfo\") pod \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " Jul 05 00:41:51.574986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.574857 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-workload-certs\") pod \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " Jul 05 00:41:51.574986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.574896 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-credential-socket\") pod \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " Jul 05 00:41:51.574986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.574934 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istiod-ca-cert\") pod \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " Jul 05 00:41:51.574986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.574974 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-envoy\") pod \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " Jul 05 00:41:51.575170 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.575003 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-workload-socket\") pod \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " Jul 05 00:41:51.575170 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.575029 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-token\") pod \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " Jul 05 00:41:51.575170 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.575069 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-data\") pod \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " Jul 05 00:41:51.575170 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.575107 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-br4dk\" (UniqueName: \"kubernetes.io/projected/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-kube-api-access-br4dk\") pod \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\" (UID: \"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4\") " Jul 05 00:41:51.575375 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.575191 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4" (UID: "4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:41:51.575375 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.575229 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4" (UID: "4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:41:51.575375 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.575279 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4" (UID: "4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:41:51.575375 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.575352 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4" (UID: "4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:41:51.575578 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.575487 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-workload-socket\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:41:51.575578 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.575509 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-workload-certs\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:41:51.575578 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.575523 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-credential-socket\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:41:51.575578 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.575537 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istiod-ca-cert\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:41:51.576032 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.576003 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-data" (OuterVolumeSpecName: "istio-data") pod "4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4" (UID: "4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:41:51.577246 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.577191 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4" (UID: "4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 00:41:51.577490 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.577466 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4" (UID: "4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:41:51.577650 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.577631 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-token" (OuterVolumeSpecName: "istio-token") pod "4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4" (UID: "4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:41:51.577718 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.577699 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-kube-api-access-br4dk" (OuterVolumeSpecName: "kube-api-access-br4dk") pod "4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4" (UID: "4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4"). InnerVolumeSpecName "kube-api-access-br4dk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:41:51.676231 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.676204 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-data\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:41:51.676231 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.676230 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-br4dk\" (UniqueName: \"kubernetes.io/projected/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-kube-api-access-br4dk\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:41:51.676380 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.676245 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-podinfo\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:41:51.676380 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.676257 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-envoy\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:41:51.676380 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:51.676268 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4-istio-token\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:41:52.455177 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:52.455152 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" Jul 05 00:41:52.455668 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:52.455146 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v" event={"ID":"4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4","Type":"ContainerDied","Data":"b700e4847f419cef063f5c9fbeca5f46b8bfdf7a710f495c67daeb5dc052725e"} Jul 05 00:41:52.455668 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:52.455293 2561 scope.go:117] "RemoveContainer" containerID="b56122cd4c98093f33bae5d86b327a72f0d2a8ce7c0bc4918a3ee217bac5fcc7" Jul 05 00:41:52.476753 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:52.476727 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v"] Jul 05 00:41:52.483149 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:52.483127 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-125bebca-openshift-default-78767b8bc9-pnw7v"] Jul 05 00:41:53.777550 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:41:53.777511 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4" path="/var/lib/kubelet/pods/4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4/volumes" Jul 05 00:42:04.163654 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.163620 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p"] Jul 05 00:42:04.164165 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.164035 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4" containerName="istio-proxy" Jul 05 00:42:04.164165 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.164050 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4" containerName="istio-proxy" Jul 05 00:42:04.164165 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.164071 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4" containerName="istio-proxy" Jul 05 00:42:04.164165 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.164077 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4" containerName="istio-proxy" Jul 05 00:42:04.164165 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.164159 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4" containerName="istio-proxy" Jul 05 00:42:04.167448 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.167429 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.170104 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.170083 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e214bcba-openshift-default-dockercfg-8z6dc\"" Jul 05 00:42:04.179488 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.179465 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p"] Jul 05 00:42:04.283551 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.283518 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-token\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.283551 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.283553 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-workload-socket\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.283751 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.283575 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-podinfo\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.283751 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.283589 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istiod-ca-cert\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.283751 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.283699 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-credential-socket\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.283751 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.283744 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-workload-certs\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.283939 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.283850 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-envoy\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.283939 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.283901 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-data\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.284045 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.284012 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7dtq\" (UniqueName: \"kubernetes.io/projected/639122d2-df6f-4c18-8c84-4e9b59f7c71c-kube-api-access-s7dtq\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.384997 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.384964 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7dtq\" (UniqueName: \"kubernetes.io/projected/639122d2-df6f-4c18-8c84-4e9b59f7c71c-kube-api-access-s7dtq\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.385149 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.385010 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-token\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.385149 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.385040 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-workload-socket\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.385149 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.385069 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-podinfo\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.385149 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.385093 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istiod-ca-cert\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.385149 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.385134 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-credential-socket\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.385415 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.385166 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-workload-certs\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.385415 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.385199 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-envoy\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.385415 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.385247 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-data\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.385676 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.385647 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-workload-certs\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.385762 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.385720 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-workload-socket\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.385878 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.385777 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-credential-socket\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.386143 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.386121 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-data\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.386356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.386335 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istiod-ca-cert\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.387550 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.387532 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-envoy\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.387649 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.387632 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-podinfo\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.395041 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.395016 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-token\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.395498 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.395477 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7dtq\" (UniqueName: \"kubernetes.io/projected/639122d2-df6f-4c18-8c84-4e9b59f7c71c-kube-api-access-s7dtq\") pod \"e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.479789 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.479720 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:04.619247 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.619214 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p"] Jul 05 00:42:04.620579 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:42:04.620550 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod639122d2_df6f_4c18_8c84_4e9b59f7c71c.slice/crio-65963ec8f1abaf7d2a4bb666f42bf187fda48408d2b25063c1d7741feac394ed WatchSource:0}: Error finding container 65963ec8f1abaf7d2a4bb666f42bf187fda48408d2b25063c1d7741feac394ed: Status 404 returned error can't find the container with id 65963ec8f1abaf7d2a4bb666f42bf187fda48408d2b25063c1d7741feac394ed Jul 05 00:42:04.622676 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.622644 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:42:04.622760 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.622705 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:42:04.622760 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:04.622746 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:42:05.529228 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:05.529182 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" event={"ID":"639122d2-df6f-4c18-8c84-4e9b59f7c71c","Type":"ContainerStarted","Data":"f456a16654a53c64913ba996ded412c4f54321dc6b57584068cd6732857a2cd2"} Jul 05 00:42:05.529625 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:05.529255 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" event={"ID":"639122d2-df6f-4c18-8c84-4e9b59f7c71c","Type":"ContainerStarted","Data":"65963ec8f1abaf7d2a4bb666f42bf187fda48408d2b25063c1d7741feac394ed"} Jul 05 00:42:05.549770 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:05.549719 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" podStartSLOduration=1.549704235 podStartE2EDuration="1.549704235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:42:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:42:05.547850082 +0000 UTC m=+1996.272866141" watchObservedRunningTime="2026-07-05 00:42:05.549704235 +0000 UTC m=+1996.274720300" Jul 05 00:42:06.480884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:06.480842 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:06.486113 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:06.486087 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:06.534686 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:06.534659 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:06.535347 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:06.535331 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:21.536599 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:21.536563 2561 patch_prober.go:28] interesting pod/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 05 00:42:21.537099 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:21.536650 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" podUID="639122d2-df6f-4c18-8c84-4e9b59f7c71c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 05 00:42:21.631342 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:21.631313 2561 generic.go:356] "Generic (PLEG): container finished" podID="639122d2-df6f-4c18-8c84-4e9b59f7c71c" containerID="f456a16654a53c64913ba996ded412c4f54321dc6b57584068cd6732857a2cd2" exitCode=0 Jul 05 00:42:21.631491 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:21.631355 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" event={"ID":"639122d2-df6f-4c18-8c84-4e9b59f7c71c","Type":"ContainerDied","Data":"f456a16654a53c64913ba996ded412c4f54321dc6b57584068cd6732857a2cd2"} Jul 05 00:42:21.631748 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:21.631733 2561 scope.go:117] "RemoveContainer" containerID="f456a16654a53c64913ba996ded412c4f54321dc6b57584068cd6732857a2cd2" Jul 05 00:42:21.632715 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:21.632684 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:42:21.632818 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:21.632752 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:42:21.632818 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:21.632782 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:42:22.638431 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:22.638397 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" event={"ID":"639122d2-df6f-4c18-8c84-4e9b59f7c71c","Type":"ContainerStarted","Data":"5f3923849f1c5ff8a87c39e4312331313441de2f1e5b74842c28e819d0035e0b"} Jul 05 00:42:23.480171 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:23.480134 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:23.480560 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:23.480530 2561 patch_prober.go:28] interesting pod/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 05 00:42:23.480790 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:23.480749 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" podUID="639122d2-df6f-4c18-8c84-4e9b59f7c71c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 05 00:42:24.480629 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:24.480593 2561 patch_prober.go:28] interesting pod/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 05 00:42:24.481109 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:24.480670 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" podUID="639122d2-df6f-4c18-8c84-4e9b59f7c71c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 05 00:42:25.480674 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:25.480633 2561 patch_prober.go:28] interesting pod/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 05 00:42:25.481197 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:25.480702 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" podUID="639122d2-df6f-4c18-8c84-4e9b59f7c71c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 05 00:42:26.490313 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:26.490280 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:26.490732 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:26.490553 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:42:26.491244 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:42:26.491227 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:43:49.914482 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:49.914450 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/1.log" Jul 05 00:43:49.924136 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:49.924115 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/1.log" Jul 05 00:43:53.779281 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:53.779248 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p"] Jul 05 00:43:53.779728 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:53.779475 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" podUID="639122d2-df6f-4c18-8c84-4e9b59f7c71c" containerName="istio-proxy" containerID="cri-o://5f3923849f1c5ff8a87c39e4312331313441de2f1e5b74842c28e819d0035e0b" gracePeriod=30 Jul 05 00:43:56.493621 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:56.493585 2561 patch_prober.go:28] interesting pod/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 05 00:43:56.494003 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:56.493666 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" podUID="639122d2-df6f-4c18-8c84-4e9b59f7c71c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 05 00:43:59.031721 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.031698 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:43:59.156530 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.156499 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-podinfo\") pod \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " Jul 05 00:43:59.157059 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.156538 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istiod-ca-cert\") pod \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " Jul 05 00:43:59.157059 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.156559 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-envoy\") pod \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " Jul 05 00:43:59.157059 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.156620 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-workload-certs\") pod \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " Jul 05 00:43:59.157059 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.156651 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-token\") pod \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " Jul 05 00:43:59.157059 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.156714 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7dtq\" (UniqueName: \"kubernetes.io/projected/639122d2-df6f-4c18-8c84-4e9b59f7c71c-kube-api-access-s7dtq\") pod \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " Jul 05 00:43:59.157059 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.156748 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-workload-socket\") pod \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " Jul 05 00:43:59.157059 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.156771 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-data\") pod \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " Jul 05 00:43:59.157059 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.156825 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-credential-socket\") pod \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\" (UID: \"639122d2-df6f-4c18-8c84-4e9b59f7c71c\") " Jul 05 00:43:59.157059 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.156974 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "639122d2-df6f-4c18-8c84-4e9b59f7c71c" (UID: "639122d2-df6f-4c18-8c84-4e9b59f7c71c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:43:59.157585 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.157059 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "639122d2-df6f-4c18-8c84-4e9b59f7c71c" (UID: "639122d2-df6f-4c18-8c84-4e9b59f7c71c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:43:59.157713 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.157692 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istiod-ca-cert\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:43:59.157839 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.157718 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-workload-certs\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:43:59.157914 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.157830 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "639122d2-df6f-4c18-8c84-4e9b59f7c71c" (UID: "639122d2-df6f-4c18-8c84-4e9b59f7c71c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:43:59.157914 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.157900 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "639122d2-df6f-4c18-8c84-4e9b59f7c71c" (UID: "639122d2-df6f-4c18-8c84-4e9b59f7c71c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:43:59.158413 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.158386 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-data" (OuterVolumeSpecName: "istio-data") pod "639122d2-df6f-4c18-8c84-4e9b59f7c71c" (UID: "639122d2-df6f-4c18-8c84-4e9b59f7c71c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:43:59.159061 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.159033 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "639122d2-df6f-4c18-8c84-4e9b59f7c71c" (UID: "639122d2-df6f-4c18-8c84-4e9b59f7c71c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:43:59.159207 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.159183 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/639122d2-df6f-4c18-8c84-4e9b59f7c71c-kube-api-access-s7dtq" (OuterVolumeSpecName: "kube-api-access-s7dtq") pod "639122d2-df6f-4c18-8c84-4e9b59f7c71c" (UID: "639122d2-df6f-4c18-8c84-4e9b59f7c71c"). InnerVolumeSpecName "kube-api-access-s7dtq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:43:59.159300 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.159240 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-token" (OuterVolumeSpecName: "istio-token") pod "639122d2-df6f-4c18-8c84-4e9b59f7c71c" (UID: "639122d2-df6f-4c18-8c84-4e9b59f7c71c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:43:59.159354 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.159314 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "639122d2-df6f-4c18-8c84-4e9b59f7c71c" (UID: "639122d2-df6f-4c18-8c84-4e9b59f7c71c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 00:43:59.167894 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.167857 2561 generic.go:356] "Generic (PLEG): container finished" podID="639122d2-df6f-4c18-8c84-4e9b59f7c71c" containerID="5f3923849f1c5ff8a87c39e4312331313441de2f1e5b74842c28e819d0035e0b" exitCode=0 Jul 05 00:43:59.167997 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.167911 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" Jul 05 00:43:59.167997 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.167935 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" event={"ID":"639122d2-df6f-4c18-8c84-4e9b59f7c71c","Type":"ContainerDied","Data":"5f3923849f1c5ff8a87c39e4312331313441de2f1e5b74842c28e819d0035e0b"} Jul 05 00:43:59.167997 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.167996 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p" event={"ID":"639122d2-df6f-4c18-8c84-4e9b59f7c71c","Type":"ContainerDied","Data":"65963ec8f1abaf7d2a4bb666f42bf187fda48408d2b25063c1d7741feac394ed"} Jul 05 00:43:59.168156 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.168020 2561 scope.go:117] "RemoveContainer" containerID="5f3923849f1c5ff8a87c39e4312331313441de2f1e5b74842c28e819d0035e0b" Jul 05 00:43:59.180471 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.180442 2561 scope.go:117] "RemoveContainer" containerID="f456a16654a53c64913ba996ded412c4f54321dc6b57584068cd6732857a2cd2" Jul 05 00:43:59.190524 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.190508 2561 scope.go:117] "RemoveContainer" containerID="5f3923849f1c5ff8a87c39e4312331313441de2f1e5b74842c28e819d0035e0b" Jul 05 00:43:59.190753 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:43:59.190737 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f3923849f1c5ff8a87c39e4312331313441de2f1e5b74842c28e819d0035e0b\": container with ID starting with 5f3923849f1c5ff8a87c39e4312331313441de2f1e5b74842c28e819d0035e0b not found: ID does not exist" containerID="5f3923849f1c5ff8a87c39e4312331313441de2f1e5b74842c28e819d0035e0b" Jul 05 00:43:59.190960 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.190762 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f3923849f1c5ff8a87c39e4312331313441de2f1e5b74842c28e819d0035e0b"} err="failed to get container status \"5f3923849f1c5ff8a87c39e4312331313441de2f1e5b74842c28e819d0035e0b\": rpc error: code = NotFound desc = could not find container \"5f3923849f1c5ff8a87c39e4312331313441de2f1e5b74842c28e819d0035e0b\": container with ID starting with 5f3923849f1c5ff8a87c39e4312331313441de2f1e5b74842c28e819d0035e0b not found: ID does not exist" Jul 05 00:43:59.190960 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.190778 2561 scope.go:117] "RemoveContainer" containerID="f456a16654a53c64913ba996ded412c4f54321dc6b57584068cd6732857a2cd2" Jul 05 00:43:59.191083 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:43:59.191057 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f456a16654a53c64913ba996ded412c4f54321dc6b57584068cd6732857a2cd2\": container with ID starting with f456a16654a53c64913ba996ded412c4f54321dc6b57584068cd6732857a2cd2 not found: ID does not exist" containerID="f456a16654a53c64913ba996ded412c4f54321dc6b57584068cd6732857a2cd2" Jul 05 00:43:59.191124 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.191092 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f456a16654a53c64913ba996ded412c4f54321dc6b57584068cd6732857a2cd2"} err="failed to get container status \"f456a16654a53c64913ba996ded412c4f54321dc6b57584068cd6732857a2cd2\": rpc error: code = NotFound desc = could not find container \"f456a16654a53c64913ba996ded412c4f54321dc6b57584068cd6732857a2cd2\": container with ID starting with f456a16654a53c64913ba996ded412c4f54321dc6b57584068cd6732857a2cd2 not found: ID does not exist" Jul 05 00:43:59.203133 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.203107 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p"] Jul 05 00:43:59.208779 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.208758 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e214bcba-openshift-default-85bf798fff-4rk5p"] Jul 05 00:43:59.259010 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.258988 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-token\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:43:59.259010 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.259008 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7dtq\" (UniqueName: \"kubernetes.io/projected/639122d2-df6f-4c18-8c84-4e9b59f7c71c-kube-api-access-s7dtq\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:43:59.259138 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.259018 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-workload-socket\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:43:59.259138 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.259027 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-data\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:43:59.259138 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.259038 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-credential-socket\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:43:59.259138 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.259046 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-podinfo\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:43:59.259138 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.259053 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/639122d2-df6f-4c18-8c84-4e9b59f7c71c-istio-envoy\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:43:59.777316 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:43:59.777283 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="639122d2-df6f-4c18-8c84-4e9b59f7c71c" path="/var/lib/kubelet/pods/639122d2-df6f-4c18-8c84-4e9b59f7c71c/volumes" Jul 05 00:44:47.742265 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.742179 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg"] Jul 05 00:44:47.742782 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.742737 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="639122d2-df6f-4c18-8c84-4e9b59f7c71c" containerName="istio-proxy" Jul 05 00:44:47.742782 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.742758 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="639122d2-df6f-4c18-8c84-4e9b59f7c71c" containerName="istio-proxy" Jul 05 00:44:47.742782 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.742772 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="639122d2-df6f-4c18-8c84-4e9b59f7c71c" containerName="istio-proxy" Jul 05 00:44:47.742782 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.742781 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="639122d2-df6f-4c18-8c84-4e9b59f7c71c" containerName="istio-proxy" Jul 05 00:44:47.743033 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.742891 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ab7948e-e7f9-4111-a6d1-cbfe4f6839a4" containerName="istio-proxy" Jul 05 00:44:47.743033 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.742906 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="639122d2-df6f-4c18-8c84-4e9b59f7c71c" containerName="istio-proxy" Jul 05 00:44:47.746072 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.746051 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.748777 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.748758 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-4e7441-openshift-default-dockercfg-dtg9f\"" Jul 05 00:44:47.755921 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.755900 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg"] Jul 05 00:44:47.869439 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.869410 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00542a2a-af3b-49a6-86df-9c6828c77769-istiod-ca-cert\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.869630 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.869457 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-istio-envoy\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.869630 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.869475 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpg7w\" (UniqueName: \"kubernetes.io/projected/00542a2a-af3b-49a6-86df-9c6828c77769-kube-api-access-vpg7w\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.869630 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.869528 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-workload-socket\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.869630 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.869546 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-workload-certs\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.869630 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.869569 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00542a2a-af3b-49a6-86df-9c6828c77769-istio-podinfo\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.869630 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.869627 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00542a2a-af3b-49a6-86df-9c6828c77769-istio-token\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.870157 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.869667 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-credential-socket\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.870271 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.870243 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-istio-data\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.971563 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.971526 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00542a2a-af3b-49a6-86df-9c6828c77769-istiod-ca-cert\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.971744 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.971575 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-istio-envoy\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.971744 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.971695 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpg7w\" (UniqueName: \"kubernetes.io/projected/00542a2a-af3b-49a6-86df-9c6828c77769-kube-api-access-vpg7w\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.971887 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.971771 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-workload-socket\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.971887 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.971828 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-workload-certs\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.971887 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.971855 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00542a2a-af3b-49a6-86df-9c6828c77769-istio-podinfo\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.972059 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.971983 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00542a2a-af3b-49a6-86df-9c6828c77769-istio-token\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.972118 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.972058 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-credential-socket\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.972612 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.972219 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-istio-data\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.972612 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.972281 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-workload-socket\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.972612 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.972484 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-credential-socket\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.972612 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.972571 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-istio-data\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.972926 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.972749 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00542a2a-af3b-49a6-86df-9c6828c77769-istiod-ca-cert\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.972926 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.972779 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-workload-certs\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.974190 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.974167 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-istio-envoy\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.974593 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.974575 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00542a2a-af3b-49a6-86df-9c6828c77769-istio-podinfo\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.979515 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.979446 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00542a2a-af3b-49a6-86df-9c6828c77769-istio-token\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:47.980048 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:47.980023 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpg7w\" (UniqueName: \"kubernetes.io/projected/00542a2a-af3b-49a6-86df-9c6828c77769-kube-api-access-vpg7w\") pod \"e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:48.058247 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:48.058179 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:48.194090 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:48.194066 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg"] Jul 05 00:44:48.195579 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:44:48.195545 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00542a2a_af3b_49a6_86df_9c6828c77769.slice/crio-a36471e3d70751a04b03685c12d66c3b88b34b2ab568c6199415f76ecb05fdde WatchSource:0}: Error finding container a36471e3d70751a04b03685c12d66c3b88b34b2ab568c6199415f76ecb05fdde: Status 404 returned error can't find the container with id a36471e3d70751a04b03685c12d66c3b88b34b2ab568c6199415f76ecb05fdde Jul 05 00:44:48.197758 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:48.197721 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:44:48.197871 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:48.197814 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:44:48.197871 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:48.197847 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:44:48.438832 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:48.438768 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" event={"ID":"00542a2a-af3b-49a6-86df-9c6828c77769","Type":"ContainerStarted","Data":"2380cecdcac85c9b15089c8048779ec67af3c9f90bce0eb0fffd2722ef942646"} Jul 05 00:44:48.439007 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:48.438853 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" event={"ID":"00542a2a-af3b-49a6-86df-9c6828c77769","Type":"ContainerStarted","Data":"a36471e3d70751a04b03685c12d66c3b88b34b2ab568c6199415f76ecb05fdde"} Jul 05 00:44:48.459714 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:48.459665 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" podStartSLOduration=1.459651794 podStartE2EDuration="1.459651794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:44:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:44:48.457220146 +0000 UTC m=+2159.182236216" watchObservedRunningTime="2026-07-05 00:44:48.459651794 +0000 UTC m=+2159.184667854" Jul 05 00:44:49.059129 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:49.059099 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:49.063897 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:49.063869 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:49.444230 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:49.444202 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:49.445199 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:49.445181 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:44:55.617415 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.617380 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn"] Jul 05 00:44:55.618024 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.617930 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="639122d2-df6f-4c18-8c84-4e9b59f7c71c" containerName="istio-proxy" Jul 05 00:44:55.621215 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.621191 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.621883 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.621856 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn"] Jul 05 00:44:55.624090 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.624073 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-11db4a-openshift-default-dockercfg-zhglt\"" Jul 05 00:44:55.745521 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.745490 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-envoy\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.745729 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.745530 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-podinfo\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.745729 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.745557 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-workload-certs\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.745729 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.745647 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-data\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.745729 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.745702 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-token\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.745914 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.745785 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18a442ea-7b61-4a6b-8629-9edc480ca574-istiod-ca-cert\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.745914 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.745838 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-workload-socket\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.745914 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.745885 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-credential-socket\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.746035 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.745934 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsljs\" (UniqueName: \"kubernetes.io/projected/18a442ea-7b61-4a6b-8629-9edc480ca574-kube-api-access-zsljs\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.846551 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.846515 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-workload-socket\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.846720 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.846564 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-credential-socket\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.846783 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.846755 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsljs\" (UniqueName: \"kubernetes.io/projected/18a442ea-7b61-4a6b-8629-9edc480ca574-kube-api-access-zsljs\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.846937 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.846918 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-envoy\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.846976 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.846965 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-podinfo\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.847011 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.846992 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-workload-socket\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.847061 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.847012 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-workload-certs\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.847061 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.847041 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-credential-socket\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.847061 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.847054 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-data\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.847211 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.847114 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-token\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.847211 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.847178 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18a442ea-7b61-4a6b-8629-9edc480ca574-istiod-ca-cert\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.847359 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.847337 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-workload-certs\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.847747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.847722 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-data\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.847906 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.847882 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18a442ea-7b61-4a6b-8629-9edc480ca574-istiod-ca-cert\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.849554 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.849529 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-envoy\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.849733 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.849713 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-podinfo\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.854921 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.854896 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsljs\" (UniqueName: \"kubernetes.io/projected/18a442ea-7b61-4a6b-8629-9edc480ca574-kube-api-access-zsljs\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.855202 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.855185 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-token\") pod \"e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:55.933067 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:55.932976 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:56.124193 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:56.124168 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn"] Jul 05 00:44:56.126318 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:44:56.126288 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18a442ea_7b61_4a6b_8629_9edc480ca574.slice/crio-dee2f2dc9c891b56191453629d544a0f0ca02bd83ca222af53ffa91e6009727d WatchSource:0}: Error finding container dee2f2dc9c891b56191453629d544a0f0ca02bd83ca222af53ffa91e6009727d: Status 404 returned error can't find the container with id dee2f2dc9c891b56191453629d544a0f0ca02bd83ca222af53ffa91e6009727d Jul 05 00:44:56.128540 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:56.128499 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:44:56.128631 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:56.128574 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:44:56.128631 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:56.128601 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:44:56.489423 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:56.489331 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" event={"ID":"18a442ea-7b61-4a6b-8629-9edc480ca574","Type":"ContainerStarted","Data":"2722b4e1d799fafd58427037e66314c63aa96866ccf81e83ccd0cde0b5b10d6e"} Jul 05 00:44:56.489423 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:56.489400 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" event={"ID":"18a442ea-7b61-4a6b-8629-9edc480ca574","Type":"ContainerStarted","Data":"dee2f2dc9c891b56191453629d544a0f0ca02bd83ca222af53ffa91e6009727d"} Jul 05 00:44:56.509671 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:56.509608 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" podStartSLOduration=1.509587131 podStartE2EDuration="1.509587131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:44:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:44:56.507238768 +0000 UTC m=+2167.232254829" watchObservedRunningTime="2026-07-05 00:44:56.509587131 +0000 UTC m=+2167.234603193" Jul 05 00:44:56.933331 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:56.933292 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:57.938132 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:57.938103 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:58.511222 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:58.511189 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:44:58.512259 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:44:58.512234 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:45:02.534468 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:02.534436 2561 generic.go:356] "Generic (PLEG): container finished" podID="00542a2a-af3b-49a6-86df-9c6828c77769" containerID="2380cecdcac85c9b15089c8048779ec67af3c9f90bce0eb0fffd2722ef942646" exitCode=0 Jul 05 00:45:02.534968 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:02.534508 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" event={"ID":"00542a2a-af3b-49a6-86df-9c6828c77769","Type":"ContainerDied","Data":"2380cecdcac85c9b15089c8048779ec67af3c9f90bce0eb0fffd2722ef942646"} Jul 05 00:45:02.534968 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:02.534875 2561 scope.go:117] "RemoveContainer" containerID="2380cecdcac85c9b15089c8048779ec67af3c9f90bce0eb0fffd2722ef942646" Jul 05 00:45:02.535770 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:02.535741 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:45:02.535884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:02.535821 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:45:02.535884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:02.535853 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:45:03.541961 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:03.541923 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" event={"ID":"00542a2a-af3b-49a6-86df-9c6828c77769","Type":"ContainerStarted","Data":"3c7e80739f1ad4ccf528b2651a841cde5be37c8413a50d94b3eb6bfc382187a7"} Jul 05 00:45:04.058730 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:04.058692 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:45:04.059961 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:04.059935 2561 patch_prober.go:28] interesting pod/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 05 00:45:04.060033 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:04.059995 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" podUID="00542a2a-af3b-49a6-86df-9c6828c77769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 05 00:45:04.445178 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:04.445130 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:45:05.059372 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:05.059337 2561 patch_prober.go:28] interesting pod/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 05 00:45:05.059780 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:05.059393 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" podUID="00542a2a-af3b-49a6-86df-9c6828c77769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 05 00:45:06.059205 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:06.059167 2561 patch_prober.go:28] interesting pod/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 05 00:45:06.059390 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:06.059219 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" podUID="00542a2a-af3b-49a6-86df-9c6828c77769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 05 00:45:07.058951 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:07.058911 2561 patch_prober.go:28] interesting pod/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 05 00:45:07.059343 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:07.058970 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" podUID="00542a2a-af3b-49a6-86df-9c6828c77769" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 05 00:45:08.062981 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:08.062951 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:45:08.063889 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:08.063871 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:45:12.595970 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:12.595942 2561 generic.go:356] "Generic (PLEG): container finished" podID="18a442ea-7b61-4a6b-8629-9edc480ca574" containerID="2722b4e1d799fafd58427037e66314c63aa96866ccf81e83ccd0cde0b5b10d6e" exitCode=0 Jul 05 00:45:12.596301 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:12.596001 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" event={"ID":"18a442ea-7b61-4a6b-8629-9edc480ca574","Type":"ContainerDied","Data":"2722b4e1d799fafd58427037e66314c63aa96866ccf81e83ccd0cde0b5b10d6e"} Jul 05 00:45:12.596456 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:12.596440 2561 scope.go:117] "RemoveContainer" containerID="2722b4e1d799fafd58427037e66314c63aa96866ccf81e83ccd0cde0b5b10d6e" Jul 05 00:45:12.597494 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:12.597463 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:45:12.597572 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:12.597553 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:45:12.597611 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:12.597596 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:45:13.511430 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:13.511391 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:45:13.608126 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:13.608089 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" event={"ID":"18a442ea-7b61-4a6b-8629-9edc480ca574","Type":"ContainerStarted","Data":"e35f82148ba99d0eb3c456c1a9f74a7552975bf95c98722630dca2c01bb2b948"} Jul 05 00:45:13.934123 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:13.934079 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:45:13.935443 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:13.935415 2561 patch_prober.go:28] interesting pod/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 05 00:45:13.935549 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:13.935480 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" podUID="18a442ea-7b61-4a6b-8629-9edc480ca574" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 05 00:45:14.933767 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:14.933729 2561 patch_prober.go:28] interesting pod/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 05 00:45:14.934238 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:14.933784 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" podUID="18a442ea-7b61-4a6b-8629-9edc480ca574" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 05 00:45:15.934268 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:15.934230 2561 patch_prober.go:28] interesting pod/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 05 00:45:15.934652 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:15.934292 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" podUID="18a442ea-7b61-4a6b-8629-9edc480ca574" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 05 00:45:16.934352 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:16.934315 2561 patch_prober.go:28] interesting pod/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 05 00:45:16.934713 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:16.934370 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" podUID="18a442ea-7b61-4a6b-8629-9edc480ca574" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 05 00:45:17.937403 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:17.937368 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:45:17.937784 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:17.937725 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:45:17.938304 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:45:17.938287 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:48:03.529472 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:03.529389 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg"] Jul 05 00:48:03.529955 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:03.529660 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" podUID="00542a2a-af3b-49a6-86df-9c6828c77769" containerName="istio-proxy" containerID="cri-o://3c7e80739f1ad4ccf528b2651a841cde5be37c8413a50d94b3eb6bfc382187a7" gracePeriod=30 Jul 05 00:48:08.065606 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.065571 2561 patch_prober.go:28] interesting pod/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 05 00:48:08.066097 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.065636 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" podUID="00542a2a-af3b-49a6-86df-9c6828c77769" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 05 00:48:08.784152 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.784128 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:48:08.886330 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.886294 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00542a2a-af3b-49a6-86df-9c6828c77769-istiod-ca-cert\") pod \"00542a2a-af3b-49a6-86df-9c6828c77769\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " Jul 05 00:48:08.886483 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.886357 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-workload-socket\") pod \"00542a2a-af3b-49a6-86df-9c6828c77769\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " Jul 05 00:48:08.886483 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.886374 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-credential-socket\") pod \"00542a2a-af3b-49a6-86df-9c6828c77769\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " Jul 05 00:48:08.886483 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.886418 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-istio-data\") pod \"00542a2a-af3b-49a6-86df-9c6828c77769\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " Jul 05 00:48:08.886483 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.886470 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-istio-envoy\") pod \"00542a2a-af3b-49a6-86df-9c6828c77769\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " Jul 05 00:48:08.886722 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.886485 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpg7w\" (UniqueName: \"kubernetes.io/projected/00542a2a-af3b-49a6-86df-9c6828c77769-kube-api-access-vpg7w\") pod \"00542a2a-af3b-49a6-86df-9c6828c77769\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " Jul 05 00:48:08.886722 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.886503 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-workload-certs\") pod \"00542a2a-af3b-49a6-86df-9c6828c77769\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " Jul 05 00:48:08.886722 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.886520 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00542a2a-af3b-49a6-86df-9c6828c77769-istio-podinfo\") pod \"00542a2a-af3b-49a6-86df-9c6828c77769\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " Jul 05 00:48:08.886722 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.886536 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00542a2a-af3b-49a6-86df-9c6828c77769-istio-token\") pod \"00542a2a-af3b-49a6-86df-9c6828c77769\" (UID: \"00542a2a-af3b-49a6-86df-9c6828c77769\") " Jul 05 00:48:08.886722 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.886575 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "00542a2a-af3b-49a6-86df-9c6828c77769" (UID: "00542a2a-af3b-49a6-86df-9c6828c77769"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:48:08.887048 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.886725 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "00542a2a-af3b-49a6-86df-9c6828c77769" (UID: "00542a2a-af3b-49a6-86df-9c6828c77769"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:48:08.887048 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.886764 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00542a2a-af3b-49a6-86df-9c6828c77769-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "00542a2a-af3b-49a6-86df-9c6828c77769" (UID: "00542a2a-af3b-49a6-86df-9c6828c77769"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:48:08.887048 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.886882 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "00542a2a-af3b-49a6-86df-9c6828c77769" (UID: "00542a2a-af3b-49a6-86df-9c6828c77769"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:48:08.887048 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.886943 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-workload-socket\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:08.887048 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.886964 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-credential-socket\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:08.887048 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.886979 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00542a2a-af3b-49a6-86df-9c6828c77769-istiod-ca-cert\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:08.887528 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.887506 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-istio-data" (OuterVolumeSpecName: "istio-data") pod "00542a2a-af3b-49a6-86df-9c6828c77769" (UID: "00542a2a-af3b-49a6-86df-9c6828c77769"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:48:08.888651 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.888623 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "00542a2a-af3b-49a6-86df-9c6828c77769" (UID: "00542a2a-af3b-49a6-86df-9c6828c77769"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:48:08.888842 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.888818 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/00542a2a-af3b-49a6-86df-9c6828c77769-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "00542a2a-af3b-49a6-86df-9c6828c77769" (UID: "00542a2a-af3b-49a6-86df-9c6828c77769"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 00:48:08.889164 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.889145 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00542a2a-af3b-49a6-86df-9c6828c77769-kube-api-access-vpg7w" (OuterVolumeSpecName: "kube-api-access-vpg7w") pod "00542a2a-af3b-49a6-86df-9c6828c77769" (UID: "00542a2a-af3b-49a6-86df-9c6828c77769"). InnerVolumeSpecName "kube-api-access-vpg7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:48:08.889213 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.889168 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00542a2a-af3b-49a6-86df-9c6828c77769-istio-token" (OuterVolumeSpecName: "istio-token") pod "00542a2a-af3b-49a6-86df-9c6828c77769" (UID: "00542a2a-af3b-49a6-86df-9c6828c77769"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:48:08.988158 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.988131 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-istio-envoy\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:08.988158 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.988156 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpg7w\" (UniqueName: \"kubernetes.io/projected/00542a2a-af3b-49a6-86df-9c6828c77769-kube-api-access-vpg7w\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:08.988311 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.988167 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-workload-certs\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:08.988311 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.988175 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00542a2a-af3b-49a6-86df-9c6828c77769-istio-podinfo\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:08.988311 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.988183 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00542a2a-af3b-49a6-86df-9c6828c77769-istio-token\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:08.988311 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:08.988190 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00542a2a-af3b-49a6-86df-9c6828c77769-istio-data\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:09.599963 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:09.599933 2561 generic.go:356] "Generic (PLEG): container finished" podID="00542a2a-af3b-49a6-86df-9c6828c77769" containerID="3c7e80739f1ad4ccf528b2651a841cde5be37c8413a50d94b3eb6bfc382187a7" exitCode=0 Jul 05 00:48:09.600401 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:09.599980 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" Jul 05 00:48:09.600401 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:09.599988 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" event={"ID":"00542a2a-af3b-49a6-86df-9c6828c77769","Type":"ContainerDied","Data":"3c7e80739f1ad4ccf528b2651a841cde5be37c8413a50d94b3eb6bfc382187a7"} Jul 05 00:48:09.600401 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:09.600035 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg" event={"ID":"00542a2a-af3b-49a6-86df-9c6828c77769","Type":"ContainerDied","Data":"a36471e3d70751a04b03685c12d66c3b88b34b2ab568c6199415f76ecb05fdde"} Jul 05 00:48:09.600401 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:09.600056 2561 scope.go:117] "RemoveContainer" containerID="3c7e80739f1ad4ccf528b2651a841cde5be37c8413a50d94b3eb6bfc382187a7" Jul 05 00:48:09.609916 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:09.609898 2561 scope.go:117] "RemoveContainer" containerID="2380cecdcac85c9b15089c8048779ec67af3c9f90bce0eb0fffd2722ef942646" Jul 05 00:48:09.617898 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:09.617884 2561 scope.go:117] "RemoveContainer" containerID="3c7e80739f1ad4ccf528b2651a841cde5be37c8413a50d94b3eb6bfc382187a7" Jul 05 00:48:09.618109 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:48:09.618092 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c7e80739f1ad4ccf528b2651a841cde5be37c8413a50d94b3eb6bfc382187a7\": container with ID starting with 3c7e80739f1ad4ccf528b2651a841cde5be37c8413a50d94b3eb6bfc382187a7 not found: ID does not exist" containerID="3c7e80739f1ad4ccf528b2651a841cde5be37c8413a50d94b3eb6bfc382187a7" Jul 05 00:48:09.618147 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:09.618117 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c7e80739f1ad4ccf528b2651a841cde5be37c8413a50d94b3eb6bfc382187a7"} err="failed to get container status \"3c7e80739f1ad4ccf528b2651a841cde5be37c8413a50d94b3eb6bfc382187a7\": rpc error: code = NotFound desc = could not find container \"3c7e80739f1ad4ccf528b2651a841cde5be37c8413a50d94b3eb6bfc382187a7\": container with ID starting with 3c7e80739f1ad4ccf528b2651a841cde5be37c8413a50d94b3eb6bfc382187a7 not found: ID does not exist" Jul 05 00:48:09.618147 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:09.618132 2561 scope.go:117] "RemoveContainer" containerID="2380cecdcac85c9b15089c8048779ec67af3c9f90bce0eb0fffd2722ef942646" Jul 05 00:48:09.618431 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:48:09.618410 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2380cecdcac85c9b15089c8048779ec67af3c9f90bce0eb0fffd2722ef942646\": container with ID starting with 2380cecdcac85c9b15089c8048779ec67af3c9f90bce0eb0fffd2722ef942646 not found: ID does not exist" containerID="2380cecdcac85c9b15089c8048779ec67af3c9f90bce0eb0fffd2722ef942646" Jul 05 00:48:09.618569 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:09.618433 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2380cecdcac85c9b15089c8048779ec67af3c9f90bce0eb0fffd2722ef942646"} err="failed to get container status \"2380cecdcac85c9b15089c8048779ec67af3c9f90bce0eb0fffd2722ef942646\": rpc error: code = NotFound desc = could not find container \"2380cecdcac85c9b15089c8048779ec67af3c9f90bce0eb0fffd2722ef942646\": container with ID starting with 2380cecdcac85c9b15089c8048779ec67af3c9f90bce0eb0fffd2722ef942646 not found: ID does not exist" Jul 05 00:48:09.621706 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:09.621684 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg"] Jul 05 00:48:09.625606 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:09.625583 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-4e7441-openshift-default-6cbfb9b48c-r56rg"] Jul 05 00:48:09.777730 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:09.777702 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00542a2a-af3b-49a6-86df-9c6828c77769" path="/var/lib/kubelet/pods/00542a2a-af3b-49a6-86df-9c6828c77769/volumes" Jul 05 00:48:10.268636 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:10.268602 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn"] Jul 05 00:48:10.268839 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:10.268811 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" podUID="18a442ea-7b61-4a6b-8629-9edc480ca574" containerName="istio-proxy" containerID="cri-o://e35f82148ba99d0eb3c456c1a9f74a7552975bf95c98722630dca2c01bb2b948" gracePeriod=30 Jul 05 00:48:15.528096 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.528072 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:48:15.634420 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.634387 2561 generic.go:356] "Generic (PLEG): container finished" podID="18a442ea-7b61-4a6b-8629-9edc480ca574" containerID="e35f82148ba99d0eb3c456c1a9f74a7552975bf95c98722630dca2c01bb2b948" exitCode=0 Jul 05 00:48:15.634563 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.634439 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" Jul 05 00:48:15.634563 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.634462 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" event={"ID":"18a442ea-7b61-4a6b-8629-9edc480ca574","Type":"ContainerDied","Data":"e35f82148ba99d0eb3c456c1a9f74a7552975bf95c98722630dca2c01bb2b948"} Jul 05 00:48:15.634563 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.634509 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn" event={"ID":"18a442ea-7b61-4a6b-8629-9edc480ca574","Type":"ContainerDied","Data":"dee2f2dc9c891b56191453629d544a0f0ca02bd83ca222af53ffa91e6009727d"} Jul 05 00:48:15.634563 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.634531 2561 scope.go:117] "RemoveContainer" containerID="e35f82148ba99d0eb3c456c1a9f74a7552975bf95c98722630dca2c01bb2b948" Jul 05 00:48:15.643570 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.643538 2561 scope.go:117] "RemoveContainer" containerID="2722b4e1d799fafd58427037e66314c63aa96866ccf81e83ccd0cde0b5b10d6e" Jul 05 00:48:15.645973 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.645950 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-workload-certs\") pod \"18a442ea-7b61-4a6b-8629-9edc480ca574\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " Jul 05 00:48:15.646083 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.645993 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-token\") pod \"18a442ea-7b61-4a6b-8629-9edc480ca574\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " Jul 05 00:48:15.646083 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.646027 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18a442ea-7b61-4a6b-8629-9edc480ca574-istiod-ca-cert\") pod \"18a442ea-7b61-4a6b-8629-9edc480ca574\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " Jul 05 00:48:15.646083 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.646059 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-envoy\") pod \"18a442ea-7b61-4a6b-8629-9edc480ca574\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " Jul 05 00:48:15.646300 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.646255 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "18a442ea-7b61-4a6b-8629-9edc480ca574" (UID: "18a442ea-7b61-4a6b-8629-9edc480ca574"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:48:15.647666 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.646468 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsljs\" (UniqueName: \"kubernetes.io/projected/18a442ea-7b61-4a6b-8629-9edc480ca574-kube-api-access-zsljs\") pod \"18a442ea-7b61-4a6b-8629-9edc480ca574\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " Jul 05 00:48:15.647666 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.646529 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-data\") pod \"18a442ea-7b61-4a6b-8629-9edc480ca574\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " Jul 05 00:48:15.647666 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.646606 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-podinfo\") pod \"18a442ea-7b61-4a6b-8629-9edc480ca574\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " Jul 05 00:48:15.647666 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.646640 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-credential-socket\") pod \"18a442ea-7b61-4a6b-8629-9edc480ca574\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " Jul 05 00:48:15.647666 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.646694 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-workload-socket\") pod \"18a442ea-7b61-4a6b-8629-9edc480ca574\" (UID: \"18a442ea-7b61-4a6b-8629-9edc480ca574\") " Jul 05 00:48:15.647666 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.646716 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a442ea-7b61-4a6b-8629-9edc480ca574-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "18a442ea-7b61-4a6b-8629-9edc480ca574" (UID: "18a442ea-7b61-4a6b-8629-9edc480ca574"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:48:15.647666 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.647041 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-workload-certs\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:15.647666 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.647061 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18a442ea-7b61-4a6b-8629-9edc480ca574-istiod-ca-cert\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:15.647666 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.647254 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "18a442ea-7b61-4a6b-8629-9edc480ca574" (UID: "18a442ea-7b61-4a6b-8629-9edc480ca574"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:48:15.647666 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.647423 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "18a442ea-7b61-4a6b-8629-9edc480ca574" (UID: "18a442ea-7b61-4a6b-8629-9edc480ca574"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:48:15.648386 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.648356 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-data" (OuterVolumeSpecName: "istio-data") pod "18a442ea-7b61-4a6b-8629-9edc480ca574" (UID: "18a442ea-7b61-4a6b-8629-9edc480ca574"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:48:15.648881 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.648857 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-token" (OuterVolumeSpecName: "istio-token") pod "18a442ea-7b61-4a6b-8629-9edc480ca574" (UID: "18a442ea-7b61-4a6b-8629-9edc480ca574"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:48:15.649022 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.648999 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "18a442ea-7b61-4a6b-8629-9edc480ca574" (UID: "18a442ea-7b61-4a6b-8629-9edc480ca574"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:48:15.649966 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.649944 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "18a442ea-7b61-4a6b-8629-9edc480ca574" (UID: "18a442ea-7b61-4a6b-8629-9edc480ca574"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 00:48:15.650455 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.650430 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18a442ea-7b61-4a6b-8629-9edc480ca574-kube-api-access-zsljs" (OuterVolumeSpecName: "kube-api-access-zsljs") pod "18a442ea-7b61-4a6b-8629-9edc480ca574" (UID: "18a442ea-7b61-4a6b-8629-9edc480ca574"). InnerVolumeSpecName "kube-api-access-zsljs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:48:15.654547 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.654526 2561 scope.go:117] "RemoveContainer" containerID="e35f82148ba99d0eb3c456c1a9f74a7552975bf95c98722630dca2c01bb2b948" Jul 05 00:48:15.654870 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:48:15.654853 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e35f82148ba99d0eb3c456c1a9f74a7552975bf95c98722630dca2c01bb2b948\": container with ID starting with e35f82148ba99d0eb3c456c1a9f74a7552975bf95c98722630dca2c01bb2b948 not found: ID does not exist" containerID="e35f82148ba99d0eb3c456c1a9f74a7552975bf95c98722630dca2c01bb2b948" Jul 05 00:48:15.654970 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.654880 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e35f82148ba99d0eb3c456c1a9f74a7552975bf95c98722630dca2c01bb2b948"} err="failed to get container status \"e35f82148ba99d0eb3c456c1a9f74a7552975bf95c98722630dca2c01bb2b948\": rpc error: code = NotFound desc = could not find container \"e35f82148ba99d0eb3c456c1a9f74a7552975bf95c98722630dca2c01bb2b948\": container with ID starting with e35f82148ba99d0eb3c456c1a9f74a7552975bf95c98722630dca2c01bb2b948 not found: ID does not exist" Jul 05 00:48:15.654970 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.654903 2561 scope.go:117] "RemoveContainer" containerID="2722b4e1d799fafd58427037e66314c63aa96866ccf81e83ccd0cde0b5b10d6e" Jul 05 00:48:15.655168 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:48:15.655150 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2722b4e1d799fafd58427037e66314c63aa96866ccf81e83ccd0cde0b5b10d6e\": container with ID starting with 2722b4e1d799fafd58427037e66314c63aa96866ccf81e83ccd0cde0b5b10d6e not found: ID does not exist" containerID="2722b4e1d799fafd58427037e66314c63aa96866ccf81e83ccd0cde0b5b10d6e" Jul 05 00:48:15.655223 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.655175 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2722b4e1d799fafd58427037e66314c63aa96866ccf81e83ccd0cde0b5b10d6e"} err="failed to get container status \"2722b4e1d799fafd58427037e66314c63aa96866ccf81e83ccd0cde0b5b10d6e\": rpc error: code = NotFound desc = could not find container \"2722b4e1d799fafd58427037e66314c63aa96866ccf81e83ccd0cde0b5b10d6e\": container with ID starting with 2722b4e1d799fafd58427037e66314c63aa96866ccf81e83ccd0cde0b5b10d6e not found: ID does not exist" Jul 05 00:48:15.747464 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.747441 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-podinfo\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:15.747464 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.747462 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-credential-socket\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:15.747570 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.747471 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-workload-socket\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:15.747570 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.747480 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-token\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:15.747570 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.747489 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-envoy\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:15.747570 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.747499 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsljs\" (UniqueName: \"kubernetes.io/projected/18a442ea-7b61-4a6b-8629-9edc480ca574-kube-api-access-zsljs\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:15.747570 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.747508 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18a442ea-7b61-4a6b-8629-9edc480ca574-istio-data\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:15.950698 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.950624 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn"] Jul 05 00:48:15.953896 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:15.953873 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-11db4a-openshift-default-7b974dbcbf-rjlwn"] Jul 05 00:48:17.776735 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:17.776695 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18a442ea-7b61-4a6b-8629-9edc480ca574" path="/var/lib/kubelet/pods/18a442ea-7b61-4a6b-8629-9edc480ca574/volumes" Jul 05 00:48:19.351652 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.351618 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x"] Jul 05 00:48:19.352065 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.352049 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00542a2a-af3b-49a6-86df-9c6828c77769" containerName="istio-proxy" Jul 05 00:48:19.352065 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.352066 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="00542a2a-af3b-49a6-86df-9c6828c77769" containerName="istio-proxy" Jul 05 00:48:19.352154 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.352093 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18a442ea-7b61-4a6b-8629-9edc480ca574" containerName="istio-proxy" Jul 05 00:48:19.352154 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.352099 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="18a442ea-7b61-4a6b-8629-9edc480ca574" containerName="istio-proxy" Jul 05 00:48:19.352154 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.352106 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18a442ea-7b61-4a6b-8629-9edc480ca574" containerName="istio-proxy" Jul 05 00:48:19.352154 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.352112 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="18a442ea-7b61-4a6b-8629-9edc480ca574" containerName="istio-proxy" Jul 05 00:48:19.352306 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.352165 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="00542a2a-af3b-49a6-86df-9c6828c77769" containerName="istio-proxy" Jul 05 00:48:19.352306 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.352174 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="00542a2a-af3b-49a6-86df-9c6828c77769" containerName="istio-proxy" Jul 05 00:48:19.352306 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.352181 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="18a442ea-7b61-4a6b-8629-9edc480ca574" containerName="istio-proxy" Jul 05 00:48:19.352306 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.352187 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="18a442ea-7b61-4a6b-8629-9edc480ca574" containerName="istio-proxy" Jul 05 00:48:19.356773 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.356752 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.359255 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.359233 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-5e8d9c-openshift-default-dockercfg-5rjwd\"" Jul 05 00:48:19.366960 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.366932 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x"] Jul 05 00:48:19.476651 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.476620 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-workload-socket\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.476853 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.476662 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-token\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.476853 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.476703 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgs4r\" (UniqueName: \"kubernetes.io/projected/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-kube-api-access-sgs4r\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.476853 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.476735 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-envoy\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.476853 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.476767 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-workload-certs\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.477016 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.476841 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istiod-ca-cert\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.477016 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.476890 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-podinfo\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.477016 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.476989 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-data\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.477126 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.477018 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-credential-socket\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.577835 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.577788 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-envoy\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.577986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.577839 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-workload-certs\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.577986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.577863 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istiod-ca-cert\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.577986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.577881 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-podinfo\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.577986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.577947 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-data\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.577986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.577968 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-credential-socket\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.577986 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.577986 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-workload-socket\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.578315 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.578010 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-token\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.578315 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.578050 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgs4r\" (UniqueName: \"kubernetes.io/projected/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-kube-api-access-sgs4r\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.578315 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.578276 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-workload-certs\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.578473 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.578398 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-data\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.578535 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.578518 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-workload-socket\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.578716 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.578693 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istiod-ca-cert\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.578832 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.578703 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-credential-socket\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.580605 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.580584 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-envoy\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.580921 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.580901 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-podinfo\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.586416 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.586370 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-token\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.586970 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.586947 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgs4r\" (UniqueName: \"kubernetes.io/projected/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-kube-api-access-sgs4r\") pod \"e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.668263 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.668199 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:19.811836 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.811808 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x"] Jul 05 00:48:19.813163 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:48:19.813138 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80d43fc0_fc43_4afa_9499_0fdd3901cdc8.slice/crio-83809b02d51821b510c1653e25d8142721a5ec57cf037fb9629e525629c506c7 WatchSource:0}: Error finding container 83809b02d51821b510c1653e25d8142721a5ec57cf037fb9629e525629c506c7: Status 404 returned error can't find the container with id 83809b02d51821b510c1653e25d8142721a5ec57cf037fb9629e525629c506c7 Jul 05 00:48:19.815227 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.815195 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:48:19.815305 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.815258 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:48:19.815305 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:19.815286 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:48:20.664752 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:20.664715 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" event={"ID":"80d43fc0-fc43-4afa-9499-0fdd3901cdc8","Type":"ContainerStarted","Data":"23ee54480cc61f728384acc7994d9b29deafcd2f726fd53f7b3ca5196363b02b"} Jul 05 00:48:20.665187 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:20.664779 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" event={"ID":"80d43fc0-fc43-4afa-9499-0fdd3901cdc8","Type":"ContainerStarted","Data":"83809b02d51821b510c1653e25d8142721a5ec57cf037fb9629e525629c506c7"} Jul 05 00:48:20.668678 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:20.668649 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:20.673532 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:20.673510 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:20.683872 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:20.683823 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" podStartSLOduration=1.683787581 podStartE2EDuration="1.683787581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:48:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:48:20.682819374 +0000 UTC m=+2371.407835428" watchObservedRunningTime="2026-07-05 00:48:20.683787581 +0000 UTC m=+2371.408803640" Jul 05 00:48:21.670530 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:21.670500 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:21.671552 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:21.671532 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:35.752244 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:35.752173 2561 generic.go:356] "Generic (PLEG): container finished" podID="80d43fc0-fc43-4afa-9499-0fdd3901cdc8" containerID="23ee54480cc61f728384acc7994d9b29deafcd2f726fd53f7b3ca5196363b02b" exitCode=0 Jul 05 00:48:35.752656 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:35.752247 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" event={"ID":"80d43fc0-fc43-4afa-9499-0fdd3901cdc8","Type":"ContainerDied","Data":"23ee54480cc61f728384acc7994d9b29deafcd2f726fd53f7b3ca5196363b02b"} Jul 05 00:48:35.752656 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:35.752619 2561 scope.go:117] "RemoveContainer" containerID="23ee54480cc61f728384acc7994d9b29deafcd2f726fd53f7b3ca5196363b02b" Jul 05 00:48:35.753626 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:35.753599 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:48:35.753678 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:35.753666 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:48:35.753719 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:35.753696 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:48:36.670919 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:36.670883 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:36.759989 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:36.759953 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" event={"ID":"80d43fc0-fc43-4afa-9499-0fdd3901cdc8","Type":"ContainerStarted","Data":"0ae9865e1c997903f48a3caa62d10e634db4cb17e984bc86e3f6a5f53b5ef849"} Jul 05 00:48:37.668552 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:37.668514 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:37.669694 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:37.669671 2561 patch_prober.go:28] interesting pod/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 05 00:48:37.669756 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:37.669732 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" podUID="80d43fc0-fc43-4afa-9499-0fdd3901cdc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 05 00:48:38.668713 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:38.668672 2561 patch_prober.go:28] interesting pod/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 05 00:48:38.669152 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:38.668741 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" podUID="80d43fc0-fc43-4afa-9499-0fdd3901cdc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 05 00:48:39.668657 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:39.668620 2561 patch_prober.go:28] interesting pod/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 05 00:48:39.668918 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:39.668679 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" podUID="80d43fc0-fc43-4afa-9499-0fdd3901cdc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 05 00:48:40.672276 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:40.672244 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:40.672683 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:40.672490 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:40.673143 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:40.673125 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:48.496867 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:48.496832 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x"] Jul 05 00:48:48.497295 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:48.497031 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" podUID="80d43fc0-fc43-4afa-9499-0fdd3901cdc8" containerName="istio-proxy" containerID="cri-o://0ae9865e1c997903f48a3caa62d10e634db4cb17e984bc86e3f6a5f53b5ef849" gracePeriod=30 Jul 05 00:48:49.948534 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:49.948502 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/1.log" Jul 05 00:48:49.962028 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:49.962006 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/1.log" Jul 05 00:48:53.749909 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.749886 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:53.858891 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.858863 2561 generic.go:356] "Generic (PLEG): container finished" podID="80d43fc0-fc43-4afa-9499-0fdd3901cdc8" containerID="0ae9865e1c997903f48a3caa62d10e634db4cb17e984bc86e3f6a5f53b5ef849" exitCode=0 Jul 05 00:48:53.859071 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.858907 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" Jul 05 00:48:53.859071 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.858952 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" event={"ID":"80d43fc0-fc43-4afa-9499-0fdd3901cdc8","Type":"ContainerDied","Data":"0ae9865e1c997903f48a3caa62d10e634db4cb17e984bc86e3f6a5f53b5ef849"} Jul 05 00:48:53.859071 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.859010 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x" event={"ID":"80d43fc0-fc43-4afa-9499-0fdd3901cdc8","Type":"ContainerDied","Data":"83809b02d51821b510c1653e25d8142721a5ec57cf037fb9629e525629c506c7"} Jul 05 00:48:53.859071 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.859038 2561 scope.go:117] "RemoveContainer" containerID="0ae9865e1c997903f48a3caa62d10e634db4cb17e984bc86e3f6a5f53b5ef849" Jul 05 00:48:53.867731 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.867713 2561 scope.go:117] "RemoveContainer" containerID="23ee54480cc61f728384acc7994d9b29deafcd2f726fd53f7b3ca5196363b02b" Jul 05 00:48:53.875747 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.875730 2561 scope.go:117] "RemoveContainer" containerID="0ae9865e1c997903f48a3caa62d10e634db4cb17e984bc86e3f6a5f53b5ef849" Jul 05 00:48:53.876011 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:48:53.875991 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ae9865e1c997903f48a3caa62d10e634db4cb17e984bc86e3f6a5f53b5ef849\": container with ID starting with 0ae9865e1c997903f48a3caa62d10e634db4cb17e984bc86e3f6a5f53b5ef849 not found: ID does not exist" containerID="0ae9865e1c997903f48a3caa62d10e634db4cb17e984bc86e3f6a5f53b5ef849" Jul 05 00:48:53.876096 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.876018 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ae9865e1c997903f48a3caa62d10e634db4cb17e984bc86e3f6a5f53b5ef849"} err="failed to get container status \"0ae9865e1c997903f48a3caa62d10e634db4cb17e984bc86e3f6a5f53b5ef849\": rpc error: code = NotFound desc = could not find container \"0ae9865e1c997903f48a3caa62d10e634db4cb17e984bc86e3f6a5f53b5ef849\": container with ID starting with 0ae9865e1c997903f48a3caa62d10e634db4cb17e984bc86e3f6a5f53b5ef849 not found: ID does not exist" Jul 05 00:48:53.876096 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.876034 2561 scope.go:117] "RemoveContainer" containerID="23ee54480cc61f728384acc7994d9b29deafcd2f726fd53f7b3ca5196363b02b" Jul 05 00:48:53.876324 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:48:53.876301 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23ee54480cc61f728384acc7994d9b29deafcd2f726fd53f7b3ca5196363b02b\": container with ID starting with 23ee54480cc61f728384acc7994d9b29deafcd2f726fd53f7b3ca5196363b02b not found: ID does not exist" containerID="23ee54480cc61f728384acc7994d9b29deafcd2f726fd53f7b3ca5196363b02b" Jul 05 00:48:53.876377 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.876334 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23ee54480cc61f728384acc7994d9b29deafcd2f726fd53f7b3ca5196363b02b"} err="failed to get container status \"23ee54480cc61f728384acc7994d9b29deafcd2f726fd53f7b3ca5196363b02b\": rpc error: code = NotFound desc = could not find container \"23ee54480cc61f728384acc7994d9b29deafcd2f726fd53f7b3ca5196363b02b\": container with ID starting with 23ee54480cc61f728384acc7994d9b29deafcd2f726fd53f7b3ca5196363b02b not found: ID does not exist" Jul 05 00:48:53.886590 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.886572 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgs4r\" (UniqueName: \"kubernetes.io/projected/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-kube-api-access-sgs4r\") pod \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " Jul 05 00:48:53.886678 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.886625 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-envoy\") pod \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " Jul 05 00:48:53.886678 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.886646 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istiod-ca-cert\") pod \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " Jul 05 00:48:53.886678 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.886662 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-data\") pod \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " Jul 05 00:48:53.886860 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.886696 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-token\") pod \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " Jul 05 00:48:53.886860 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.886714 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-credential-socket\") pod \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " Jul 05 00:48:53.886860 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.886756 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-podinfo\") pod \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " Jul 05 00:48:53.886860 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.886812 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-workload-socket\") pod \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " Jul 05 00:48:53.887068 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.886863 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-workload-certs\") pod \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\" (UID: \"80d43fc0-fc43-4afa-9499-0fdd3901cdc8\") " Jul 05 00:48:53.887123 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.887096 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "80d43fc0-fc43-4afa-9499-0fdd3901cdc8" (UID: "80d43fc0-fc43-4afa-9499-0fdd3901cdc8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:48:53.887178 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.887138 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "80d43fc0-fc43-4afa-9499-0fdd3901cdc8" (UID: "80d43fc0-fc43-4afa-9499-0fdd3901cdc8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:48:53.887313 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.887281 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istiod-ca-cert\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:53.887313 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.887303 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-credential-socket\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:53.887646 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.887609 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "80d43fc0-fc43-4afa-9499-0fdd3901cdc8" (UID: "80d43fc0-fc43-4afa-9499-0fdd3901cdc8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:48:53.887646 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.887631 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-data" (OuterVolumeSpecName: "istio-data") pod "80d43fc0-fc43-4afa-9499-0fdd3901cdc8" (UID: "80d43fc0-fc43-4afa-9499-0fdd3901cdc8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:48:53.887841 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.887822 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "80d43fc0-fc43-4afa-9499-0fdd3901cdc8" (UID: "80d43fc0-fc43-4afa-9499-0fdd3901cdc8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:48:53.889443 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.889421 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "80d43fc0-fc43-4afa-9499-0fdd3901cdc8" (UID: "80d43fc0-fc43-4afa-9499-0fdd3901cdc8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:48:53.889549 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.889528 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-kube-api-access-sgs4r" (OuterVolumeSpecName: "kube-api-access-sgs4r") pod "80d43fc0-fc43-4afa-9499-0fdd3901cdc8" (UID: "80d43fc0-fc43-4afa-9499-0fdd3901cdc8"). InnerVolumeSpecName "kube-api-access-sgs4r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:48:53.889670 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.889650 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "80d43fc0-fc43-4afa-9499-0fdd3901cdc8" (UID: "80d43fc0-fc43-4afa-9499-0fdd3901cdc8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 00:48:53.891011 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.890991 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-token" (OuterVolumeSpecName: "istio-token") pod "80d43fc0-fc43-4afa-9499-0fdd3901cdc8" (UID: "80d43fc0-fc43-4afa-9499-0fdd3901cdc8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:48:53.987868 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.987839 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-podinfo\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:53.987868 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.987866 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-workload-socket\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:53.988039 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.987879 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-workload-certs\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:53.988039 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.987892 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgs4r\" (UniqueName: \"kubernetes.io/projected/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-kube-api-access-sgs4r\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:53.988039 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.987905 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-envoy\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:53.988039 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.987915 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-data\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:53.988039 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:53.987926 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80d43fc0-fc43-4afa-9499-0fdd3901cdc8-istio-token\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:48:54.182012 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:54.181975 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x"] Jul 05 00:48:54.184672 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:54.184645 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-5e8d9c-openshift-default-64df7cd585-rmj2x"] Jul 05 00:48:55.778592 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:55.778552 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80d43fc0-fc43-4afa-9499-0fdd3901cdc8" path="/var/lib/kubelet/pods/80d43fc0-fc43-4afa-9499-0fdd3901cdc8/volumes" Jul 05 00:48:57.355418 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.355377 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf"] Jul 05 00:48:57.355886 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.355758 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80d43fc0-fc43-4afa-9499-0fdd3901cdc8" containerName="istio-proxy" Jul 05 00:48:57.355886 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.355770 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="80d43fc0-fc43-4afa-9499-0fdd3901cdc8" containerName="istio-proxy" Jul 05 00:48:57.355886 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.355781 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80d43fc0-fc43-4afa-9499-0fdd3901cdc8" containerName="istio-proxy" Jul 05 00:48:57.355886 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.355787 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="80d43fc0-fc43-4afa-9499-0fdd3901cdc8" containerName="istio-proxy" Jul 05 00:48:57.355886 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.355841 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00542a2a-af3b-49a6-86df-9c6828c77769" containerName="istio-proxy" Jul 05 00:48:57.355886 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.355848 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="00542a2a-af3b-49a6-86df-9c6828c77769" containerName="istio-proxy" Jul 05 00:48:57.356234 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.355921 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="80d43fc0-fc43-4afa-9499-0fdd3901cdc8" containerName="istio-proxy" Jul 05 00:48:57.356234 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.355930 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="80d43fc0-fc43-4afa-9499-0fdd3901cdc8" containerName="istio-proxy" Jul 05 00:48:57.359108 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.359087 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.361890 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.361872 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-1a1f49-openshift-default-dockercfg-bc442\"" Jul 05 00:48:57.371387 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.371365 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf"] Jul 05 00:48:57.516675 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.516640 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-workload-certs\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.516894 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.516700 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a6ce4e-c884-4276-995a-52d231c16344-istiod-ca-cert\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.516894 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.516826 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a6ce4e-c884-4276-995a-52d231c16344-istio-token\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.516894 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.516865 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-workload-socket\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.517075 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.516895 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-istio-envoy\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.517075 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.516930 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-credential-socket\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.517075 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.516979 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a6ce4e-c884-4276-995a-52d231c16344-istio-podinfo\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.517075 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.517042 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch2z7\" (UniqueName: \"kubernetes.io/projected/56a6ce4e-c884-4276-995a-52d231c16344-kube-api-access-ch2z7\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.517287 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.517093 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-istio-data\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.618394 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.618315 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a6ce4e-c884-4276-995a-52d231c16344-istio-podinfo\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.618394 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.618355 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch2z7\" (UniqueName: \"kubernetes.io/projected/56a6ce4e-c884-4276-995a-52d231c16344-kube-api-access-ch2z7\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.618394 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.618380 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-istio-data\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.618655 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.618419 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-workload-certs\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.618655 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.618451 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a6ce4e-c884-4276-995a-52d231c16344-istiod-ca-cert\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.618655 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.618519 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a6ce4e-c884-4276-995a-52d231c16344-istio-token\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.618655 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.618546 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-workload-socket\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.618655 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.618573 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-istio-envoy\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.618958 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.618816 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-credential-socket\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.618958 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.618909 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-istio-data\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.619096 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.619074 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-workload-certs\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.619172 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.619153 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-workload-socket\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.619302 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.619276 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-credential-socket\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.619456 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.619433 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a6ce4e-c884-4276-995a-52d231c16344-istiod-ca-cert\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.620983 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.620949 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-istio-envoy\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.621128 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.621095 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a6ce4e-c884-4276-995a-52d231c16344-istio-podinfo\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.626019 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.625998 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a6ce4e-c884-4276-995a-52d231c16344-istio-token\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.626243 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.626223 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch2z7\" (UniqueName: \"kubernetes.io/projected/56a6ce4e-c884-4276-995a-52d231c16344-kube-api-access-ch2z7\") pod \"e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.670556 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.670533 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:57.825210 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.825179 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf"] Jul 05 00:48:57.826320 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:48:57.826290 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56a6ce4e_c884_4276_995a_52d231c16344.slice/crio-379551421ae973515a40fb2407e66743679b0782ebd7176a6ec9432223183f48 WatchSource:0}: Error finding container 379551421ae973515a40fb2407e66743679b0782ebd7176a6ec9432223183f48: Status 404 returned error can't find the container with id 379551421ae973515a40fb2407e66743679b0782ebd7176a6ec9432223183f48 Jul 05 00:48:57.828475 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.828439 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:48:57.828580 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.828501 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:48:57.828580 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.828527 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:48:57.885651 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.885620 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" event={"ID":"56a6ce4e-c884-4276-995a-52d231c16344","Type":"ContainerStarted","Data":"379551421ae973515a40fb2407e66743679b0782ebd7176a6ec9432223183f48"} Jul 05 00:48:57.905988 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:57.905945 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" podStartSLOduration=0.905926627 podStartE2EDuration="905.926627ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:48:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:48:57.904222693 +0000 UTC m=+2408.629238751" watchObservedRunningTime="2026-07-05 00:48:57.905926627 +0000 UTC m=+2408.630942686" Jul 05 00:48:58.671139 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:58.671103 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:58.676451 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:58.676422 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:58.892592 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:58.892551 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" event={"ID":"56a6ce4e-c884-4276-995a-52d231c16344","Type":"ContainerStarted","Data":"3de7ea46bac6f33bc1432bef2d712b784d2fa227ae1adf18960febdc0d873a6b"} Jul 05 00:48:58.892779 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:58.892622 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:48:58.893584 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:48:58.893564 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:49:13.894087 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:49:13.894050 2561 patch_prober.go:28] interesting pod/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 05 00:49:13.894487 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:49:13.894116 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" podUID="56a6ce4e-c884-4276-995a-52d231c16344" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 05 00:49:13.981883 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:49:13.981853 2561 generic.go:356] "Generic (PLEG): container finished" podID="56a6ce4e-c884-4276-995a-52d231c16344" containerID="3de7ea46bac6f33bc1432bef2d712b784d2fa227ae1adf18960febdc0d873a6b" exitCode=0 Jul 05 00:49:13.982046 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:49:13.981933 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" event={"ID":"56a6ce4e-c884-4276-995a-52d231c16344","Type":"ContainerDied","Data":"3de7ea46bac6f33bc1432bef2d712b784d2fa227ae1adf18960febdc0d873a6b"} Jul 05 00:49:13.982449 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:49:13.982433 2561 scope.go:117] "RemoveContainer" containerID="3de7ea46bac6f33bc1432bef2d712b784d2fa227ae1adf18960febdc0d873a6b" Jul 05 00:49:13.983468 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:49:13.983440 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:49:13.983563 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:49:13.983504 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:49:13.983563 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:49:13.983541 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 05 00:49:14.993061 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:49:14.993022 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" event={"ID":"56a6ce4e-c884-4276-995a-52d231c16344","Type":"ContainerStarted","Data":"0d7674355051a673d8db6233e1c3f6faff04ab0e543a16d043f2048a7c229db2"} Jul 05 00:49:15.670940 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:49:15.670902 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:49:15.671108 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:49:15.671089 2561 patch_prober.go:28] interesting pod/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 05 00:49:15.671170 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:49:15.671151 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" podUID="56a6ce4e-c884-4276-995a-52d231c16344" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 05 00:49:16.671714 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:49:16.671679 2561 patch_prober.go:28] interesting pod/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 05 00:49:16.672105 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:49:16.671735 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" podUID="56a6ce4e-c884-4276-995a-52d231c16344" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 05 00:49:17.670908 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:49:17.670869 2561 patch_prober.go:28] interesting pod/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 05 00:49:17.671084 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:49:17.670927 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" podUID="56a6ce4e-c884-4276-995a-52d231c16344" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 05 00:49:18.670902 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:49:18.670866 2561 patch_prober.go:28] interesting pod/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 05 00:49:18.671280 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:49:18.670920 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" podUID="56a6ce4e-c884-4276-995a-52d231c16344" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 05 00:49:19.675011 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:49:19.674980 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:49:19.675446 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:49:19.675418 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:49:19.676155 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:49:19.676134 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:53:49.982815 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:53:49.982718 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/1.log" Jul 05 00:53:50.001275 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:53:50.001250 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/1.log" Jul 05 00:55:05.310983 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:05.310949 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf"] Jul 05 00:55:05.311450 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:05.311171 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" podUID="56a6ce4e-c884-4276-995a-52d231c16344" containerName="istio-proxy" containerID="cri-o://0d7674355051a673d8db6233e1c3f6faff04ab0e543a16d043f2048a7c229db2" gracePeriod=30 Jul 05 00:55:10.568991 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.568964 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:55:10.645664 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.645636 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-credential-socket\") pod \"56a6ce4e-c884-4276-995a-52d231c16344\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " Jul 05 00:55:10.645814 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.645700 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a6ce4e-c884-4276-995a-52d231c16344-istiod-ca-cert\") pod \"56a6ce4e-c884-4276-995a-52d231c16344\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " Jul 05 00:55:10.645814 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.645718 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ch2z7\" (UniqueName: \"kubernetes.io/projected/56a6ce4e-c884-4276-995a-52d231c16344-kube-api-access-ch2z7\") pod \"56a6ce4e-c884-4276-995a-52d231c16344\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " Jul 05 00:55:10.645814 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.645749 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a6ce4e-c884-4276-995a-52d231c16344-istio-token\") pod \"56a6ce4e-c884-4276-995a-52d231c16344\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " Jul 05 00:55:10.645814 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.645775 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-istio-envoy\") pod \"56a6ce4e-c884-4276-995a-52d231c16344\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " Jul 05 00:55:10.646042 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.645825 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-workload-socket\") pod \"56a6ce4e-c884-4276-995a-52d231c16344\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " Jul 05 00:55:10.646042 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.645854 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-istio-data\") pod \"56a6ce4e-c884-4276-995a-52d231c16344\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " Jul 05 00:55:10.646042 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.645894 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a6ce4e-c884-4276-995a-52d231c16344-istio-podinfo\") pod \"56a6ce4e-c884-4276-995a-52d231c16344\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " Jul 05 00:55:10.646042 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.645948 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-workload-certs\") pod \"56a6ce4e-c884-4276-995a-52d231c16344\" (UID: \"56a6ce4e-c884-4276-995a-52d231c16344\") " Jul 05 00:55:10.646258 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.646141 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "56a6ce4e-c884-4276-995a-52d231c16344" (UID: "56a6ce4e-c884-4276-995a-52d231c16344"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:55:10.646258 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.646165 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56a6ce4e-c884-4276-995a-52d231c16344-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "56a6ce4e-c884-4276-995a-52d231c16344" (UID: "56a6ce4e-c884-4276-995a-52d231c16344"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 00:55:10.646364 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.646300 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-workload-socket\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:55:10.646364 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.646319 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a6ce4e-c884-4276-995a-52d231c16344-istiod-ca-cert\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:55:10.646475 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.646445 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "56a6ce4e-c884-4276-995a-52d231c16344" (UID: "56a6ce4e-c884-4276-995a-52d231c16344"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:55:10.646535 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.645895 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "56a6ce4e-c884-4276-995a-52d231c16344" (UID: "56a6ce4e-c884-4276-995a-52d231c16344"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:55:10.646892 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.646865 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-istio-data" (OuterVolumeSpecName: "istio-data") pod "56a6ce4e-c884-4276-995a-52d231c16344" (UID: "56a6ce4e-c884-4276-995a-52d231c16344"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:55:10.648050 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.648021 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "56a6ce4e-c884-4276-995a-52d231c16344" (UID: "56a6ce4e-c884-4276-995a-52d231c16344"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 00:55:10.648150 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.648066 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56a6ce4e-c884-4276-995a-52d231c16344-kube-api-access-ch2z7" (OuterVolumeSpecName: "kube-api-access-ch2z7") pod "56a6ce4e-c884-4276-995a-52d231c16344" (UID: "56a6ce4e-c884-4276-995a-52d231c16344"). InnerVolumeSpecName "kube-api-access-ch2z7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:55:10.648150 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.648088 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56a6ce4e-c884-4276-995a-52d231c16344-istio-token" (OuterVolumeSpecName: "istio-token") pod "56a6ce4e-c884-4276-995a-52d231c16344" (UID: "56a6ce4e-c884-4276-995a-52d231c16344"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 00:55:10.648230 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.648160 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/56a6ce4e-c884-4276-995a-52d231c16344-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "56a6ce4e-c884-4276-995a-52d231c16344" (UID: "56a6ce4e-c884-4276-995a-52d231c16344"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 05 00:55:10.747124 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.747099 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ch2z7\" (UniqueName: \"kubernetes.io/projected/56a6ce4e-c884-4276-995a-52d231c16344-kube-api-access-ch2z7\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:55:10.747124 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.747123 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a6ce4e-c884-4276-995a-52d231c16344-istio-token\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:55:10.747259 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.747133 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-istio-envoy\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:55:10.747259 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.747141 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-istio-data\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:55:10.747259 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.747149 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a6ce4e-c884-4276-995a-52d231c16344-istio-podinfo\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:55:10.747259 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.747157 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-workload-certs\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:55:10.747259 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.747167 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a6ce4e-c884-4276-995a-52d231c16344-credential-socket\") on node \"ip-10-0-142-188.ec2.internal\" DevicePath \"\"" Jul 05 00:55:10.950611 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.950529 2561 generic.go:356] "Generic (PLEG): container finished" podID="56a6ce4e-c884-4276-995a-52d231c16344" containerID="0d7674355051a673d8db6233e1c3f6faff04ab0e543a16d043f2048a7c229db2" exitCode=0 Jul 05 00:55:10.950611 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.950575 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" Jul 05 00:55:10.950776 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.950617 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" event={"ID":"56a6ce4e-c884-4276-995a-52d231c16344","Type":"ContainerDied","Data":"0d7674355051a673d8db6233e1c3f6faff04ab0e543a16d043f2048a7c229db2"} Jul 05 00:55:10.950776 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.950673 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf" event={"ID":"56a6ce4e-c884-4276-995a-52d231c16344","Type":"ContainerDied","Data":"379551421ae973515a40fb2407e66743679b0782ebd7176a6ec9432223183f48"} Jul 05 00:55:10.950776 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.950697 2561 scope.go:117] "RemoveContainer" containerID="0d7674355051a673d8db6233e1c3f6faff04ab0e543a16d043f2048a7c229db2" Jul 05 00:55:10.962596 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.962573 2561 scope.go:117] "RemoveContainer" containerID="3de7ea46bac6f33bc1432bef2d712b784d2fa227ae1adf18960febdc0d873a6b" Jul 05 00:55:10.971247 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.971231 2561 scope.go:117] "RemoveContainer" containerID="0d7674355051a673d8db6233e1c3f6faff04ab0e543a16d043f2048a7c229db2" Jul 05 00:55:10.971494 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:55:10.971465 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d7674355051a673d8db6233e1c3f6faff04ab0e543a16d043f2048a7c229db2\": container with ID starting with 0d7674355051a673d8db6233e1c3f6faff04ab0e543a16d043f2048a7c229db2 not found: ID does not exist" containerID="0d7674355051a673d8db6233e1c3f6faff04ab0e543a16d043f2048a7c229db2" Jul 05 00:55:10.971553 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.971492 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d7674355051a673d8db6233e1c3f6faff04ab0e543a16d043f2048a7c229db2"} err="failed to get container status \"0d7674355051a673d8db6233e1c3f6faff04ab0e543a16d043f2048a7c229db2\": rpc error: code = NotFound desc = could not find container \"0d7674355051a673d8db6233e1c3f6faff04ab0e543a16d043f2048a7c229db2\": container with ID starting with 0d7674355051a673d8db6233e1c3f6faff04ab0e543a16d043f2048a7c229db2 not found: ID does not exist" Jul 05 00:55:10.971553 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.971507 2561 scope.go:117] "RemoveContainer" containerID="3de7ea46bac6f33bc1432bef2d712b784d2fa227ae1adf18960febdc0d873a6b" Jul 05 00:55:10.971762 ip-10-0-142-188 kubenswrapper[2561]: E0705 00:55:10.971740 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3de7ea46bac6f33bc1432bef2d712b784d2fa227ae1adf18960febdc0d873a6b\": container with ID starting with 3de7ea46bac6f33bc1432bef2d712b784d2fa227ae1adf18960febdc0d873a6b not found: ID does not exist" containerID="3de7ea46bac6f33bc1432bef2d712b784d2fa227ae1adf18960febdc0d873a6b" Jul 05 00:55:10.971837 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.971773 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3de7ea46bac6f33bc1432bef2d712b784d2fa227ae1adf18960febdc0d873a6b"} err="failed to get container status \"3de7ea46bac6f33bc1432bef2d712b784d2fa227ae1adf18960febdc0d873a6b\": rpc error: code = NotFound desc = could not find container \"3de7ea46bac6f33bc1432bef2d712b784d2fa227ae1adf18960febdc0d873a6b\": container with ID starting with 3de7ea46bac6f33bc1432bef2d712b784d2fa227ae1adf18960febdc0d873a6b not found: ID does not exist" Jul 05 00:55:10.973474 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.973453 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf"] Jul 05 00:55:10.976760 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:10.976739 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-1a1f49-openshift-default-57c5df8679-ckqzf"] Jul 05 00:55:11.777032 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:11.777001 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56a6ce4e-c884-4276-995a-52d231c16344" path="/var/lib/kubelet/pods/56a6ce4e-c884-4276-995a-52d231c16344/volumes" Jul 05 00:55:12.459525 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:12.459460 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-674c4bd948-crkmh_6efa6c1e-8c73-4334-8420-da97a1a754c3/copy-manifests/0.log" Jul 05 00:55:12.471469 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:12.471438 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-674c4bd948-crkmh_6efa6c1e-8c73-4334-8420-da97a1a754c3/manager/0.log" Jul 05 00:55:13.424631 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:13.424604 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs_b358d47b-db93-4fa9-844b-b83ade106500/util/0.log" Jul 05 00:55:13.430045 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:13.430028 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs_b358d47b-db93-4fa9-844b-b83ade106500/pull/0.log" Jul 05 00:55:13.435292 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:13.435274 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs_b358d47b-db93-4fa9-844b-b83ade106500/extract/0.log" Jul 05 00:55:13.552182 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:13.552154 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj_3c590c51-f636-4ed9-b10a-743e5eb1520a/extract/0.log" Jul 05 00:55:13.557198 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:13.557179 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj_3c590c51-f636-4ed9-b10a-743e5eb1520a/util/0.log" Jul 05 00:55:13.562675 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:13.562641 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj_3c590c51-f636-4ed9-b10a-743e5eb1520a/pull/0.log" Jul 05 00:55:13.682481 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:13.682422 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4_26d66d9c-8c24-4b63-9f0d-e524fcc5c96e/util/0.log" Jul 05 00:55:13.688589 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:13.688571 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4_26d66d9c-8c24-4b63-9f0d-e524fcc5c96e/pull/0.log" Jul 05 00:55:13.694433 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:13.694407 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4_26d66d9c-8c24-4b63-9f0d-e524fcc5c96e/extract/0.log" Jul 05 00:55:13.816977 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:13.816949 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr_2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c/extract/0.log" Jul 05 00:55:13.821828 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:13.821788 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr_2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c/util/0.log" Jul 05 00:55:13.826954 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:13.826934 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr_2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c/pull/0.log" Jul 05 00:55:14.081404 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:14.081342 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-8zz99_a1e725b6-9155-4f8f-984c-de8d10153671/manager/0.log" Jul 05 00:55:14.352868 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:14.352766 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-twztc_cdd498e3-5e18-4f1a-b097-eb5ced1f035a/kuadrant-console-plugin/0.log" Jul 05 00:55:14.477496 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:14.477468 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wznts_f9493252-0272-4c76-8f9b-a6a3e0b3448a/registry-server/0.log" Jul 05 00:55:14.617820 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:14.617712 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xf2zw_0aeaea78-756d-4ac3-bee6-03ed58c44c88/manager/0.log" Jul 05 00:55:14.872932 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:14.872831 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gzbjl_fcc333ae-1d94-4bab-96aa-9f54e66bf955/manager/0.log" Jul 05 00:55:15.239117 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:15.239038 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4j6mwl_aa0af251-c3d6-40e3-b489-6a421b06092b/istio-proxy/0.log" Jul 05 00:55:16.178339 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:16.178313 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d86866d97-ldmcp_548a01a5-00d4-4d0a-93ae-6468343cb273/router/0.log" Jul 05 00:55:16.736586 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:16.736560 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-v6xvk_967b3ec9-09d1-496a-ac76-453a2be34d4c/main/0.log" Jul 05 00:55:21.788726 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:21.788693 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6nfx9/must-gather-62v66"] Jul 05 00:55:21.789227 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:21.789203 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56a6ce4e-c884-4276-995a-52d231c16344" containerName="istio-proxy" Jul 05 00:55:21.789321 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:21.789231 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="56a6ce4e-c884-4276-995a-52d231c16344" containerName="istio-proxy" Jul 05 00:55:21.789375 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:21.789351 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="56a6ce4e-c884-4276-995a-52d231c16344" containerName="istio-proxy" Jul 05 00:55:21.789457 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:21.789446 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56a6ce4e-c884-4276-995a-52d231c16344" containerName="istio-proxy" Jul 05 00:55:21.789494 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:21.789458 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="56a6ce4e-c884-4276-995a-52d231c16344" containerName="istio-proxy" Jul 05 00:55:21.789526 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:21.789516 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="56a6ce4e-c884-4276-995a-52d231c16344" containerName="istio-proxy" Jul 05 00:55:21.794050 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:21.794033 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6nfx9/must-gather-62v66" Jul 05 00:55:21.797225 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:21.797199 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6nfx9\"/\"kube-root-ca.crt\"" Jul 05 00:55:21.798341 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:21.798326 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6nfx9\"/\"default-dockercfg-jzs6w\"" Jul 05 00:55:21.798419 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:21.798333 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6nfx9\"/\"openshift-service-ca.crt\"" Jul 05 00:55:21.804246 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:21.804223 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6nfx9/must-gather-62v66"] Jul 05 00:55:21.838000 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:21.837972 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/967fdacc-b0be-44e2-9801-dde510d2dfd4-must-gather-output\") pod \"must-gather-62v66\" (UID: \"967fdacc-b0be-44e2-9801-dde510d2dfd4\") " pod="openshift-must-gather-6nfx9/must-gather-62v66" Jul 05 00:55:21.838107 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:21.838007 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2fpk\" (UniqueName: \"kubernetes.io/projected/967fdacc-b0be-44e2-9801-dde510d2dfd4-kube-api-access-c2fpk\") pod \"must-gather-62v66\" (UID: \"967fdacc-b0be-44e2-9801-dde510d2dfd4\") " pod="openshift-must-gather-6nfx9/must-gather-62v66" Jul 05 00:55:21.938927 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:21.938906 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/967fdacc-b0be-44e2-9801-dde510d2dfd4-must-gather-output\") pod \"must-gather-62v66\" (UID: \"967fdacc-b0be-44e2-9801-dde510d2dfd4\") " pod="openshift-must-gather-6nfx9/must-gather-62v66" Jul 05 00:55:21.939033 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:21.938936 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2fpk\" (UniqueName: \"kubernetes.io/projected/967fdacc-b0be-44e2-9801-dde510d2dfd4-kube-api-access-c2fpk\") pod \"must-gather-62v66\" (UID: \"967fdacc-b0be-44e2-9801-dde510d2dfd4\") " pod="openshift-must-gather-6nfx9/must-gather-62v66" Jul 05 00:55:21.939223 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:21.939204 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/967fdacc-b0be-44e2-9801-dde510d2dfd4-must-gather-output\") pod \"must-gather-62v66\" (UID: \"967fdacc-b0be-44e2-9801-dde510d2dfd4\") " pod="openshift-must-gather-6nfx9/must-gather-62v66" Jul 05 00:55:21.946635 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:21.946609 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2fpk\" (UniqueName: \"kubernetes.io/projected/967fdacc-b0be-44e2-9801-dde510d2dfd4-kube-api-access-c2fpk\") pod \"must-gather-62v66\" (UID: \"967fdacc-b0be-44e2-9801-dde510d2dfd4\") " pod="openshift-must-gather-6nfx9/must-gather-62v66" Jul 05 00:55:22.104248 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:22.104220 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6nfx9/must-gather-62v66" Jul 05 00:55:22.236212 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:22.236188 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6nfx9/must-gather-62v66"] Jul 05 00:55:22.238234 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:55:22.238205 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod967fdacc_b0be_44e2_9801_dde510d2dfd4.slice/crio-0a812424d58452e22156fb9e92caf08653fd6ab44fdd3b8eab8155055354733b WatchSource:0}: Error finding container 0a812424d58452e22156fb9e92caf08653fd6ab44fdd3b8eab8155055354733b: Status 404 returned error can't find the container with id 0a812424d58452e22156fb9e92caf08653fd6ab44fdd3b8eab8155055354733b Jul 05 00:55:22.240160 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:22.240139 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 00:55:23.018433 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:23.018398 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6nfx9/must-gather-62v66" event={"ID":"967fdacc-b0be-44e2-9801-dde510d2dfd4","Type":"ContainerStarted","Data":"0a812424d58452e22156fb9e92caf08653fd6ab44fdd3b8eab8155055354733b"} Jul 05 00:55:24.028964 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:24.028913 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6nfx9/must-gather-62v66" event={"ID":"967fdacc-b0be-44e2-9801-dde510d2dfd4","Type":"ContainerStarted","Data":"ff213e75e094d53bf70a6dc463b95718acf6385568facba7ef837fd4c0f1f644"} Jul 05 00:55:24.029406 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:24.028976 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6nfx9/must-gather-62v66" event={"ID":"967fdacc-b0be-44e2-9801-dde510d2dfd4","Type":"ContainerStarted","Data":"75e263ac52ca29bd4fc69e2563764fabbf08b426191e47ed6ed83c6b49dfcbd6"} Jul 05 00:55:24.045115 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:24.045064 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6nfx9/must-gather-62v66" podStartSLOduration=2.158492853 podStartE2EDuration="3.045048683s" totalImagesPullingTime="886.55583ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 00:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:55:24.04249801 +0000 UTC m=+2794.767514073" watchObservedRunningTime="2026-07-05 00:55:24.045048683 +0000 UTC m=+2794.770064742" Jul 05 00:55:24.584058 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:24.584016 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dxsxs_d3f73c87-0938-4904-8db7-e28345166dd1/global-pull-secret-syncer/0.log" Jul 05 00:55:24.696989 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:24.696927 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qp7vx_7f25f798-bb34-44b4-83e2-19ab8622e667/konnectivity-agent/0.log" Jul 05 00:55:24.756140 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:24.756067 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-188.ec2.internal_4d98373d2705b464e11a31bbc31f03dd/haproxy/0.log" Jul 05 00:55:29.452004 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:29.451975 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs_b358d47b-db93-4fa9-844b-b83ade106500/extract/0.log" Jul 05 00:55:29.469154 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:29.469128 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs_b358d47b-db93-4fa9-844b-b83ade106500/util/0.log" Jul 05 00:55:29.485568 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:29.485442 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gnbvs_b358d47b-db93-4fa9-844b-b83ade106500/pull/0.log" Jul 05 00:55:29.512971 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:29.512909 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj_3c590c51-f636-4ed9-b10a-743e5eb1520a/extract/0.log" Jul 05 00:55:29.531345 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:29.531320 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj_3c590c51-f636-4ed9-b10a-743e5eb1520a/util/0.log" Jul 05 00:55:29.549566 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:29.549543 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qw8cj_3c590c51-f636-4ed9-b10a-743e5eb1520a/pull/0.log" Jul 05 00:55:29.573115 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:29.573092 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4_26d66d9c-8c24-4b63-9f0d-e524fcc5c96e/extract/0.log" Jul 05 00:55:29.589489 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:29.589419 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4_26d66d9c-8c24-4b63-9f0d-e524fcc5c96e/util/0.log" Jul 05 00:55:29.606074 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:29.606043 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tcgm4_26d66d9c-8c24-4b63-9f0d-e524fcc5c96e/pull/0.log" Jul 05 00:55:29.634173 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:29.634141 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr_2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c/extract/0.log" Jul 05 00:55:29.658694 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:29.658657 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr_2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c/util/0.log" Jul 05 00:55:29.676721 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:29.676693 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1grlvr_2f6e6e3e-ff76-4737-99bd-6e2915e6cf9c/pull/0.log" Jul 05 00:55:29.951663 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:29.951631 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-8zz99_a1e725b6-9155-4f8f-984c-de8d10153671/manager/0.log" Jul 05 00:55:29.998659 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:29.998629 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-twztc_cdd498e3-5e18-4f1a-b097-eb5ced1f035a/kuadrant-console-plugin/0.log" Jul 05 00:55:30.044831 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:30.044781 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wznts_f9493252-0272-4c76-8f9b-a6a3e0b3448a/registry-server/0.log" Jul 05 00:55:30.245671 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:30.244828 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-xf2zw_0aeaea78-756d-4ac3-bee6-03ed58c44c88/manager/0.log" Jul 05 00:55:30.340753 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:30.340676 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gzbjl_fcc333ae-1d94-4bab-96aa-9f54e66bf955/manager/0.log" Jul 05 00:55:32.322037 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:32.321998 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-86659787cb-9x6pn_33714cc0-2510-4d30-89ca-e7e1c7f84340/metrics-server/0.log" Jul 05 00:55:32.342992 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:32.342964 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-9rp78_1813fe8d-71b8-4cc6-93ad-6e49a9d77af3/monitoring-plugin/0.log" Jul 05 00:55:32.426057 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:32.425997 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ms8rb_ffd08932-7257-4b59-8a1f-01c91839aca1/node-exporter/0.log" Jul 05 00:55:32.442917 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:32.442862 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ms8rb_ffd08932-7257-4b59-8a1f-01c91839aca1/kube-rbac-proxy/0.log" Jul 05 00:55:32.459175 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:32.459136 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ms8rb_ffd08932-7257-4b59-8a1f-01c91839aca1/init-textfile/0.log" Jul 05 00:55:32.542611 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:32.542579 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-qwk6z_00a4e5ad-fd46-4aaa-920b-d9e311c983ec/kube-rbac-proxy-main/0.log" Jul 05 00:55:32.559075 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:32.559043 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-qwk6z_00a4e5ad-fd46-4aaa-920b-d9e311c983ec/kube-rbac-proxy-self/0.log" Jul 05 00:55:32.574958 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:32.574931 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-qwk6z_00a4e5ad-fd46-4aaa-920b-d9e311c983ec/openshift-state-metrics/0.log" Jul 05 00:55:32.843990 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:32.843917 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55f858b44-w78ww_5c44da80-8871-4e4a-897e-49453716fb51/thanos-query/0.log" Jul 05 00:55:32.862360 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:32.862328 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55f858b44-w78ww_5c44da80-8871-4e4a-897e-49453716fb51/kube-rbac-proxy-web/0.log" Jul 05 00:55:32.878298 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:32.878269 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55f858b44-w78ww_5c44da80-8871-4e4a-897e-49453716fb51/kube-rbac-proxy/0.log" Jul 05 00:55:32.893714 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:32.893675 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55f858b44-w78ww_5c44da80-8871-4e4a-897e-49453716fb51/prom-label-proxy/0.log" Jul 05 00:55:32.911629 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:32.911588 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55f858b44-w78ww_5c44da80-8871-4e4a-897e-49453716fb51/kube-rbac-proxy-rules/0.log" Jul 05 00:55:32.927262 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:32.927220 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55f858b44-w78ww_5c44da80-8871-4e4a-897e-49453716fb51/kube-rbac-proxy-metrics/0.log" Jul 05 00:55:34.111356 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:34.111329 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-w97sv_b4d54845-8c05-46b8-9130-3aea115d4f6c/networking-console-plugin/0.log" Jul 05 00:55:34.635847 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:34.635786 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/1.log" Jul 05 00:55:34.641463 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:34.641434 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-rj72b_e3b8e330-88ef-4783-9ef5-615ae05e4c88/console-operator/2.log" Jul 05 00:55:34.914975 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:34.914884 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m"] Jul 05 00:55:34.923906 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:34.923875 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m" Jul 05 00:55:34.926445 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:34.926409 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m"] Jul 05 00:55:35.078876 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:35.078819 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f24cf2cf-7287-4c13-85f1-98e835ad4bf7-sys\") pod \"perf-node-gather-daemonset-2hv6m\" (UID: \"f24cf2cf-7287-4c13-85f1-98e835ad4bf7\") " pod="openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m" Jul 05 00:55:35.079056 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:35.078893 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f24cf2cf-7287-4c13-85f1-98e835ad4bf7-lib-modules\") pod \"perf-node-gather-daemonset-2hv6m\" (UID: \"f24cf2cf-7287-4c13-85f1-98e835ad4bf7\") " pod="openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m" Jul 05 00:55:35.079056 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:35.078989 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj4sp\" (UniqueName: \"kubernetes.io/projected/f24cf2cf-7287-4c13-85f1-98e835ad4bf7-kube-api-access-kj4sp\") pod \"perf-node-gather-daemonset-2hv6m\" (UID: \"f24cf2cf-7287-4c13-85f1-98e835ad4bf7\") " pod="openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m" Jul 05 00:55:35.079181 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:35.079086 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f24cf2cf-7287-4c13-85f1-98e835ad4bf7-proc\") pod \"perf-node-gather-daemonset-2hv6m\" (UID: \"f24cf2cf-7287-4c13-85f1-98e835ad4bf7\") " pod="openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m" Jul 05 00:55:35.079238 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:35.079186 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f24cf2cf-7287-4c13-85f1-98e835ad4bf7-podres\") pod \"perf-node-gather-daemonset-2hv6m\" (UID: \"f24cf2cf-7287-4c13-85f1-98e835ad4bf7\") " pod="openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m" Jul 05 00:55:35.179041 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:35.178969 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59fd6474c-7kvkh_b004c51e-79db-43c1-875f-a7ce35850ed4/console/0.log" Jul 05 00:55:35.179846 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:35.179818 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f24cf2cf-7287-4c13-85f1-98e835ad4bf7-podres\") pod \"perf-node-gather-daemonset-2hv6m\" (UID: \"f24cf2cf-7287-4c13-85f1-98e835ad4bf7\") " pod="openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m" Jul 05 00:55:35.180000 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:35.179883 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f24cf2cf-7287-4c13-85f1-98e835ad4bf7-sys\") pod \"perf-node-gather-daemonset-2hv6m\" (UID: \"f24cf2cf-7287-4c13-85f1-98e835ad4bf7\") " pod="openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m" Jul 05 00:55:35.180000 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:35.179915 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f24cf2cf-7287-4c13-85f1-98e835ad4bf7-lib-modules\") pod \"perf-node-gather-daemonset-2hv6m\" (UID: \"f24cf2cf-7287-4c13-85f1-98e835ad4bf7\") " pod="openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m" Jul 05 00:55:35.180000 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:35.179949 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj4sp\" (UniqueName: \"kubernetes.io/projected/f24cf2cf-7287-4c13-85f1-98e835ad4bf7-kube-api-access-kj4sp\") pod \"perf-node-gather-daemonset-2hv6m\" (UID: \"f24cf2cf-7287-4c13-85f1-98e835ad4bf7\") " pod="openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m" Jul 05 00:55:35.180000 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:35.179990 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f24cf2cf-7287-4c13-85f1-98e835ad4bf7-sys\") pod \"perf-node-gather-daemonset-2hv6m\" (UID: \"f24cf2cf-7287-4c13-85f1-98e835ad4bf7\") " pod="openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m" Jul 05 00:55:35.180218 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:35.180000 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f24cf2cf-7287-4c13-85f1-98e835ad4bf7-proc\") pod \"perf-node-gather-daemonset-2hv6m\" (UID: \"f24cf2cf-7287-4c13-85f1-98e835ad4bf7\") " pod="openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m" Jul 05 00:55:35.180218 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:35.180045 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f24cf2cf-7287-4c13-85f1-98e835ad4bf7-proc\") pod \"perf-node-gather-daemonset-2hv6m\" (UID: \"f24cf2cf-7287-4c13-85f1-98e835ad4bf7\") " pod="openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m" Jul 05 00:55:35.180218 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:35.180049 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f24cf2cf-7287-4c13-85f1-98e835ad4bf7-podres\") pod \"perf-node-gather-daemonset-2hv6m\" (UID: \"f24cf2cf-7287-4c13-85f1-98e835ad4bf7\") " pod="openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m" Jul 05 00:55:35.180218 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:35.180199 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f24cf2cf-7287-4c13-85f1-98e835ad4bf7-lib-modules\") pod \"perf-node-gather-daemonset-2hv6m\" (UID: \"f24cf2cf-7287-4c13-85f1-98e835ad4bf7\") " pod="openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m" Jul 05 00:55:35.187699 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:35.187672 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj4sp\" (UniqueName: \"kubernetes.io/projected/f24cf2cf-7287-4c13-85f1-98e835ad4bf7-kube-api-access-kj4sp\") pod \"perf-node-gather-daemonset-2hv6m\" (UID: \"f24cf2cf-7287-4c13-85f1-98e835ad4bf7\") " pod="openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m" Jul 05 00:55:35.238756 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:35.238714 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m" Jul 05 00:55:35.415092 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:35.415062 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m"] Jul 05 00:55:35.417041 ip-10-0-142-188 kubenswrapper[2561]: W0705 00:55:35.417011 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf24cf2cf_7287_4c13_85f1_98e835ad4bf7.slice/crio-de4d58c8f24f352b4e8cbf399c94bd6f938c76e1a4caef10763a052b48e403aa WatchSource:0}: Error finding container de4d58c8f24f352b4e8cbf399c94bd6f938c76e1a4caef10763a052b48e403aa: Status 404 returned error can't find the container with id de4d58c8f24f352b4e8cbf399c94bd6f938c76e1a4caef10763a052b48e403aa Jul 05 00:55:35.769296 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:35.769220 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-z7755_dc6063cc-901a-41d7-8cca-ec261238dc1c/volume-data-source-validator/0.log" Jul 05 00:55:36.140320 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:36.140256 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m" event={"ID":"f24cf2cf-7287-4c13-85f1-98e835ad4bf7","Type":"ContainerStarted","Data":"2def8ac7d74477667aade32c2c74efee9d93addc158e265358384b25568d8f7c"} Jul 05 00:55:36.140634 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:36.140365 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m" event={"ID":"f24cf2cf-7287-4c13-85f1-98e835ad4bf7","Type":"ContainerStarted","Data":"de4d58c8f24f352b4e8cbf399c94bd6f938c76e1a4caef10763a052b48e403aa"} Jul 05 00:55:36.140884 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:36.140865 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m" Jul 05 00:55:36.158233 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:36.158173 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m" podStartSLOduration=2.158153526 podStartE2EDuration="2.158153526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 00:55:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 00:55:36.156142745 +0000 UTC m=+2806.881158857" watchObservedRunningTime="2026-07-05 00:55:36.158153526 +0000 UTC m=+2806.883169586" Jul 05 00:55:36.669650 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:36.669606 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dm6pw_21ab9246-2ceb-4ee9-be3d-f158461d8ed1/dns/0.log" Jul 05 00:55:36.684839 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:36.684811 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dm6pw_21ab9246-2ceb-4ee9-be3d-f158461d8ed1/kube-rbac-proxy/0.log" Jul 05 00:55:36.807197 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:36.807171 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m6rgl_962c613c-ccfc-4bdd-aded-f0978bc0b8ab/dns-node-resolver/0.log" Jul 05 00:55:37.336759 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:37.336732 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lz9th_a9a304be-a49e-4a1a-983e-7ade1cc7ea10/node-ca/0.log" Jul 05 00:55:38.163626 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:38.163595 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4j6mwl_aa0af251-c3d6-40e3-b489-6a421b06092b/istio-proxy/0.log" Jul 05 00:55:38.578419 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:38.578385 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d86866d97-ldmcp_548a01a5-00d4-4d0a-93ae-6468343cb273/router/0.log" Jul 05 00:55:39.216063 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:39.216029 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mkr59_1ee85ca6-328e-47e2-ab72-17410e1636a5/serve-healthcheck-canary/0.log" Jul 05 00:55:39.687609 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:39.687574 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-j4rbf_ce97d3ea-0558-47bb-bce3-0aebe2cc7603/insights-operator/0.log" Jul 05 00:55:39.688179 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:39.688154 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-j4rbf_ce97d3ea-0558-47bb-bce3-0aebe2cc7603/insights-operator/1.log" Jul 05 00:55:39.806077 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:39.806050 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tn5mz_c51e3fb6-b6ca-4a4b-8895-cc595f81e82a/kube-rbac-proxy/0.log" Jul 05 00:55:39.821352 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:39.821324 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tn5mz_c51e3fb6-b6ca-4a4b-8895-cc595f81e82a/exporter/0.log" Jul 05 00:55:39.836524 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:39.836499 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tn5mz_c51e3fb6-b6ca-4a4b-8895-cc595f81e82a/extractor/0.log" Jul 05 00:55:42.159917 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:42.159872 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6nfx9/perf-node-gather-daemonset-2hv6m" Jul 05 00:55:42.576323 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:42.576292 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-674c4bd948-crkmh_6efa6c1e-8c73-4334-8420-da97a1a754c3/manager/0.log" Jul 05 00:55:42.590948 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:42.590924 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-674c4bd948-crkmh_6efa6c1e-8c73-4334-8420-da97a1a754c3/copy-manifests/0.log" Jul 05 00:55:44.010384 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:44.010354 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7dcb9fcb66-69h9r_cd378798-2580-4938-8102-211144a61181/manager/0.log" Jul 05 00:55:44.778756 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:44.778699 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4j6mwl_aa0af251-c3d6-40e3-b489-6a421b06092b/istio-proxy/0.log" Jul 05 00:55:45.158392 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:45.158353 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d86866d97-ldmcp_548a01a5-00d4-4d0a-93ae-6468343cb273/router/0.log" Jul 05 00:55:46.317012 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:46.316917 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4j6mwl_aa0af251-c3d6-40e3-b489-6a421b06092b/istio-proxy/0.log" Jul 05 00:55:46.700500 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:46.700460 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d86866d97-ldmcp_548a01a5-00d4-4d0a-93ae-6468343cb273/router/0.log" Jul 05 00:55:49.284045 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:49.284010 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-wvd2f_e1d14242-819e-4f92-bc54-eeebf3e858f3/kube-storage-version-migrator-operator/1.log" Jul 05 00:55:49.285640 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:49.285610 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-wvd2f_e1d14242-819e-4f92-bc54-eeebf3e858f3/kube-storage-version-migrator-operator/0.log" Jul 05 00:55:50.157782 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:50.157755 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99xdd_0d61705e-33be-4264-85b4-8edce04fffbd/kube-multus-additional-cni-plugins/0.log" Jul 05 00:55:50.174590 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:50.174568 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99xdd_0d61705e-33be-4264-85b4-8edce04fffbd/egress-router-binary-copy/0.log" Jul 05 00:55:50.189405 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:50.189387 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99xdd_0d61705e-33be-4264-85b4-8edce04fffbd/cni-plugins/0.log" Jul 05 00:55:50.204108 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:50.204088 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99xdd_0d61705e-33be-4264-85b4-8edce04fffbd/bond-cni-plugin/0.log" Jul 05 00:55:50.222130 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:50.222106 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99xdd_0d61705e-33be-4264-85b4-8edce04fffbd/routeoverride-cni/0.log" Jul 05 00:55:50.236638 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:50.236621 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99xdd_0d61705e-33be-4264-85b4-8edce04fffbd/whereabouts-cni-bincopy/0.log" Jul 05 00:55:50.251321 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:50.251303 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-99xdd_0d61705e-33be-4264-85b4-8edce04fffbd/whereabouts-cni/0.log" Jul 05 00:55:50.577373 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:50.577346 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zr9vn_d761a174-9f01-4bb2-aa2d-76a540929c2d/kube-multus/0.log" Jul 05 00:55:50.678057 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:50.678030 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tlll9_107f4ca7-7252-4983-9468-ba558c9e9e58/network-metrics-daemon/0.log" Jul 05 00:55:50.691211 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:50.691189 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tlll9_107f4ca7-7252-4983-9468-ba558c9e9e58/kube-rbac-proxy/0.log" Jul 05 00:55:51.772261 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:51.772218 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t2zpd_25833488-5ae4-4ff9-8eaf-cc1107922763/ovn-controller/0.log" Jul 05 00:55:51.783452 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:51.783427 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t2zpd_25833488-5ae4-4ff9-8eaf-cc1107922763/ovn-acl-logging/0.log" Jul 05 00:55:51.803661 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:51.803632 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t2zpd_25833488-5ae4-4ff9-8eaf-cc1107922763/kube-rbac-proxy-node/0.log" Jul 05 00:55:51.819685 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:51.819664 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t2zpd_25833488-5ae4-4ff9-8eaf-cc1107922763/kube-rbac-proxy-ovn-metrics/0.log" Jul 05 00:55:51.830551 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:51.830533 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t2zpd_25833488-5ae4-4ff9-8eaf-cc1107922763/northd/0.log" Jul 05 00:55:51.844583 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:51.844561 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t2zpd_25833488-5ae4-4ff9-8eaf-cc1107922763/nbdb/0.log" Jul 05 00:55:51.859537 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:51.859490 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t2zpd_25833488-5ae4-4ff9-8eaf-cc1107922763/sbdb/0.log" Jul 05 00:55:51.919336 ip-10-0-142-188 kubenswrapper[2561]: I0705 00:55:51.919303 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t2zpd_25833488-5ae4-4ff9-8eaf-cc1107922763/ovnkube-controller/0.log"