Jun 08 12:06:36.760595 ip-10-0-137-94 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 08 12:06:36.760662 ip-10-0-137-94 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 08 12:06:36.760673 ip-10-0-137-94 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 08 12:06:36.761000 ip-10-0-137-94 systemd[1]: Failed to start Kubernetes Kubelet. Jun 08 12:06:46.787776 ip-10-0-137-94 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 08 12:06:46.787792 ip-10-0-137-94 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 86a32dfaec1f4ffca919a5695b8b01c4 -- Jun 08 12:09:31.773090 ip-10-0-137-94 systemd[1]: Starting Kubernetes Kubelet... Jun 08 12:09:32.176237 ip-10-0-137-94 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 12:09:32.176237 ip-10-0-137-94 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 12:09:32.176237 ip-10-0-137-94 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 12:09:32.176237 ip-10-0-137-94 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 12:09:32.176237 ip-10-0-137-94 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 12:09:32.177105 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.176304 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 12:09:32.182113 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182093 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:09:32.182113 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182111 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:09:32.182113 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182117 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:09:32.182324 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182121 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:09:32.182324 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182125 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:09:32.182324 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182129 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:09:32.182324 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182133 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:09:32.182324 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182137 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:09:32.182324 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182140 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:09:32.182324 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182143 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:09:32.182324 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182147 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:09:32.182324 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182151 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:09:32.182324 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182155 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:09:32.182324 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182158 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:09:32.182324 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182162 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:09:32.182324 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182166 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:09:32.182324 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182170 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:09:32.182324 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182173 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:09:32.182324 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182182 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:09:32.182324 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182186 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:09:32.182324 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182190 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:09:32.182324 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182194 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:09:32.182324 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182198 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:09:32.183161 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182202 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:09:32.183161 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182206 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:09:32.183161 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182209 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:09:32.183161 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182213 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:09:32.183161 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182217 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:09:32.183161 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182221 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:09:32.183161 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182225 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:09:32.183161 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182229 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:09:32.183161 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182233 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:09:32.183161 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182236 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:09:32.183161 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182241 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:09:32.183161 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182245 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:09:32.183161 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182252 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:09:32.183161 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182260 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:09:32.183161 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182266 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:09:32.183161 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182271 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:09:32.183161 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182276 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:09:32.183161 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182280 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:09:32.183161 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182285 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:09:32.183984 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182290 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:09:32.183984 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182296 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:09:32.183984 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182302 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:09:32.183984 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182307 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:09:32.183984 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182311 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:09:32.183984 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182315 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:09:32.183984 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182319 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:09:32.183984 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182323 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:09:32.183984 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182327 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:09:32.183984 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182332 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:09:32.183984 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182336 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:09:32.183984 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182340 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:09:32.183984 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182344 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:09:32.183984 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182350 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:09:32.183984 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182356 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:09:32.183984 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182361 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:09:32.183984 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182366 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:09:32.183984 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182370 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:09:32.183984 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182375 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:09:32.183984 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182380 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:09:32.184886 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182384 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:09:32.184886 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182389 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:09:32.184886 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182394 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:09:32.184886 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182398 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:09:32.184886 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182403 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:09:32.184886 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182407 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:09:32.184886 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182411 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:09:32.184886 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182416 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:09:32.184886 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182420 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:09:32.184886 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182424 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:09:32.184886 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182429 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:09:32.184886 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182434 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:09:32.184886 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182438 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:09:32.184886 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182443 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:09:32.184886 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182447 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:09:32.184886 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182451 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:09:32.184886 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182455 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:09:32.184886 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182459 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:09:32.184886 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182463 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:09:32.185687 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182469 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:09:32.185687 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182474 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:09:32.185687 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182478 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:09:32.185687 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182482 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:09:32.185687 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182486 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:09:32.185687 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182490 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:09:32.185687 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182494 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:09:32.185687 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182499 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:09:32.185687 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182506 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:09:32.185687 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182511 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:09:32.185687 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182516 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:09:32.185687 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182521 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:09:32.185687 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182526 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:09:32.185687 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182531 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:09:32.185687 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182536 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:09:32.185687 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182541 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:09:32.185687 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182545 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:09:32.185687 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.182549 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:09:32.185687 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183707 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:09:32.186516 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183717 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:09:32.186516 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183722 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:09:32.186516 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183727 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:09:32.186516 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183731 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:09:32.186516 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183737 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:09:32.186516 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183741 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:09:32.186516 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183745 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:09:32.186516 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183749 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:09:32.186516 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183755 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:09:32.186516 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183759 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:09:32.186516 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183763 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:09:32.186516 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183767 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:09:32.186516 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183772 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:09:32.186516 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183776 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:09:32.186516 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183781 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:09:32.186516 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183785 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:09:32.186516 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183789 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:09:32.186516 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183793 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:09:32.186516 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183797 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:09:32.186516 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183801 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:09:32.187208 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183806 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:09:32.187208 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183830 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:09:32.187208 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183834 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:09:32.187208 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183839 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:09:32.187208 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183843 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:09:32.187208 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183847 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:09:32.187208 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183851 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:09:32.187208 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183856 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:09:32.187208 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183860 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:09:32.187208 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183864 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:09:32.187208 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183868 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:09:32.187208 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183872 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:09:32.187208 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183877 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:09:32.187208 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183881 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:09:32.187208 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183885 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:09:32.187208 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183890 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:09:32.187208 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183894 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:09:32.187208 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183899 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:09:32.187208 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183904 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:09:32.187758 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183911 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:09:32.187758 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183917 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:09:32.187758 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183921 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:09:32.187758 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183926 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:09:32.187758 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183931 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:09:32.187758 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183944 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:09:32.187758 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183948 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:09:32.187758 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183953 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:09:32.187758 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183958 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:09:32.187758 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183962 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:09:32.187758 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183967 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:09:32.187758 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183972 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:09:32.187758 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183976 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:09:32.187758 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183981 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:09:32.187758 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183985 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:09:32.187758 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183989 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:09:32.187758 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.183997 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:09:32.187758 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184000 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:09:32.187758 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184004 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:09:32.187758 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184008 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:09:32.188439 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184013 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:09:32.188439 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184017 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:09:32.188439 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184021 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:09:32.188439 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184025 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:09:32.188439 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184030 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:09:32.188439 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184034 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:09:32.188439 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184041 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:09:32.188439 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184047 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:09:32.188439 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184051 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:09:32.188439 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184056 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:09:32.188439 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184060 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:09:32.188439 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184066 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:09:32.188439 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184070 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:09:32.188439 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184075 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:09:32.188439 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184080 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:09:32.188439 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184084 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:09:32.188439 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184088 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:09:32.188439 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184092 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:09:32.188439 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184096 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:09:32.188439 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184101 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:09:32.189030 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184105 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:09:32.189030 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184109 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:09:32.189030 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184113 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:09:32.189030 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184120 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:09:32.189030 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184126 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:09:32.189030 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184130 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:09:32.189030 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184134 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:09:32.189030 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184138 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:09:32.189030 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184150 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:09:32.189030 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184155 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:09:32.189030 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184160 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:09:32.189030 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184164 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:09:32.189030 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184169 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:09:32.189030 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184173 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:09:32.189030 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184178 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:09:32.189030 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184183 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:09:32.189030 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184187 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:09:32.189030 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184190 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:09:32.189030 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184195 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:09:32.189505 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184880 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:09:32.189505 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184892 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:09:32.189505 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184897 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:09:32.189505 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184901 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:09:32.189505 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184912 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:09:32.189505 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184918 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:09:32.189505 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184924 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:09:32.189505 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184931 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:09:32.189505 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184936 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:09:32.189505 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184941 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:09:32.189505 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184945 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:09:32.189505 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184950 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:09:32.189505 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184954 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:09:32.189505 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184959 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:09:32.189505 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184963 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:09:32.189505 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184967 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:09:32.189505 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184971 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:09:32.189505 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184976 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:09:32.190044 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184980 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:09:32.190044 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184984 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:09:32.190044 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184988 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:09:32.190044 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184995 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:09:32.190044 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.184999 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:09:32.190044 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185003 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:09:32.190044 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185007 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:09:32.190044 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185012 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:09:32.190044 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185016 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:09:32.190044 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185021 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:09:32.190044 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185025 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:09:32.190044 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185029 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:09:32.190044 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185033 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:09:32.190044 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185037 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:09:32.190044 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185041 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:09:32.190044 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185045 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:09:32.190044 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185050 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:09:32.190044 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185054 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:09:32.190044 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185058 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:09:32.190044 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185063 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:09:32.190551 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185068 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:09:32.190551 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185072 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:09:32.190551 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185076 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:09:32.190551 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185080 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:09:32.190551 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185084 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:09:32.190551 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185088 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:09:32.190551 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185092 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:09:32.190551 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185096 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:09:32.190551 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185100 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:09:32.190551 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185104 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:09:32.190551 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185108 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:09:32.190551 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185112 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:09:32.190551 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185116 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:09:32.190551 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185123 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:09:32.190551 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185127 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:09:32.190551 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185133 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:09:32.190551 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185137 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:09:32.190551 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185142 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:09:32.190551 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185146 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:09:32.190551 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185150 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:09:32.191056 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185155 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:09:32.191056 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185159 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:09:32.191056 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185163 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:09:32.191056 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185167 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:09:32.191056 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185171 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:09:32.191056 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185176 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:09:32.191056 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185180 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:09:32.191056 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185184 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:09:32.191056 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185189 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:09:32.191056 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185193 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:09:32.191056 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185197 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:09:32.191056 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185201 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:09:32.191056 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185206 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:09:32.191056 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185210 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:09:32.191056 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185214 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:09:32.191056 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185219 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:09:32.191056 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185224 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:09:32.191056 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185229 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:09:32.191056 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185233 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:09:32.191056 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185237 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:09:32.191612 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185241 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:09:32.191612 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185246 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:09:32.191612 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185250 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:09:32.191612 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185254 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:09:32.191612 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185258 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:09:32.191612 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185262 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:09:32.191612 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185267 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:09:32.191612 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185273 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:09:32.191612 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185277 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:09:32.191612 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185281 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:09:32.191612 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185285 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:09:32.191612 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185290 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:09:32.191612 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185294 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:09:32.191612 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185298 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:09:32.191612 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185303 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:09:32.191612 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185307 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:09:32.191612 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185311 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:09:32.191612 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185315 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:09:32.191612 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185319 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:09:32.191612 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185323 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.185327 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185419 2565 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185429 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185438 2565 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185444 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185452 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185458 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185464 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185471 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185476 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185483 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185489 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185494 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185500 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185505 2565 flags.go:64] FLAG: --cgroup-root="" Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185509 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185514 2565 flags.go:64] FLAG: --client-ca-file="" Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185519 2565 flags.go:64] FLAG: --cloud-provider="external" Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185523 2565 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185533 2565 flags.go:64] FLAG: --cluster-domain="" Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185537 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185542 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185547 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 12:09:32.192114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185557 2565 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185562 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185567 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185572 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185578 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185583 2565 flags.go:64] FLAG: --contention-profiling="false" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185588 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185592 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185597 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185602 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185608 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185613 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185618 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185622 2565 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185627 2565 flags.go:64] FLAG: --enable-server="true" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185633 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185640 2565 flags.go:64] FLAG: --event-burst="100" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185644 2565 flags.go:64] FLAG: --event-qps="50" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185648 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185653 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185658 2565 flags.go:64] FLAG: --eviction-hard="" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185664 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185669 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185674 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185678 2565 flags.go:64] FLAG: --eviction-soft="" Jun 08 12:09:32.192705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185683 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 12:09:32.193325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185687 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 12:09:32.193325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185692 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 12:09:32.193325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185698 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 12:09:32.193325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185702 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 12:09:32.193325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185706 2565 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 12:09:32.193325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185711 2565 flags.go:64] FLAG: --feature-gates="" Jun 08 12:09:32.193325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185719 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 12:09:32.193325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185724 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 12:09:32.193325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185729 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 12:09:32.193325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185734 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 12:09:32.193325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185739 2565 flags.go:64] FLAG: --healthz-port="10248" Jun 08 12:09:32.193325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185744 2565 flags.go:64] FLAG: --help="false" Jun 08 12:09:32.193325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185748 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-137-94.ec2.internal" Jun 08 12:09:32.193325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185753 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 12:09:32.193325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185758 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 12:09:32.193325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185763 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 12:09:32.193325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185768 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 12:09:32.193325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185774 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 12:09:32.193325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185778 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 12:09:32.193325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185783 2565 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 12:09:32.193325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185788 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 12:09:32.193325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185792 2565 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 12:09:32.193325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185799 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185805 2565 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185827 2565 flags.go:64] FLAG: --kube-reserved="" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185833 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185838 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185843 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185848 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185852 2565 flags.go:64] FLAG: --lock-file="" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185856 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185861 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185866 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185875 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185880 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185885 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185889 2565 flags.go:64] FLAG: --logging-format="text" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185894 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185901 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185905 2565 flags.go:64] FLAG: --manifest-url="" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185909 2565 flags.go:64] FLAG: --manifest-url-header="" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185917 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185922 2565 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185929 2565 flags.go:64] FLAG: --max-pods="110" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185934 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185938 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185942 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 12:09:32.193972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185947 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185952 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185957 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185961 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185972 2565 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185977 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185981 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185986 2565 flags.go:64] FLAG: --pod-cidr="" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185991 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.185999 2565 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186003 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186008 2565 flags.go:64] FLAG: --pods-per-core="0" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186013 2565 flags.go:64] FLAG: --port="10250" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186017 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186022 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-047a7f423be17b2d1" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186027 2565 flags.go:64] FLAG: --qos-reserved="" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186032 2565 flags.go:64] FLAG: --read-only-port="10255" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186036 2565 flags.go:64] FLAG: --register-node="true" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186041 2565 flags.go:64] FLAG: --register-with-taints="" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186048 2565 flags.go:64] FLAG: --registry-burst="10" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186053 2565 flags.go:64] FLAG: --registry-qps="5" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186057 2565 flags.go:64] FLAG: --reserved-cpus="" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186062 2565 flags.go:64] FLAG: --reserved-memory="" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186067 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186074 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 12:09:32.194576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186079 2565 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186083 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186088 2565 flags.go:64] FLAG: --runonce="false" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186092 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186097 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186102 2565 flags.go:64] FLAG: --seccomp-default="false" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186107 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186111 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186117 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186121 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186126 2565 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186131 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186135 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186140 2565 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186144 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186149 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186154 2565 flags.go:64] FLAG: --system-cgroups="" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186159 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186168 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186173 2565 flags.go:64] FLAG: --tls-cert-file="" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186177 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186184 2565 flags.go:64] FLAG: --tls-min-version="" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186188 2565 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186193 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186197 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 12:09:32.195236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186202 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 12:09:32.195859 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186208 2565 flags.go:64] FLAG: --v="2" Jun 08 12:09:32.195859 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186214 2565 flags.go:64] FLAG: --version="false" Jun 08 12:09:32.195859 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186220 2565 flags.go:64] FLAG: --vmodule="" Jun 08 12:09:32.195859 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186226 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 12:09:32.195859 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.186231 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 12:09:32.195859 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186422 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:09:32.195859 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186429 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:09:32.195859 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186434 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:09:32.195859 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186439 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:09:32.195859 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186443 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:09:32.195859 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186448 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:09:32.195859 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186453 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:09:32.195859 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186457 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:09:32.195859 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186461 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:09:32.195859 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186465 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:09:32.195859 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186470 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:09:32.195859 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186474 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:09:32.195859 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186478 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:09:32.195859 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186483 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:09:32.195859 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186487 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:09:32.196352 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186491 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:09:32.196352 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186496 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:09:32.196352 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186500 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:09:32.196352 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186505 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:09:32.196352 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186509 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:09:32.196352 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186514 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:09:32.196352 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186518 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:09:32.196352 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186522 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:09:32.196352 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186525 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:09:32.196352 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186529 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:09:32.196352 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186533 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:09:32.196352 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186537 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:09:32.196352 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186541 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:09:32.196352 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186546 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:09:32.196352 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186550 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:09:32.196352 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186554 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:09:32.196352 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186558 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:09:32.196352 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186565 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:09:32.196352 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186569 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:09:32.196352 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186573 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:09:32.196896 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186577 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:09:32.196896 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186581 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:09:32.196896 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186586 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:09:32.196896 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186592 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:09:32.196896 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186598 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:09:32.196896 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186603 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:09:32.196896 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186607 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:09:32.196896 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186613 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:09:32.196896 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186617 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:09:32.196896 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186621 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:09:32.196896 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186626 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:09:32.196896 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186631 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:09:32.196896 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186636 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:09:32.196896 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186640 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:09:32.196896 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186645 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:09:32.196896 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186649 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:09:32.196896 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186660 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:09:32.196896 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186664 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:09:32.196896 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186669 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:09:32.197362 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186673 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:09:32.197362 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186678 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:09:32.197362 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186682 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:09:32.197362 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186686 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:09:32.197362 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186691 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:09:32.197362 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186697 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:09:32.197362 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186703 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:09:32.197362 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186707 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:09:32.197362 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186711 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:09:32.197362 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186717 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:09:32.197362 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186726 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:09:32.197362 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186731 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:09:32.197362 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186735 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:09:32.197362 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186740 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:09:32.197362 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186745 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:09:32.197362 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186750 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:09:32.197362 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186754 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:09:32.197362 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186759 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:09:32.197362 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186763 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:09:32.197829 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186768 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:09:32.197829 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186772 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:09:32.197829 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186777 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:09:32.197829 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186781 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:09:32.197829 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186785 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:09:32.197829 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186789 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:09:32.197829 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186793 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:09:32.197829 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186798 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:09:32.197829 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186802 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:09:32.197829 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186806 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:09:32.197829 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186832 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:09:32.197829 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186838 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:09:32.197829 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186842 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:09:32.197829 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186847 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:09:32.197829 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186851 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:09:32.197829 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186854 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:09:32.197829 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186859 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:09:32.197829 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186863 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:09:32.197829 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186867 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:09:32.197829 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186871 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:09:32.198333 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186875 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:09:32.198333 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186879 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:09:32.198333 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186883 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:09:32.198333 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186889 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:09:32.198333 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186893 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:09:32.198333 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.186897 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:09:32.198333 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.187493 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 12:09:32.198333 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.194346 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 12:09:32.198333 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.194454 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 12:09:32.198333 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.194475 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 12:09:32.198333 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.194483 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 12:09:32.198333 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194540 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:09:32.198333 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194545 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:09:32.198333 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194548 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:09:32.198333 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194551 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:09:32.198704 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194554 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:09:32.198704 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194558 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:09:32.198704 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194561 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:09:32.198704 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194563 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:09:32.198704 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194566 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:09:32.198704 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194569 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:09:32.198704 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194572 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:09:32.198704 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194574 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:09:32.198704 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194578 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:09:32.198704 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194581 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:09:32.198704 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194583 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:09:32.198704 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194586 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:09:32.198704 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194589 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:09:32.198704 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194592 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:09:32.198704 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194594 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:09:32.198704 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194597 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:09:32.198704 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194600 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:09:32.198704 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194602 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:09:32.198704 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194605 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:09:32.199183 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194607 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:09:32.199183 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194610 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:09:32.199183 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194612 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:09:32.199183 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194615 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:09:32.199183 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194617 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:09:32.199183 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194620 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:09:32.199183 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194623 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:09:32.199183 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194626 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:09:32.199183 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194628 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:09:32.199183 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194632 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:09:32.199183 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194634 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:09:32.199183 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194637 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:09:32.199183 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194639 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:09:32.199183 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194643 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:09:32.199183 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194645 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:09:32.199183 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194647 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:09:32.199183 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194650 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:09:32.199183 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194652 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:09:32.199183 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194655 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:09:32.199641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194658 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:09:32.199641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194660 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:09:32.199641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194664 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:09:32.199641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194668 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:09:32.199641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194672 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:09:32.199641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194674 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:09:32.199641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194677 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:09:32.199641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194680 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:09:32.199641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194682 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:09:32.199641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194685 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:09:32.199641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194687 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:09:32.199641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194690 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:09:32.199641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194692 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:09:32.199641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194694 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:09:32.199641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194697 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:09:32.199641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194699 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:09:32.199641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194702 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:09:32.199641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194704 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:09:32.199641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194706 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:09:32.200125 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194710 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:09:32.200125 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194713 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:09:32.200125 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194715 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:09:32.200125 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194718 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:09:32.200125 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194720 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:09:32.200125 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194723 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:09:32.200125 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194725 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:09:32.200125 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194728 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:09:32.200125 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194730 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:09:32.200125 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194733 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:09:32.200125 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194737 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:09:32.200125 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194740 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:09:32.200125 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194744 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:09:32.200125 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194748 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:09:32.200125 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194751 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:09:32.200125 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194754 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:09:32.200125 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194756 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:09:32.200125 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194760 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:09:32.200125 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194763 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:09:32.200125 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194765 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:09:32.200641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194768 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:09:32.200641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194770 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:09:32.200641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194773 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:09:32.200641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194775 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:09:32.200641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194778 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:09:32.200641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194780 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:09:32.200641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194782 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:09:32.200641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194785 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:09:32.200641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194787 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:09:32.200641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194790 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:09:32.200641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194792 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:09:32.200641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194794 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:09:32.200641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194798 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:09:32.200641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194800 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:09:32.200641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194803 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:09:32.200641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194805 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:09:32.200641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194808 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:09:32.200641 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194826 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:09:32.201152 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.194834 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 12:09:32.201152 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194949 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 12:09:32.201152 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194953 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 12:09:32.201152 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194956 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 12:09:32.201152 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194959 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 12:09:32.201152 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194962 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 12:09:32.201152 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194965 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 12:09:32.201152 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194967 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 12:09:32.201152 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194970 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 12:09:32.201152 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194973 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 12:09:32.201152 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194975 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 12:09:32.201152 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194978 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 12:09:32.201152 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194981 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 12:09:32.201152 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194983 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 12:09:32.201152 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194986 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 12:09:32.201513 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194988 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 12:09:32.201513 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194991 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 12:09:32.201513 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194993 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 12:09:32.201513 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194996 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 12:09:32.201513 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.194998 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 12:09:32.201513 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195001 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 12:09:32.201513 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195003 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 12:09:32.201513 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195006 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 12:09:32.201513 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195008 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 12:09:32.201513 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195010 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 12:09:32.201513 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195013 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 12:09:32.201513 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195016 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 12:09:32.201513 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195019 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 12:09:32.201513 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195022 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 12:09:32.201513 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195024 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 12:09:32.201513 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195027 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 12:09:32.201513 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195029 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 12:09:32.201513 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195031 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 12:09:32.201513 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195034 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 12:09:32.201513 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195036 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 12:09:32.202010 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195039 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 12:09:32.202010 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195041 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 12:09:32.202010 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195043 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 12:09:32.202010 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195046 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 12:09:32.202010 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195048 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 12:09:32.202010 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195052 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 12:09:32.202010 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195054 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 12:09:32.202010 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195057 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 12:09:32.202010 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195059 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 12:09:32.202010 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195062 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 12:09:32.202010 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195066 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 12:09:32.202010 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195069 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 12:09:32.202010 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195071 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 12:09:32.202010 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195074 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 12:09:32.202010 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195076 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 12:09:32.202010 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195079 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 12:09:32.202010 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195081 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 12:09:32.202010 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195084 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 12:09:32.202010 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195086 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 12:09:32.202010 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195088 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 12:09:32.202480 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195091 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 12:09:32.202480 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195093 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 12:09:32.202480 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195096 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 12:09:32.202480 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195098 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 12:09:32.202480 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195101 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 12:09:32.202480 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195104 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 12:09:32.202480 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195107 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 12:09:32.202480 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195109 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 12:09:32.202480 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195113 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 12:09:32.202480 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195116 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 12:09:32.202480 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195119 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 12:09:32.202480 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195122 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 12:09:32.202480 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195124 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 12:09:32.202480 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195127 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 12:09:32.202480 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195129 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 12:09:32.202480 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195131 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 12:09:32.202480 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195134 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 12:09:32.202480 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195136 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 12:09:32.202480 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195139 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 12:09:32.202480 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195141 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 12:09:32.202970 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195143 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 12:09:32.202970 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195146 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 12:09:32.202970 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195149 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 12:09:32.202970 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195152 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 12:09:32.202970 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195154 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 12:09:32.202970 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195156 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 12:09:32.202970 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195159 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 08 12:09:32.202970 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195161 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 12:09:32.202970 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195164 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 12:09:32.202970 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195166 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 12:09:32.202970 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195168 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 12:09:32.202970 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195171 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 12:09:32.202970 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195175 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 12:09:32.202970 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195178 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 12:09:32.202970 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195181 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 12:09:32.202970 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195184 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 12:09:32.202970 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195187 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 12:09:32.202970 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195190 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 12:09:32.202970 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195193 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 12:09:32.203411 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195196 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 12:09:32.203411 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195199 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 12:09:32.203411 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195201 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 12:09:32.203411 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195204 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 12:09:32.203411 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195206 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 12:09:32.203411 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:32.195208 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 12:09:32.203411 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.195213 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 12:09:32.203411 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.195306 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 12:09:32.203411 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.197235 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 12:09:32.203411 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.198426 2565 server.go:1019] "Starting client certificate rotation" Jun 08 12:09:32.203411 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.198528 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 12:09:32.203411 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.199379 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 12:09:32.203411 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.201797 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 12:09:32.215046 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.215022 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 12:09:32.225745 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.225726 2565 log.go:25] "Validated CRI v1 runtime API" Jun 08 12:09:32.228210 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.228197 2565 log.go:25] "Validated CRI v1 image API" Jun 08 12:09:32.229017 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.229002 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 12:09:32.234463 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.234437 2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a964df37-cd57-449f-8b3c-ed0c41ce9939:/dev/nvme0n1p4 b37bb951-cef3-45c6-9b0e-b3a862430272:/dev/nvme0n1p3] Jun 08 12:09:32.234511 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.234463 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 12:09:32.236688 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.236670 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 12:09:32.238554 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.238450 2565 manager.go:216] Machine: {Timestamp:2026-06-08 12:09:32.237998466 +0000 UTC m=+0.353816596 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3156967 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2545e48200feae9e8a78500993d05b SystemUUID:ec2545e4-8200-feae-9e8a-78500993d05b BootID:86a32dfa-ec1f-4ffc-a919-a5695b8b01c4 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2f:22:92:1e:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2f:22:92:1e:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:a4:52:78:ae:8c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 12:09:32.238554 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.238548 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 12:09:32.238663 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.238643 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 12:09:32.242508 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.242486 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 12:09:32.242635 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.242510 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-94.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 12:09:32.243210 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.243200 2565 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 12:09:32.243241 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.243213 2565 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 12:09:32.243241 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.243220 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 12:09:32.243241 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.243231 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 12:09:32.244080 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.244069 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 12:09:32.246777 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.246766 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 08 12:09:32.246924 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.246913 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 12:09:32.246955 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.246943 2565 kubelet.go:486] "Attempting to sync node with API server" Jun 08 12:09:32.246955 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.246953 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 12:09:32.247020 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.246972 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 12:09:32.247020 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.246982 2565 kubelet.go:398] "Adding apiserver pod source" Jun 08 12:09:32.247020 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.246996 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 12:09:32.247330 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.247317 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 12:09:32.247390 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.247342 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 12:09:32.250065 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.250042 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 12:09:32.251375 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.251362 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 12:09:32.251534 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.251392 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 12:09:32.252544 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.252533 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 12:09:32.252583 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.252549 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 12:09:32.252583 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.252555 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 12:09:32.252583 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.252560 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 12:09:32.252583 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.252569 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 12:09:32.252583 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.252574 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 12:09:32.252583 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.252581 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 12:09:32.252583 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.252586 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 12:09:32.252758 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.252593 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 12:09:32.252758 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.252598 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 12:09:32.252758 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.252606 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 12:09:32.252758 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.252611 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 12:09:32.253322 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.253313 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 12:09:32.253322 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.253322 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 12:09:32.256326 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.256309 2565 server.go:1268] "Started kubelet" Jun 08 12:09:32.256432 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.256376 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 12:09:32.256489 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.256383 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 12:09:32.260295 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.260270 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 12:09:32.261001 ip-10-0-137-94 systemd[1]: Started Kubernetes Kubelet. Jun 08 12:09:32.261679 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.261658 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kk7tz" Jun 08 12:09:32.262455 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.262438 2565 server.go:310] "Adding debug handlers to kubelet server" Jun 08 12:09:32.262582 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.262565 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 12:09:32.264695 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.264676 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-94.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 12:09:32.265371 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:32.265348 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 12:09:32.266927 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:32.266901 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-94.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 12:09:32.267838 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:32.266761 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-94.ec2.internal.18b719d322857333 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-94.ec2.internal,UID:ip-10-0-137-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-94.ec2.internal,},FirstTimestamp:2026-06-08 12:09:32.256285491 +0000 UTC m=+0.372103620,LastTimestamp:2026-06-08 12:09:32.256285491 +0000 UTC m=+0.372103620,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-94.ec2.internal,}" Jun 08 12:09:32.268541 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.268522 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kk7tz" Jun 08 12:09:32.269105 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:32.268914 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 12:09:32.271318 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.271304 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 12:09:32.271392 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.271314 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 12:09:32.271392 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:32.271371 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found" Jun 08 12:09:32.272226 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.272206 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 12:09:32.272226 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.272209 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 12:09:32.272407 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.272236 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 12:09:32.272407 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.272340 2565 reconstruct.go:97] "Volume reconstruction finished" Jun 08 12:09:32.272407 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.272358 2565 reconciler.go:29] "Reconciler: start to sync state" Jun 08 12:09:32.272407 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.272386 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 12:09:32.272407 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.272400 2565 factory.go:55] Registering systemd factory Jun 08 12:09:32.272407 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.272409 2565 factory.go:223] Registration of the systemd container factory successfully Jun 08 12:09:32.272666 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.272604 2565 factory.go:153] Registering CRI-O factory Jun 08 12:09:32.272666 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.272612 2565 factory.go:223] Registration of the crio container factory successfully Jun 08 12:09:32.272666 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.272631 2565 factory.go:103] Registering Raw factory Jun 08 12:09:32.272666 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.272641 2565 manager.go:1196] Started watching for new ooms in manager Jun 08 12:09:32.273186 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.273047 2565 manager.go:349] Starting recovery of all containers Jun 08 12:09:32.273847 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:32.273805 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 12:09:32.273936 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:32.273915 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-94.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 12:09:32.279682 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.279613 2565 manager.go:354] Recovery completed Jun 08 12:09:32.285031 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.285020 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:09:32.287620 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.287605 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:09:32.287690 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.287633 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:09:32.287690 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.287644 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:09:32.288316 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.288297 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 12:09:32.288316 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.288316 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 12:09:32.288446 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.288335 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 08 12:09:32.288446 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.288385 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:09:32.289556 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.289540 2565 policy_none.go:49] "None policy: Start" Jun 08 12:09:32.289651 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.289642 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 12:09:32.289728 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.289716 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 12:09:32.290419 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:32.290124 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-94.ec2.internal.18b719d3246391e1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-94.ec2.internal,UID:ip-10-0-137-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-94.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-94.ec2.internal,},FirstTimestamp:2026-06-08 12:09:32.287619553 +0000 UTC m=+0.403437682,LastTimestamp:2026-06-08 12:09:32.287619553 +0000 UTC m=+0.403437682,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-94.ec2.internal,}" Jun 08 12:09:32.291013 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.290993 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:09:32.291101 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.291026 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:09:32.291101 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.291039 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:09:32.291329 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.291313 2565 policy_none.go:47] "Start" Jun 08 12:09:32.326388 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.326374 2565 manager.go:337] "Starting Device Plugin manager" Jun 08 12:09:32.357001 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:32.326421 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 12:09:32.357001 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.326432 2565 server.go:87] "Starting device plugin registration server" Jun 08 12:09:32.357001 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.326642 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 12:09:32.357001 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.326654 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 12:09:32.357001 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.326749 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 12:09:32.357001 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.326858 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 12:09:32.357001 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.326867 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 12:09:32.357001 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:32.327530 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 12:09:32.357001 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:32.327571 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-94.ec2.internal\" not found" Jun 08 12:09:32.357001 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.339735 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 12:09:32.357001 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.340991 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 12:09:32.357001 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.341034 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 12:09:32.357001 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.341057 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 12:09:32.357001 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:32.341125 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 12:09:32.357001 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.343225 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:09:32.426918 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.426873 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:09:32.427737 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.427722 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:09:32.427825 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.427752 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:09:32.427825 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.427762 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:09:32.427825 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.427783 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-94.ec2.internal" Jun 08 12:09:32.436488 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.436473 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-94.ec2.internal" Jun 08 12:09:32.436544 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:32.436494 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-94.ec2.internal\": node \"ip-10-0-137-94.ec2.internal\" not found" Jun 08 12:09:32.441302 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.441287 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-94.ec2.internal"] Jun 08 12:09:32.441365 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.441338 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:09:32.442575 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.442559 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:09:32.442638 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.442586 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:09:32.442638 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.442596 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:09:32.443785 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.443774 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:09:32.443923 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.443909 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal" Jun 08 12:09:32.443966 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.443940 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:09:32.444458 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.444443 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:09:32.444547 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.444466 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:09:32.444547 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.444469 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:09:32.444547 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.444479 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:09:32.444547 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.444495 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:09:32.444547 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.444507 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:09:32.445651 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.445635 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-94.ec2.internal" Jun 08 12:09:32.445730 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.445663 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 12:09:32.447621 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.447606 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientMemory" Jun 08 12:09:32.447696 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.447631 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 12:09:32.447696 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.447642 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeHasSufficientPID" Jun 08 12:09:32.449548 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:32.449530 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found" Jun 08 12:09:32.465351 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:32.465332 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-94.ec2.internal\" not found" node="ip-10-0-137-94.ec2.internal" Jun 08 12:09:32.469305 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:32.469287 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-94.ec2.internal\" not found" node="ip-10-0-137-94.ec2.internal" Jun 08 12:09:32.549669 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:32.549640 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found" Jun 08 12:09:32.573891 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.573870 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/694565ca45387930e7b7b65815bbef04-config\") pod \"kube-apiserver-proxy-ip-10-0-137-94.ec2.internal\" (UID: \"694565ca45387930e7b7b65815bbef04\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-94.ec2.internal" Jun 08 12:09:32.573968 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.573895 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac9456f1bb448bd4c72bff97da6deb0c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal\" (UID: \"ac9456f1bb448bd4c72bff97da6deb0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal" Jun 08 12:09:32.573968 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.573913 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac9456f1bb448bd4c72bff97da6deb0c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal\" (UID: \"ac9456f1bb448bd4c72bff97da6deb0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal" Jun 08 12:09:32.650506 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:32.650478 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found" Jun 08 12:09:32.674906 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.674887 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac9456f1bb448bd4c72bff97da6deb0c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal\" (UID: \"ac9456f1bb448bd4c72bff97da6deb0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal" Jun 08 12:09:32.674957 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.674912 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac9456f1bb448bd4c72bff97da6deb0c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal\" (UID: \"ac9456f1bb448bd4c72bff97da6deb0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal" Jun 08 12:09:32.674957 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.674929 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/694565ca45387930e7b7b65815bbef04-config\") pod \"kube-apiserver-proxy-ip-10-0-137-94.ec2.internal\" (UID: \"694565ca45387930e7b7b65815bbef04\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-94.ec2.internal" Jun 08 12:09:32.675057 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.674980 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/694565ca45387930e7b7b65815bbef04-config\") pod \"kube-apiserver-proxy-ip-10-0-137-94.ec2.internal\" (UID: \"694565ca45387930e7b7b65815bbef04\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-94.ec2.internal" Jun 08 12:09:32.675057 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.674985 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac9456f1bb448bd4c72bff97da6deb0c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal\" (UID: \"ac9456f1bb448bd4c72bff97da6deb0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal" Jun 08 12:09:32.675057 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.675029 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac9456f1bb448bd4c72bff97da6deb0c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal\" (UID: \"ac9456f1bb448bd4c72bff97da6deb0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal" Jun 08 12:09:32.751331 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:32.751258 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found" Jun 08 12:09:32.769412 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.769395 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal" Jun 08 12:09:32.774049 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:32.774033 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-94.ec2.internal" Jun 08 12:09:32.851716 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:32.851691 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found" Jun 08 12:09:32.952299 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:32.952280 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found" Jun 08 12:09:33.052826 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:33.052751 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found" Jun 08 12:09:33.119245 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:33.119224 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:09:33.153457 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:33.153424 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found" Jun 08 12:09:33.197889 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:33.197868 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 12:09:33.198434 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:33.197989 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 12:09:33.198434 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:33.198020 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 12:09:33.253869 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:33.253649 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found" Jun 08 12:09:33.263898 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:33.263877 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:09:33.281621 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:33.281593 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 12:04:32 +0000 UTC" deadline="2027-11-09 19:10:22.713032431 +0000 UTC" Jun 08 12:09:33.281621 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:33.281618 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12463h0m49.431417793s" Jun 08 12:09:33.316874 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:33.316849 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac9456f1bb448bd4c72bff97da6deb0c.slice/crio-8874724fea76ae3a283acedbc04244d7713f849c99b7537671679581775aec74 WatchSource:0}: Error finding container 8874724fea76ae3a283acedbc04244d7713f849c99b7537671679581775aec74: Status 404 returned error can't find the container with id 8874724fea76ae3a283acedbc04244d7713f849c99b7537671679581775aec74 Jun 08 12:09:33.317280 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:33.317262 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod694565ca45387930e7b7b65815bbef04.slice/crio-0cd4864f3ed9df78eff1614b5286e98f915b4af8591a87ba330d491066bf18a1 WatchSource:0}: Error finding container 0cd4864f3ed9df78eff1614b5286e98f915b4af8591a87ba330d491066bf18a1: Status 404 returned error can't find the container with id 0cd4864f3ed9df78eff1614b5286e98f915b4af8591a87ba330d491066bf18a1 Jun 08 12:09:33.325326 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:33.325307 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 12:09:33.344408 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:33.344372 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-94.ec2.internal" event={"ID":"694565ca45387930e7b7b65815bbef04","Type":"ContainerStarted","Data":"0cd4864f3ed9df78eff1614b5286e98f915b4af8591a87ba330d491066bf18a1"} Jun 08 12:09:33.345259 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:33.345236 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal" event={"ID":"ac9456f1bb448bd4c72bff97da6deb0c","Type":"ContainerStarted","Data":"8874724fea76ae3a283acedbc04244d7713f849c99b7537671679581775aec74"} Jun 08 12:09:33.354389 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:33.354372 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-94.ec2.internal\" not found" Jun 08 12:09:33.431427 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:33.431408 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:09:33.472255 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:33.472237 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal" Jun 08 12:09:33.484805 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:33.484785 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 12:09:33.485870 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:33.485858 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-94.ec2.internal" Jun 08 12:09:33.492368 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:33.492355 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 12:09:34.027034 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.027004 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:09:34.247191 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.247166 2565 apiserver.go:52] "Watching apiserver" Jun 08 12:09:34.254736 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.254714 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 12:09:34.255962 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.255936 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-k5brj","openshift-dns/node-resolver-8c2bq","openshift-multus/multus-additional-cni-plugins-d9dk7","openshift-multus/multus-vrgwf","openshift-network-operator/iptables-alerter-vz44k","kube-system/global-pull-secret-syncer-7pwsz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v","openshift-image-registry/node-ca-6rnhx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal","openshift-multus/network-metrics-daemon-g8qk7","openshift-network-diagnostics/network-check-target-s2sh7","openshift-ovn-kubernetes/ovnkube-node-kwxhk","kube-system/konnectivity-agent-4krtw","kube-system/kube-apiserver-proxy-ip-10-0-137-94.ec2.internal"] Jun 08 12:09:34.257393 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.257368 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" Jun 08 12:09:34.258597 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.258577 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4krtw" Jun 08 12:09:34.259862 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.259843 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.260074 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.260058 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 12:09:34.260074 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.260072 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 12:09:34.260217 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.260205 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tcv6g\"" Jun 08 12:09:34.260425 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.260410 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 12:09:34.260781 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.260760 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 12:09:34.261336 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.261002 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nj8ng\"" Jun 08 12:09:34.261336 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.261049 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 12:09:34.261336 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.261049 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.262284 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.262266 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 12:09:34.262284 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.262277 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vz44k" Jun 08 12:09:34.263960 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.263922 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:34.264048 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:34.264009 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pwsz" podUID="4e3e7141-3861-4baa-b7ea-ca348f74a095" Jun 08 12:09:34.264181 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.264160 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 12:09:34.265002 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.264984 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 12:09:34.265326 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.265307 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6rnhx" Jun 08 12:09:34.270182 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.269103 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 12:09:34.270182 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.269346 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 12:09:34.270182 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.269505 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 12:09:34.270182 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.269560 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9srp2\"" Jun 08 12:09:34.270182 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.269634 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 12:09:34.270182 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.269852 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 12:09:34.270182 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.269893 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:09:34.270182 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.269954 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.270182 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.269966 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-brnhl\"" Jun 08 12:09:34.270639 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.270611 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2xlng\"" Jun 08 12:09:34.270694 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.270641 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8c2bq" Jun 08 12:09:34.270694 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.270669 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 12:09:34.270919 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.270902 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7bz8k\"" Jun 08 12:09:34.271237 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.271214 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 12:09:34.271237 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.271231 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 12:09:34.272312 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.272293 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:09:34.272427 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.272410 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 12:09:34.272494 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.272457 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:09:34.272933 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:34.272513 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8qk7" podUID="723a030e-60ee-457c-ae18-aac839fd2a5a" Jun 08 12:09:34.272933 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.272660 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-glr2l\"" Jun 08 12:09:34.272933 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.272736 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 12:09:34.273121 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.272974 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 12:09:34.273453 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.273436 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-74gqk\"" Jun 08 12:09:34.273543 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.273472 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 12:09:34.273808 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.273792 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:09:34.273905 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:34.273860 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2sh7" podUID="5fe99017-3c64-437c-904d-397ce9012add" Jun 08 12:09:34.276758 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.276743 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.279046 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.278965 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5dj5v\"" Jun 08 12:09:34.281016 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.281000 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 12:09:34.281476 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.281450 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 12:09:34.282201 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.282080 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 12:09:34.282294 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.282214 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 12:09:34.282397 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.282380 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 12:09:34.282458 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.282424 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 12:09:34.284302 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284283 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-etc-kubernetes\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.284391 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284312 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e3e7141-3861-4baa-b7ea-ca348f74a095-kubelet-config\") pod \"global-pull-secret-syncer-7pwsz\" (UID: \"4e3e7141-3861-4baa-b7ea-ca348f74a095\") " pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:34.284391 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284327 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-var-lib-kubelet\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.284391 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284345 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-cnibin\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.284391 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284367 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2qg4\" (UniqueName: \"kubernetes.io/projected/ca21fc5a-7e02-47e3-bba1-b6df850bea85-kube-api-access-l2qg4\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.284578 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284409 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7680a2d2-3d3f-4a76-88c5-462b61659f38-cnibin\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.284578 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284433 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7680a2d2-3d3f-4a76-88c5-462b61659f38-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.284578 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284456 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-etc-sysconfig\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.284578 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284477 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/59d4373d-5364-409b-955c-9a4cce583241-sys-fs\") pod \"aws-ebs-csi-driver-node-jtm4v\" (UID: \"59d4373d-5364-409b-955c-9a4cce583241\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" Jun 08 12:09:34.284578 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284500 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7680a2d2-3d3f-4a76-88c5-462b61659f38-cni-binary-copy\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.284578 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284539 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/59d4373d-5364-409b-955c-9a4cce583241-device-dir\") pod \"aws-ebs-csi-driver-node-jtm4v\" (UID: \"59d4373d-5364-409b-955c-9a4cce583241\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" Jun 08 12:09:34.284578 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284574 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-host-var-lib-cni-multus\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.284868 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284598 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-host-run-multus-certs\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.284868 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284620 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2a25093c-ba21-4727-a780-cb3a576fc3bf-etc-tuned\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.284868 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284641 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d55th\" (UniqueName: \"kubernetes.io/projected/aa07a65f-f29b-4938-8167-03e6245a6228-kube-api-access-d55th\") pod \"node-resolver-8c2bq\" (UID: \"aa07a65f-f29b-4938-8167-03e6245a6228\") " pod="openshift-dns/node-resolver-8c2bq" Jun 08 12:09:34.284868 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284666 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-host-run-k8s-cni-cncf-io\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.284868 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284687 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7680a2d2-3d3f-4a76-88c5-462b61659f38-os-release\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.284868 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284702 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-hostroot\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.284868 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284726 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/59d4373d-5364-409b-955c-9a4cce583241-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jtm4v\" (UID: \"59d4373d-5364-409b-955c-9a4cce583241\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" Jun 08 12:09:34.284868 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284771 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6a3de442-4644-42ce-a441-9b867aaf3071-agent-certs\") pod \"konnectivity-agent-4krtw\" (UID: \"6a3de442-4644-42ce-a441-9b867aaf3071\") " pod="kube-system/konnectivity-agent-4krtw" Jun 08 12:09:34.284868 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284829 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-os-release\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.284868 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284864 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-multus-socket-dir-parent\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.285320 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284891 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-host-run-netns\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.285320 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284924 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bcb07d4-39cc-41fa-bf34-e7d119414144-host\") pod \"node-ca-6rnhx\" (UID: \"5bcb07d4-39cc-41fa-bf34-e7d119414144\") " pod="openshift-image-registry/node-ca-6rnhx" Jun 08 12:09:34.285320 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284968 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7680a2d2-3d3f-4a76-88c5-462b61659f38-system-cni-dir\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.285320 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.284994 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-multus-cni-dir\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.285320 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285019 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca21fc5a-7e02-47e3-bba1-b6df850bea85-cni-binary-copy\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.285320 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285042 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca21fc5a-7e02-47e3-bba1-b6df850bea85-multus-daemon-config\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.285320 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285107 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df7d634b-fbaa-4493-9c43-84e4dabc4b8d-iptables-alerter-script\") pod \"iptables-alerter-vz44k\" (UID: \"df7d634b-fbaa-4493-9c43-84e4dabc4b8d\") " pod="openshift-network-operator/iptables-alerter-vz44k" Jun 08 12:09:34.285320 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285131 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df7d634b-fbaa-4493-9c43-84e4dabc4b8d-host-slash\") pod \"iptables-alerter-vz44k\" (UID: \"df7d634b-fbaa-4493-9c43-84e4dabc4b8d\") " pod="openshift-network-operator/iptables-alerter-vz44k" Jun 08 12:09:34.285320 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285166 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-etc-kubernetes\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.285320 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285200 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-etc-modprobe-d\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.285320 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285224 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-system-cni-dir\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.285320 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285263 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret\") pod \"global-pull-secret-syncer-7pwsz\" (UID: \"4e3e7141-3861-4baa-b7ea-ca348f74a095\") " pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:34.285320 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285299 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs\") pod \"network-metrics-daemon-g8qk7\" (UID: \"723a030e-60ee-457c-ae18-aac839fd2a5a\") " pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:09:34.285320 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285324 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hf8x\" (UniqueName: \"kubernetes.io/projected/7680a2d2-3d3f-4a76-88c5-462b61659f38-kube-api-access-4hf8x\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.286015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285350 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spjdc\" (UniqueName: \"kubernetes.io/projected/df7d634b-fbaa-4493-9c43-84e4dabc4b8d-kube-api-access-spjdc\") pod \"iptables-alerter-vz44k\" (UID: \"df7d634b-fbaa-4493-9c43-84e4dabc4b8d\") " pod="openshift-network-operator/iptables-alerter-vz44k" Jun 08 12:09:34.286015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285382 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-lib-modules\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.286015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285401 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/59d4373d-5364-409b-955c-9a4cce583241-registration-dir\") pod \"aws-ebs-csi-driver-node-jtm4v\" (UID: \"59d4373d-5364-409b-955c-9a4cce583241\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" Jun 08 12:09:34.286015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285417 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/59d4373d-5364-409b-955c-9a4cce583241-etc-selinux\") pod \"aws-ebs-csi-driver-node-jtm4v\" (UID: \"59d4373d-5364-409b-955c-9a4cce583241\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" Jun 08 12:09:34.286015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285430 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-host-var-lib-kubelet\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.286015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285450 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpdk8\" (UniqueName: \"kubernetes.io/projected/723a030e-60ee-457c-ae18-aac839fd2a5a-kube-api-access-wpdk8\") pod \"network-metrics-daemon-g8qk7\" (UID: \"723a030e-60ee-457c-ae18-aac839fd2a5a\") " pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:09:34.286015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285470 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e3e7141-3861-4baa-b7ea-ca348f74a095-dbus\") pod \"global-pull-secret-syncer-7pwsz\" (UID: \"4e3e7141-3861-4baa-b7ea-ca348f74a095\") " pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:34.286015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285500 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmg5h\" (UniqueName: \"kubernetes.io/projected/2a25093c-ba21-4727-a780-cb3a576fc3bf-kube-api-access-rmg5h\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.286015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285531 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/59d4373d-5364-409b-955c-9a4cce583241-socket-dir\") pod \"aws-ebs-csi-driver-node-jtm4v\" (UID: \"59d4373d-5364-409b-955c-9a4cce583241\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" Jun 08 12:09:34.286015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285549 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6s7w\" (UniqueName: \"kubernetes.io/projected/59d4373d-5364-409b-955c-9a4cce583241-kube-api-access-t6s7w\") pod \"aws-ebs-csi-driver-node-jtm4v\" (UID: \"59d4373d-5364-409b-955c-9a4cce583241\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" Jun 08 12:09:34.286015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285574 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-multus-conf-dir\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.286015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285595 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldr5v\" (UniqueName: \"kubernetes.io/projected/5bcb07d4-39cc-41fa-bf34-e7d119414144-kube-api-access-ldr5v\") pod \"node-ca-6rnhx\" (UID: \"5bcb07d4-39cc-41fa-bf34-e7d119414144\") " pod="openshift-image-registry/node-ca-6rnhx" Jun 08 12:09:34.286015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285619 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-run\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.286015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285646 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7680a2d2-3d3f-4a76-88c5-462b61659f38-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.286015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285671 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-etc-sysctl-d\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.286015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285695 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-host\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.286725 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285719 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa07a65f-f29b-4938-8167-03e6245a6228-hosts-file\") pod \"node-resolver-8c2bq\" (UID: \"aa07a65f-f29b-4938-8167-03e6245a6228\") " pod="openshift-dns/node-resolver-8c2bq" Jun 08 12:09:34.286725 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285741 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-host-var-lib-cni-bin\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.286725 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285759 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-etc-systemd\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.286725 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285777 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-sys\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.286725 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285803 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a25093c-ba21-4727-a780-cb3a576fc3bf-tmp\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.286725 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285873 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7680a2d2-3d3f-4a76-88c5-462b61659f38-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.286725 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285900 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6a3de442-4644-42ce-a441-9b867aaf3071-konnectivity-ca\") pod \"konnectivity-agent-4krtw\" (UID: \"6a3de442-4644-42ce-a441-9b867aaf3071\") " pod="kube-system/konnectivity-agent-4krtw" Jun 08 12:09:34.286725 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285922 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5bcb07d4-39cc-41fa-bf34-e7d119414144-serviceca\") pod \"node-ca-6rnhx\" (UID: \"5bcb07d4-39cc-41fa-bf34-e7d119414144\") " pod="openshift-image-registry/node-ca-6rnhx" Jun 08 12:09:34.286725 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285943 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa07a65f-f29b-4938-8167-03e6245a6228-tmp-dir\") pod \"node-resolver-8c2bq\" (UID: \"aa07a65f-f29b-4938-8167-03e6245a6228\") " pod="openshift-dns/node-resolver-8c2bq" Jun 08 12:09:34.286725 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.285965 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-etc-sysctl-conf\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.288874 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.288856 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 12:09:34.322421 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.322398 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ntznl" Jun 08 12:09:34.330178 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.330159 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ntznl" Jun 08 12:09:34.373090 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.373074 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 12:09:34.387099 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387070 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-run-systemd\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.387208 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387104 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mspnb\" (UniqueName: \"kubernetes.io/projected/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-kube-api-access-mspnb\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.387208 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387123 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-host-run-k8s-cni-cncf-io\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.387208 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387148 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7680a2d2-3d3f-4a76-88c5-462b61659f38-os-release\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.387208 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387193 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-host-run-k8s-cni-cncf-io\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.387208 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387205 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7680a2d2-3d3f-4a76-88c5-462b61659f38-os-release\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.387503 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387232 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-hostroot\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.387503 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387254 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-log-socket\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.387503 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387279 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-ovn-node-metrics-cert\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.387503 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387304 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/59d4373d-5364-409b-955c-9a4cce583241-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jtm4v\" (UID: \"59d4373d-5364-409b-955c-9a4cce583241\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" Jun 08 12:09:34.387503 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387328 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6a3de442-4644-42ce-a441-9b867aaf3071-agent-certs\") pod \"konnectivity-agent-4krtw\" (UID: \"6a3de442-4644-42ce-a441-9b867aaf3071\") " pod="kube-system/konnectivity-agent-4krtw" Jun 08 12:09:34.387503 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387334 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-hostroot\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.387503 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387347 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-os-release\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.387503 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387358 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/59d4373d-5364-409b-955c-9a4cce583241-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jtm4v\" (UID: \"59d4373d-5364-409b-955c-9a4cce583241\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" Jun 08 12:09:34.387503 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387375 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-multus-socket-dir-parent\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.387503 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387391 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-os-release\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.387503 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387398 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-host-run-netns\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.387503 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387412 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bcb07d4-39cc-41fa-bf34-e7d119414144-host\") pod \"node-ca-6rnhx\" (UID: \"5bcb07d4-39cc-41fa-bf34-e7d119414144\") " pod="openshift-image-registry/node-ca-6rnhx" Jun 08 12:09:34.387503 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387424 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-multus-socket-dir-parent\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.387503 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387427 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7680a2d2-3d3f-4a76-88c5-462b61659f38-system-cni-dir\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.387503 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387448 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-host-run-netns\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.387503 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387448 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-multus-cni-dir\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.387503 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387475 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bcb07d4-39cc-41fa-bf34-e7d119414144-host\") pod \"node-ca-6rnhx\" (UID: \"5bcb07d4-39cc-41fa-bf34-e7d119414144\") " pod="openshift-image-registry/node-ca-6rnhx" Jun 08 12:09:34.387503 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387480 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca21fc5a-7e02-47e3-bba1-b6df850bea85-cni-binary-copy\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.388261 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387520 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca21fc5a-7e02-47e3-bba1-b6df850bea85-multus-daemon-config\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.388261 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387532 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-multus-cni-dir\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.388261 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387480 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7680a2d2-3d3f-4a76-88c5-462b61659f38-system-cni-dir\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.388261 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387546 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df7d634b-fbaa-4493-9c43-84e4dabc4b8d-iptables-alerter-script\") pod \"iptables-alerter-vz44k\" (UID: \"df7d634b-fbaa-4493-9c43-84e4dabc4b8d\") " pod="openshift-network-operator/iptables-alerter-vz44k" Jun 08 12:09:34.388261 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387569 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df7d634b-fbaa-4493-9c43-84e4dabc4b8d-host-slash\") pod \"iptables-alerter-vz44k\" (UID: \"df7d634b-fbaa-4493-9c43-84e4dabc4b8d\") " pod="openshift-network-operator/iptables-alerter-vz44k" Jun 08 12:09:34.388261 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387592 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-host-cni-netd\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.388261 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387616 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-etc-kubernetes\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.388261 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387637 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-etc-modprobe-d\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.388261 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387634 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 12:09:34.388261 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387681 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/df7d634b-fbaa-4493-9c43-84e4dabc4b8d-host-slash\") pod \"iptables-alerter-vz44k\" (UID: \"df7d634b-fbaa-4493-9c43-84e4dabc4b8d\") " pod="openshift-network-operator/iptables-alerter-vz44k" Jun 08 12:09:34.388261 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387734 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-etc-kubernetes\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.388261 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387761 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-system-cni-dir\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.388261 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387787 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret\") pod \"global-pull-secret-syncer-7pwsz\" (UID: \"4e3e7141-3861-4baa-b7ea-ca348f74a095\") " pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:34.388261 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387831 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs\") pod \"network-metrics-daemon-g8qk7\" (UID: \"723a030e-60ee-457c-ae18-aac839fd2a5a\") " pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:09:34.388261 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387857 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hf8x\" (UniqueName: \"kubernetes.io/projected/7680a2d2-3d3f-4a76-88c5-462b61659f38-kube-api-access-4hf8x\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.388261 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387883 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spjdc\" (UniqueName: \"kubernetes.io/projected/df7d634b-fbaa-4493-9c43-84e4dabc4b8d-kube-api-access-spjdc\") pod \"iptables-alerter-vz44k\" (UID: \"df7d634b-fbaa-4493-9c43-84e4dabc4b8d\") " pod="openshift-network-operator/iptables-alerter-vz44k" Jun 08 12:09:34.388261 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387905 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-lib-modules\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.388971 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387944 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/59d4373d-5364-409b-955c-9a4cce583241-registration-dir\") pod \"aws-ebs-csi-driver-node-jtm4v\" (UID: \"59d4373d-5364-409b-955c-9a4cce583241\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" Jun 08 12:09:34.388971 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.387953 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca21fc5a-7e02-47e3-bba1-b6df850bea85-cni-binary-copy\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.388971 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.388028 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-system-cni-dir\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.388971 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:34.388044 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:34.388971 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:34.388055 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:34.388971 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.388062 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca21fc5a-7e02-47e3-bba1-b6df850bea85-multus-daemon-config\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.388971 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.388159 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-lib-modules\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.388971 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.388169 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/df7d634b-fbaa-4493-9c43-84e4dabc4b8d-iptables-alerter-script\") pod \"iptables-alerter-vz44k\" (UID: \"df7d634b-fbaa-4493-9c43-84e4dabc4b8d\") " pod="openshift-network-operator/iptables-alerter-vz44k" Jun 08 12:09:34.388971 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.388241 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/59d4373d-5364-409b-955c-9a4cce583241-etc-selinux\") pod \"aws-ebs-csi-driver-node-jtm4v\" (UID: \"59d4373d-5364-409b-955c-9a4cce583241\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" Jun 08 12:09:34.388971 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.388278 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/59d4373d-5364-409b-955c-9a4cce583241-etc-selinux\") pod \"aws-ebs-csi-driver-node-jtm4v\" (UID: \"59d4373d-5364-409b-955c-9a4cce583241\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" Jun 08 12:09:34.388971 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.388285 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-etc-modprobe-d\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.388971 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:34.388313 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs podName:723a030e-60ee-457c-ae18-aac839fd2a5a nodeName:}" failed. No retries permitted until 2026-06-08 12:09:34.888257898 +0000 UTC m=+3.004076023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs") pod "network-metrics-daemon-g8qk7" (UID: "723a030e-60ee-457c-ae18-aac839fd2a5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:34.388971 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.388289 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/59d4373d-5364-409b-955c-9a4cce583241-registration-dir\") pod \"aws-ebs-csi-driver-node-jtm4v\" (UID: \"59d4373d-5364-409b-955c-9a4cce583241\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" Jun 08 12:09:34.388971 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:34.388371 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret podName:4e3e7141-3861-4baa-b7ea-ca348f74a095 nodeName:}" failed. No retries permitted until 2026-06-08 12:09:34.888358721 +0000 UTC m=+3.004176843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret") pod "global-pull-secret-syncer-7pwsz" (UID: "4e3e7141-3861-4baa-b7ea-ca348f74a095") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:34.388971 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.388472 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-host-var-lib-kubelet\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.388971 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.388591 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpdk8\" (UniqueName: \"kubernetes.io/projected/723a030e-60ee-457c-ae18-aac839fd2a5a-kube-api-access-wpdk8\") pod \"network-metrics-daemon-g8qk7\" (UID: \"723a030e-60ee-457c-ae18-aac839fd2a5a\") " pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:09:34.388971 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.388604 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-host-var-lib-kubelet\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.389696 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.388617 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-host-slash\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.389696 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.388644 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-run-ovn\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.389696 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.388746 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.389696 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.388770 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-ovnkube-config\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.389696 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.388790 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e3e7141-3861-4baa-b7ea-ca348f74a095-dbus\") pod \"global-pull-secret-syncer-7pwsz\" (UID: \"4e3e7141-3861-4baa-b7ea-ca348f74a095\") " pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:34.389696 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.388845 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmg5h\" (UniqueName: \"kubernetes.io/projected/2a25093c-ba21-4727-a780-cb3a576fc3bf-kube-api-access-rmg5h\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.389696 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.388867 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-systemd-units\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.389696 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.388891 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmmzd\" (UniqueName: \"kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd\") pod \"network-check-target-s2sh7\" (UID: \"5fe99017-3c64-437c-904d-397ce9012add\") " pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:09:34.389696 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.388895 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e3e7141-3861-4baa-b7ea-ca348f74a095-dbus\") pod \"global-pull-secret-syncer-7pwsz\" (UID: \"4e3e7141-3861-4baa-b7ea-ca348f74a095\") " pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:34.389696 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.388933 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/59d4373d-5364-409b-955c-9a4cce583241-socket-dir\") pod \"aws-ebs-csi-driver-node-jtm4v\" (UID: \"59d4373d-5364-409b-955c-9a4cce583241\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" Jun 08 12:09:34.389696 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.388983 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6s7w\" (UniqueName: \"kubernetes.io/projected/59d4373d-5364-409b-955c-9a4cce583241-kube-api-access-t6s7w\") pod \"aws-ebs-csi-driver-node-jtm4v\" (UID: \"59d4373d-5364-409b-955c-9a4cce583241\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" Jun 08 12:09:34.389696 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389013 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/59d4373d-5364-409b-955c-9a4cce583241-socket-dir\") pod \"aws-ebs-csi-driver-node-jtm4v\" (UID: \"59d4373d-5364-409b-955c-9a4cce583241\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" Jun 08 12:09:34.389696 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389023 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-multus-conf-dir\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.389696 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389066 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-multus-conf-dir\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.389696 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389083 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldr5v\" (UniqueName: \"kubernetes.io/projected/5bcb07d4-39cc-41fa-bf34-e7d119414144-kube-api-access-ldr5v\") pod \"node-ca-6rnhx\" (UID: \"5bcb07d4-39cc-41fa-bf34-e7d119414144\") " pod="openshift-image-registry/node-ca-6rnhx" Jun 08 12:09:34.389696 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389104 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-run\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.389696 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389157 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-run\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.390514 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389226 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-env-overrides\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.390514 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389256 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7680a2d2-3d3f-4a76-88c5-462b61659f38-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.390514 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389276 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-etc-sysctl-d\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.390514 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389325 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-host\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.390514 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389364 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa07a65f-f29b-4938-8167-03e6245a6228-hosts-file\") pod \"node-resolver-8c2bq\" (UID: \"aa07a65f-f29b-4938-8167-03e6245a6228\") " pod="openshift-dns/node-resolver-8c2bq" Jun 08 12:09:34.390514 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389392 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-host-kubelet\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.390514 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389415 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-host-run-netns\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.390514 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389367 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-etc-sysctl-d\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.390514 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389395 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-host\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.390514 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389446 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-var-lib-openvswitch\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.390514 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389424 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa07a65f-f29b-4938-8167-03e6245a6228-hosts-file\") pod \"node-resolver-8c2bq\" (UID: \"aa07a65f-f29b-4938-8167-03e6245a6228\") " pod="openshift-dns/node-resolver-8c2bq" Jun 08 12:09:34.390514 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389472 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-host-var-lib-cni-bin\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.390514 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389492 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-etc-systemd\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.390514 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389496 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-host-var-lib-cni-bin\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.390514 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389514 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-sys\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.390514 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389527 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a25093c-ba21-4727-a780-cb3a576fc3bf-tmp\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.390514 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389535 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-etc-systemd\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.391367 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389544 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-run-openvswitch\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.391367 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389568 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-node-log\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.391367 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389580 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-sys\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.391367 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389595 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7680a2d2-3d3f-4a76-88c5-462b61659f38-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.391367 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389622 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6a3de442-4644-42ce-a441-9b867aaf3071-konnectivity-ca\") pod \"konnectivity-agent-4krtw\" (UID: \"6a3de442-4644-42ce-a441-9b867aaf3071\") " pod="kube-system/konnectivity-agent-4krtw" Jun 08 12:09:34.391367 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389661 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5bcb07d4-39cc-41fa-bf34-e7d119414144-serviceca\") pod \"node-ca-6rnhx\" (UID: \"5bcb07d4-39cc-41fa-bf34-e7d119414144\") " pod="openshift-image-registry/node-ca-6rnhx" Jun 08 12:09:34.391367 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389684 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa07a65f-f29b-4938-8167-03e6245a6228-tmp-dir\") pod \"node-resolver-8c2bq\" (UID: \"aa07a65f-f29b-4938-8167-03e6245a6228\") " pod="openshift-dns/node-resolver-8c2bq" Jun 08 12:09:34.391367 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389714 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-etc-sysctl-conf\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.391367 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389740 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-etc-kubernetes\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.391367 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389778 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e3e7141-3861-4baa-b7ea-ca348f74a095-kubelet-config\") pod \"global-pull-secret-syncer-7pwsz\" (UID: \"4e3e7141-3861-4baa-b7ea-ca348f74a095\") " pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:34.391367 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389802 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-var-lib-kubelet\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.391367 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389834 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7680a2d2-3d3f-4a76-88c5-462b61659f38-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.391367 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389847 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-ovnkube-script-lib\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.391367 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389882 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-cnibin\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.391367 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389930 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2qg4\" (UniqueName: \"kubernetes.io/projected/ca21fc5a-7e02-47e3-bba1-b6df850bea85-kube-api-access-l2qg4\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.391367 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.389956 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7680a2d2-3d3f-4a76-88c5-462b61659f38-cnibin\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.391367 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390001 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-cnibin\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.392262 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390093 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e3e7141-3861-4baa-b7ea-ca348f74a095-kubelet-config\") pod \"global-pull-secret-syncer-7pwsz\" (UID: \"4e3e7141-3861-4baa-b7ea-ca348f74a095\") " pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:34.392262 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390128 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7680a2d2-3d3f-4a76-88c5-462b61659f38-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.392262 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390154 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-etc-sysconfig\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.392262 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390166 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa07a65f-f29b-4938-8167-03e6245a6228-tmp-dir\") pod \"node-resolver-8c2bq\" (UID: \"aa07a65f-f29b-4938-8167-03e6245a6228\") " pod="openshift-dns/node-resolver-8c2bq" Jun 08 12:09:34.392262 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390178 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/59d4373d-5364-409b-955c-9a4cce583241-sys-fs\") pod \"aws-ebs-csi-driver-node-jtm4v\" (UID: \"59d4373d-5364-409b-955c-9a4cce583241\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" Jun 08 12:09:34.392262 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390229 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7680a2d2-3d3f-4a76-88c5-462b61659f38-cni-binary-copy\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.392262 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390313 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-etc-sysconfig\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.392262 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390323 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6a3de442-4644-42ce-a441-9b867aaf3071-konnectivity-ca\") pod \"konnectivity-agent-4krtw\" (UID: \"6a3de442-4644-42ce-a441-9b867aaf3071\") " pod="kube-system/konnectivity-agent-4krtw" Jun 08 12:09:34.392262 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390331 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5bcb07d4-39cc-41fa-bf34-e7d119414144-serviceca\") pod \"node-ca-6rnhx\" (UID: \"5bcb07d4-39cc-41fa-bf34-e7d119414144\") " pod="openshift-image-registry/node-ca-6rnhx" Jun 08 12:09:34.392262 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390341 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7680a2d2-3d3f-4a76-88c5-462b61659f38-cnibin\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.392262 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390345 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-etc-openvswitch\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.392262 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390383 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-host-run-ovn-kubernetes\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.392262 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390391 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-var-lib-kubelet\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.392262 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390409 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-host-cni-bin\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.392262 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390517 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7680a2d2-3d3f-4a76-88c5-462b61659f38-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.392262 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390552 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/59d4373d-5364-409b-955c-9a4cce583241-device-dir\") pod \"aws-ebs-csi-driver-node-jtm4v\" (UID: \"59d4373d-5364-409b-955c-9a4cce583241\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" Jun 08 12:09:34.392262 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390582 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-host-var-lib-cni-multus\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.393091 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390607 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-host-run-multus-certs\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.393091 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390634 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2a25093c-ba21-4727-a780-cb3a576fc3bf-etc-tuned\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.393091 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390635 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2a25093c-ba21-4727-a780-cb3a576fc3bf-etc-sysctl-conf\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.393091 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390645 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/59d4373d-5364-409b-955c-9a4cce583241-sys-fs\") pod \"aws-ebs-csi-driver-node-jtm4v\" (UID: \"59d4373d-5364-409b-955c-9a4cce583241\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" Jun 08 12:09:34.393091 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390697 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d55th\" (UniqueName: \"kubernetes.io/projected/aa07a65f-f29b-4938-8167-03e6245a6228-kube-api-access-d55th\") pod \"node-resolver-8c2bq\" (UID: \"aa07a65f-f29b-4938-8167-03e6245a6228\") " pod="openshift-dns/node-resolver-8c2bq" Jun 08 12:09:34.393091 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390700 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-host-var-lib-cni-multus\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.393091 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390749 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7680a2d2-3d3f-4a76-88c5-462b61659f38-cni-binary-copy\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.393091 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390760 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/59d4373d-5364-409b-955c-9a4cce583241-device-dir\") pod \"aws-ebs-csi-driver-node-jtm4v\" (UID: \"59d4373d-5364-409b-955c-9a4cce583241\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" Jun 08 12:09:34.393091 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.390829 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-host-run-multus-certs\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.393091 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.391338 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6a3de442-4644-42ce-a441-9b867aaf3071-agent-certs\") pod \"konnectivity-agent-4krtw\" (UID: \"6a3de442-4644-42ce-a441-9b867aaf3071\") " pod="kube-system/konnectivity-agent-4krtw" Jun 08 12:09:34.393091 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.391431 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7680a2d2-3d3f-4a76-88c5-462b61659f38-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.393091 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.392206 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a25093c-ba21-4727-a780-cb3a576fc3bf-tmp\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.393859 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.393836 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca21fc5a-7e02-47e3-bba1-b6df850bea85-etc-kubernetes\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.396333 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.396310 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2a25093c-ba21-4727-a780-cb3a576fc3bf-etc-tuned\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.397875 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.397850 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpdk8\" (UniqueName: \"kubernetes.io/projected/723a030e-60ee-457c-ae18-aac839fd2a5a-kube-api-access-wpdk8\") pod \"network-metrics-daemon-g8qk7\" (UID: \"723a030e-60ee-457c-ae18-aac839fd2a5a\") " pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:09:34.398296 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.398256 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spjdc\" (UniqueName: \"kubernetes.io/projected/df7d634b-fbaa-4493-9c43-84e4dabc4b8d-kube-api-access-spjdc\") pod \"iptables-alerter-vz44k\" (UID: \"df7d634b-fbaa-4493-9c43-84e4dabc4b8d\") " pod="openshift-network-operator/iptables-alerter-vz44k" Jun 08 12:09:34.398979 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.398661 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldr5v\" (UniqueName: \"kubernetes.io/projected/5bcb07d4-39cc-41fa-bf34-e7d119414144-kube-api-access-ldr5v\") pod \"node-ca-6rnhx\" (UID: \"5bcb07d4-39cc-41fa-bf34-e7d119414144\") " pod="openshift-image-registry/node-ca-6rnhx" Jun 08 12:09:34.399657 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.399639 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hf8x\" (UniqueName: \"kubernetes.io/projected/7680a2d2-3d3f-4a76-88c5-462b61659f38-kube-api-access-4hf8x\") pod \"multus-additional-cni-plugins-d9dk7\" (UID: \"7680a2d2-3d3f-4a76-88c5-462b61659f38\") " pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.399835 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.399747 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmg5h\" (UniqueName: \"kubernetes.io/projected/2a25093c-ba21-4727-a780-cb3a576fc3bf-kube-api-access-rmg5h\") pod \"tuned-k5brj\" (UID: \"2a25093c-ba21-4727-a780-cb3a576fc3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.401026 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.400044 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6s7w\" (UniqueName: \"kubernetes.io/projected/59d4373d-5364-409b-955c-9a4cce583241-kube-api-access-t6s7w\") pod \"aws-ebs-csi-driver-node-jtm4v\" (UID: \"59d4373d-5364-409b-955c-9a4cce583241\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" Jun 08 12:09:34.401026 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.400648 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2qg4\" (UniqueName: \"kubernetes.io/projected/ca21fc5a-7e02-47e3-bba1-b6df850bea85-kube-api-access-l2qg4\") pod \"multus-vrgwf\" (UID: \"ca21fc5a-7e02-47e3-bba1-b6df850bea85\") " pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.401233 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.401215 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d55th\" (UniqueName: \"kubernetes.io/projected/aa07a65f-f29b-4938-8167-03e6245a6228-kube-api-access-d55th\") pod \"node-resolver-8c2bq\" (UID: \"aa07a65f-f29b-4938-8167-03e6245a6228\") " pod="openshift-dns/node-resolver-8c2bq" Jun 08 12:09:34.491740 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.491708 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-etc-openvswitch\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.491928 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.491748 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-host-run-ovn-kubernetes\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.491928 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.491776 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-host-cni-bin\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.491928 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.491805 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-run-systemd\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.491928 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.491846 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mspnb\" (UniqueName: \"kubernetes.io/projected/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-kube-api-access-mspnb\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.491928 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.491857 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-etc-openvswitch\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.491928 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.491873 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-log-socket\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.491928 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.491848 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-host-run-ovn-kubernetes\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.491928 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.491901 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-ovn-node-metrics-cert\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.491928 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.491917 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-run-systemd\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.492358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.491941 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-host-cni-bin\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.492358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.491935 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-host-cni-netd\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.492358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.491987 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-host-cni-netd\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.492358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492015 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-host-slash\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.492358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492028 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-log-socket\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.492358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492042 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-run-ovn\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.492358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492070 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.492358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492096 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-ovnkube-config\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.492358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492122 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-systemd-units\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.492358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492147 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmmzd\" (UniqueName: \"kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd\") pod \"network-check-target-s2sh7\" (UID: \"5fe99017-3c64-437c-904d-397ce9012add\") " pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:09:34.492358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492175 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-env-overrides\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.492358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492215 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.492358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492239 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-host-kubelet\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.492358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492268 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-host-run-netns\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.492358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492270 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-host-slash\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.492358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492283 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-var-lib-openvswitch\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.492358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492302 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-run-openvswitch\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.493054 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492322 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-run-ovn\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.493054 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492351 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-var-lib-openvswitch\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.493054 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492363 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-host-run-netns\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.493054 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492322 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-node-log\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.493054 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492386 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-host-kubelet\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.493054 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492412 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-ovnkube-script-lib\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.493054 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492422 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-run-openvswitch\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.493054 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492454 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-node-log\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.493054 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492655 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-env-overrides\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.493054 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492706 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-systemd-units\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.493054 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.492924 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-ovnkube-config\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.493054 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.493041 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-ovnkube-script-lib\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.494358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.494332 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-ovn-node-metrics-cert\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.503173 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:34.503153 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:09:34.503173 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:34.503174 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:09:34.503345 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:34.503183 2565 projected.go:196] Error preparing data for projected volume kube-api-access-wmmzd for pod openshift-network-diagnostics/network-check-target-s2sh7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:34.503345 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:34.503238 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd podName:5fe99017-3c64-437c-904d-397ce9012add nodeName:}" failed. No retries permitted until 2026-06-08 12:09:35.00322242 +0000 UTC m=+3.119040556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wmmzd" (UniqueName: "kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd") pod "network-check-target-s2sh7" (UID: "5fe99017-3c64-437c-904d-397ce9012add") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:34.504588 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.504571 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mspnb\" (UniqueName: \"kubernetes.io/projected/1aa340eb-58d2-4e29-9cbd-4f1b831abf58-kube-api-access-mspnb\") pod \"ovnkube-node-kwxhk\" (UID: \"1aa340eb-58d2-4e29-9cbd-4f1b831abf58\") " pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.570150 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.570071 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" Jun 08 12:09:34.578802 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.578778 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4krtw" Jun 08 12:09:34.586828 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.586791 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d9dk7" Jun 08 12:09:34.592565 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.592547 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vrgwf" Jun 08 12:09:34.600637 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.600621 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vz44k" Jun 08 12:09:34.607942 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.607927 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6rnhx" Jun 08 12:09:34.613875 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.613856 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k5brj" Jun 08 12:09:34.620877 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.620861 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8c2bq" Jun 08 12:09:34.626359 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.626337 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:09:34.806035 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.806002 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 12:09:34.894377 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.894309 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret\") pod \"global-pull-secret-syncer-7pwsz\" (UID: \"4e3e7141-3861-4baa-b7ea-ca348f74a095\") " pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:34.894377 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:34.894344 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs\") pod \"network-metrics-daemon-g8qk7\" (UID: \"723a030e-60ee-457c-ae18-aac839fd2a5a\") " pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:09:34.894566 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:34.894457 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:34.894566 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:34.894462 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:34.894566 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:34.894509 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs podName:723a030e-60ee-457c-ae18-aac839fd2a5a nodeName:}" failed. No retries permitted until 2026-06-08 12:09:35.894492955 +0000 UTC m=+4.010311071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs") pod "network-metrics-daemon-g8qk7" (UID: "723a030e-60ee-457c-ae18-aac839fd2a5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:34.894566 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:34.894527 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret podName:4e3e7141-3861-4baa-b7ea-ca348f74a095 nodeName:}" failed. No retries permitted until 2026-06-08 12:09:35.894517648 +0000 UTC m=+4.010335764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret") pod "global-pull-secret-syncer-7pwsz" (UID: "4e3e7141-3861-4baa-b7ea-ca348f74a095") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:35.095942 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:35.095912 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmmzd\" (UniqueName: \"kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd\") pod \"network-check-target-s2sh7\" (UID: \"5fe99017-3c64-437c-904d-397ce9012add\") " pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:09:35.096117 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:35.096058 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:09:35.096117 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:35.096079 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:09:35.096117 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:35.096092 2565 projected.go:196] Error preparing data for projected volume kube-api-access-wmmzd for pod openshift-network-diagnostics/network-check-target-s2sh7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:35.096274 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:35.096137 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd podName:5fe99017-3c64-437c-904d-397ce9012add nodeName:}" failed. No retries permitted until 2026-06-08 12:09:36.096124647 +0000 UTC m=+4.211942784 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wmmzd" (UniqueName: "kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd") pod "network-check-target-s2sh7" (UID: "5fe99017-3c64-437c-904d-397ce9012add") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:35.235566 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:35.235539 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa07a65f_f29b_4938_8167_03e6245a6228.slice/crio-83fd62f1ab014f2ebd294fb3511a83fe998f99f00423edbc001fb0ba1ab38931 WatchSource:0}: Error finding container 83fd62f1ab014f2ebd294fb3511a83fe998f99f00423edbc001fb0ba1ab38931: Status 404 returned error can't find the container with id 83fd62f1ab014f2ebd294fb3511a83fe998f99f00423edbc001fb0ba1ab38931 Jun 08 12:09:35.236746 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:35.236705 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7680a2d2_3d3f_4a76_88c5_462b61659f38.slice/crio-a4eea33a660fcbd51118c3a98179d3714472517427e8ca5ed9a41bcd06db1f08 WatchSource:0}: Error finding container a4eea33a660fcbd51118c3a98179d3714472517427e8ca5ed9a41bcd06db1f08: Status 404 returned error can't find the container with id a4eea33a660fcbd51118c3a98179d3714472517427e8ca5ed9a41bcd06db1f08 Jun 08 12:09:35.237804 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:35.237629 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a25093c_ba21_4727_a780_cb3a576fc3bf.slice/crio-d4e5464e48671cd49eea57741fcd6bdeaf2f5af99557751c05d7f733e9c46fda WatchSource:0}: Error finding container d4e5464e48671cd49eea57741fcd6bdeaf2f5af99557751c05d7f733e9c46fda: Status 404 returned error can't find the container with id d4e5464e48671cd49eea57741fcd6bdeaf2f5af99557751c05d7f733e9c46fda Jun 08 12:09:35.243149 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:35.242901 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a3de442_4644_42ce_a441_9b867aaf3071.slice/crio-252127caf8c0b5bdf2268dfd47ee9bf6ae112249394d519c9d4bfe18697f8543 WatchSource:0}: Error finding container 252127caf8c0b5bdf2268dfd47ee9bf6ae112249394d519c9d4bfe18697f8543: Status 404 returned error can't find the container with id 252127caf8c0b5bdf2268dfd47ee9bf6ae112249394d519c9d4bfe18697f8543 Jun 08 12:09:35.245573 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:35.245554 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf7d634b_fbaa_4493_9c43_84e4dabc4b8d.slice/crio-0c1f321d99314286e7d1375d68b66b8afcc1bfb8e7d696c3faa4df377a07bd58 WatchSource:0}: Error finding container 0c1f321d99314286e7d1375d68b66b8afcc1bfb8e7d696c3faa4df377a07bd58: Status 404 returned error can't find the container with id 0c1f321d99314286e7d1375d68b66b8afcc1bfb8e7d696c3faa4df377a07bd58 Jun 08 12:09:35.246605 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:35.246581 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aa340eb_58d2_4e29_9cbd_4f1b831abf58.slice/crio-6ef14ec6ccb5277d31da6b477edbc55dd4880d72c71482c7de65cc7a2fc5f92e WatchSource:0}: Error finding container 6ef14ec6ccb5277d31da6b477edbc55dd4880d72c71482c7de65cc7a2fc5f92e: Status 404 returned error can't find the container with id 6ef14ec6ccb5277d31da6b477edbc55dd4880d72c71482c7de65cc7a2fc5f92e Jun 08 12:09:35.247355 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:09:35.247338 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca21fc5a_7e02_47e3_bba1_b6df850bea85.slice/crio-4581cc38a30e21edc6fb85e98aaf79c0c863df54012f428d104605d3357267fa WatchSource:0}: Error finding container 4581cc38a30e21edc6fb85e98aaf79c0c863df54012f428d104605d3357267fa: Status 404 returned error can't find the container with id 4581cc38a30e21edc6fb85e98aaf79c0c863df54012f428d104605d3357267fa Jun 08 12:09:35.332712 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:35.332667 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 12:04:34 +0000 UTC" deadline="2028-01-10 15:30:15.460334187 +0000 UTC" Jun 08 12:09:35.332841 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:35.332710 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13947h20m40.127628013s" Jun 08 12:09:35.341944 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:35.341924 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:35.342036 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:35.342019 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pwsz" podUID="4e3e7141-3861-4baa-b7ea-ca348f74a095" Jun 08 12:09:35.351372 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:35.351347 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8c2bq" event={"ID":"aa07a65f-f29b-4938-8167-03e6245a6228","Type":"ContainerStarted","Data":"83fd62f1ab014f2ebd294fb3511a83fe998f99f00423edbc001fb0ba1ab38931"} Jun 08 12:09:35.353685 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:35.353663 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" event={"ID":"59d4373d-5364-409b-955c-9a4cce583241","Type":"ContainerStarted","Data":"a00fe073bf7029a6c212e9ded9ba8fcfc8ef5c00718314c637a94a2e9cbaf48b"} Jun 08 12:09:35.354916 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:35.354887 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vrgwf" event={"ID":"ca21fc5a-7e02-47e3-bba1-b6df850bea85","Type":"ContainerStarted","Data":"4581cc38a30e21edc6fb85e98aaf79c0c863df54012f428d104605d3357267fa"} Jun 08 12:09:35.356261 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:35.356240 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" event={"ID":"1aa340eb-58d2-4e29-9cbd-4f1b831abf58","Type":"ContainerStarted","Data":"6ef14ec6ccb5277d31da6b477edbc55dd4880d72c71482c7de65cc7a2fc5f92e"} Jun 08 12:09:35.357393 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:35.357373 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vz44k" event={"ID":"df7d634b-fbaa-4493-9c43-84e4dabc4b8d","Type":"ContainerStarted","Data":"0c1f321d99314286e7d1375d68b66b8afcc1bfb8e7d696c3faa4df377a07bd58"} Jun 08 12:09:35.358778 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:35.358746 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6rnhx" event={"ID":"5bcb07d4-39cc-41fa-bf34-e7d119414144","Type":"ContainerStarted","Data":"8eeb838c4b5f5fb47192e4917905a8a1d58dae05fce340e9f31d90dbff47a61b"} Jun 08 12:09:35.359981 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:35.359960 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d9dk7" event={"ID":"7680a2d2-3d3f-4a76-88c5-462b61659f38","Type":"ContainerStarted","Data":"a4eea33a660fcbd51118c3a98179d3714472517427e8ca5ed9a41bcd06db1f08"} Jun 08 12:09:35.361945 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:35.361927 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-94.ec2.internal" event={"ID":"694565ca45387930e7b7b65815bbef04","Type":"ContainerStarted","Data":"7bb47be50d7d8992f8cf5f56c5119b1dbfd77729d19a8a129cdacb49200345fd"} Jun 08 12:09:35.363195 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:35.363171 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4krtw" event={"ID":"6a3de442-4644-42ce-a441-9b867aaf3071","Type":"ContainerStarted","Data":"252127caf8c0b5bdf2268dfd47ee9bf6ae112249394d519c9d4bfe18697f8543"} Jun 08 12:09:35.364248 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:35.364227 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k5brj" event={"ID":"2a25093c-ba21-4727-a780-cb3a576fc3bf","Type":"ContainerStarted","Data":"d4e5464e48671cd49eea57741fcd6bdeaf2f5af99557751c05d7f733e9c46fda"} Jun 08 12:09:35.381117 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:35.381081 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-94.ec2.internal" podStartSLOduration=2.381069816 podStartE2EDuration="2.381069816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:09:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:35.376638917 +0000 UTC m=+3.492457076" watchObservedRunningTime="2026-06-08 12:09:35.381069816 +0000 UTC m=+3.496887955" Jun 08 12:09:35.902637 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:35.902548 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret\") pod \"global-pull-secret-syncer-7pwsz\" (UID: \"4e3e7141-3861-4baa-b7ea-ca348f74a095\") " pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:35.902637 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:35.902599 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs\") pod \"network-metrics-daemon-g8qk7\" (UID: \"723a030e-60ee-457c-ae18-aac839fd2a5a\") " pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:09:35.902888 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:35.902744 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:35.902888 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:35.902802 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs podName:723a030e-60ee-457c-ae18-aac839fd2a5a nodeName:}" failed. No retries permitted until 2026-06-08 12:09:37.902784566 +0000 UTC m=+6.018602687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs") pod "network-metrics-daemon-g8qk7" (UID: "723a030e-60ee-457c-ae18-aac839fd2a5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:35.903223 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:35.903205 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:35.903289 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:35.903259 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret podName:4e3e7141-3861-4baa-b7ea-ca348f74a095 nodeName:}" failed. No retries permitted until 2026-06-08 12:09:37.903244345 +0000 UTC m=+6.019062466 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret") pod "global-pull-secret-syncer-7pwsz" (UID: "4e3e7141-3861-4baa-b7ea-ca348f74a095") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:36.103565 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:36.103517 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmmzd\" (UniqueName: \"kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd\") pod \"network-check-target-s2sh7\" (UID: \"5fe99017-3c64-437c-904d-397ce9012add\") " pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:09:36.103746 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:36.103660 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:09:36.103746 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:36.103677 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:09:36.103746 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:36.103689 2565 projected.go:196] Error preparing data for projected volume kube-api-access-wmmzd for pod openshift-network-diagnostics/network-check-target-s2sh7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:36.103746 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:36.103745 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd podName:5fe99017-3c64-437c-904d-397ce9012add nodeName:}" failed. No retries permitted until 2026-06-08 12:09:38.103727684 +0000 UTC m=+6.219545804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wmmzd" (UniqueName: "kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd") pod "network-check-target-s2sh7" (UID: "5fe99017-3c64-437c-904d-397ce9012add") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:36.333860 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:36.333752 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 12:04:34 +0000 UTC" deadline="2028-02-14 06:46:48.029722566 +0000 UTC" Jun 08 12:09:36.333860 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:36.333795 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14778h37m11.69593231s" Jun 08 12:09:36.344656 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:36.344626 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:09:36.344796 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:36.344769 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8qk7" podUID="723a030e-60ee-457c-ae18-aac839fd2a5a" Jun 08 12:09:36.345218 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:36.345199 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:09:36.345316 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:36.345295 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2sh7" podUID="5fe99017-3c64-437c-904d-397ce9012add" Jun 08 12:09:36.409335 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:36.409256 2565 generic.go:356] "Generic (PLEG): container finished" podID="ac9456f1bb448bd4c72bff97da6deb0c" containerID="95aa5f674b5f22f2a9b40f861cdf2e1abf6f1ba01667c85470b42f6f93c77654" exitCode=0 Jun 08 12:09:36.410302 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:36.410276 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal" event={"ID":"ac9456f1bb448bd4c72bff97da6deb0c","Type":"ContainerDied","Data":"95aa5f674b5f22f2a9b40f861cdf2e1abf6f1ba01667c85470b42f6f93c77654"} Jun 08 12:09:37.341877 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:37.341369 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:37.341877 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:37.341494 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pwsz" podUID="4e3e7141-3861-4baa-b7ea-ca348f74a095" Jun 08 12:09:37.430524 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:37.430486 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal" event={"ID":"ac9456f1bb448bd4c72bff97da6deb0c","Type":"ContainerStarted","Data":"758cd3fcbe4276be255d19a6934b5e7ffea60c358d0efe33a96d15061611354b"} Jun 08 12:09:37.923118 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:37.923079 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret\") pod \"global-pull-secret-syncer-7pwsz\" (UID: \"4e3e7141-3861-4baa-b7ea-ca348f74a095\") " pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:37.923313 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:37.923131 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs\") pod \"network-metrics-daemon-g8qk7\" (UID: \"723a030e-60ee-457c-ae18-aac839fd2a5a\") " pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:09:37.923380 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:37.923327 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:37.923437 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:37.923392 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs podName:723a030e-60ee-457c-ae18-aac839fd2a5a nodeName:}" failed. No retries permitted until 2026-06-08 12:09:41.923372195 +0000 UTC m=+10.039190314 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs") pod "network-metrics-daemon-g8qk7" (UID: "723a030e-60ee-457c-ae18-aac839fd2a5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:37.923790 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:37.923767 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:37.923906 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:37.923843 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret podName:4e3e7141-3861-4baa-b7ea-ca348f74a095 nodeName:}" failed. No retries permitted until 2026-06-08 12:09:41.923828446 +0000 UTC m=+10.039646576 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret") pod "global-pull-secret-syncer-7pwsz" (UID: "4e3e7141-3861-4baa-b7ea-ca348f74a095") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:38.125462 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:38.125425 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmmzd\" (UniqueName: \"kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd\") pod \"network-check-target-s2sh7\" (UID: \"5fe99017-3c64-437c-904d-397ce9012add\") " pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:09:38.126113 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:38.125625 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:09:38.126113 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:38.125649 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:09:38.126113 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:38.125662 2565 projected.go:196] Error preparing data for projected volume kube-api-access-wmmzd for pod openshift-network-diagnostics/network-check-target-s2sh7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:38.126113 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:38.125720 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd podName:5fe99017-3c64-437c-904d-397ce9012add nodeName:}" failed. No retries permitted until 2026-06-08 12:09:42.125701413 +0000 UTC m=+10.241519531 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wmmzd" (UniqueName: "kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd") pod "network-check-target-s2sh7" (UID: "5fe99017-3c64-437c-904d-397ce9012add") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:38.344339 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:38.343595 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:09:38.344339 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:38.343720 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2sh7" podUID="5fe99017-3c64-437c-904d-397ce9012add" Jun 08 12:09:38.344339 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:38.344137 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:09:38.344339 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:38.344244 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8qk7" podUID="723a030e-60ee-457c-ae18-aac839fd2a5a" Jun 08 12:09:39.341702 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:39.341669 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:39.341902 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:39.341835 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pwsz" podUID="4e3e7141-3861-4baa-b7ea-ca348f74a095" Jun 08 12:09:40.342947 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:40.342916 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:09:40.343373 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:40.343064 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8qk7" podUID="723a030e-60ee-457c-ae18-aac839fd2a5a" Jun 08 12:09:40.343373 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:40.343097 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:09:40.343373 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:40.343225 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2sh7" podUID="5fe99017-3c64-437c-904d-397ce9012add" Jun 08 12:09:41.342086 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:41.342049 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:41.342275 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:41.342178 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pwsz" podUID="4e3e7141-3861-4baa-b7ea-ca348f74a095" Jun 08 12:09:41.955640 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:41.955531 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret\") pod \"global-pull-secret-syncer-7pwsz\" (UID: \"4e3e7141-3861-4baa-b7ea-ca348f74a095\") " pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:41.955640 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:41.955582 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs\") pod \"network-metrics-daemon-g8qk7\" (UID: \"723a030e-60ee-457c-ae18-aac839fd2a5a\") " pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:09:41.956182 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:41.955713 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:41.956182 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:41.955787 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret podName:4e3e7141-3861-4baa-b7ea-ca348f74a095 nodeName:}" failed. No retries permitted until 2026-06-08 12:09:49.95576572 +0000 UTC m=+18.071583845 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret") pod "global-pull-secret-syncer-7pwsz" (UID: "4e3e7141-3861-4baa-b7ea-ca348f74a095") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:41.956182 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:41.955832 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:41.956182 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:41.955876 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs podName:723a030e-60ee-457c-ae18-aac839fd2a5a nodeName:}" failed. No retries permitted until 2026-06-08 12:09:49.95586222 +0000 UTC m=+18.071680351 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs") pod "network-metrics-daemon-g8qk7" (UID: "723a030e-60ee-457c-ae18-aac839fd2a5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:42.157838 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:42.157777 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmmzd\" (UniqueName: \"kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd\") pod \"network-check-target-s2sh7\" (UID: \"5fe99017-3c64-437c-904d-397ce9012add\") " pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:09:42.158023 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:42.158000 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:09:42.158023 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:42.158017 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:09:42.158138 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:42.158026 2565 projected.go:196] Error preparing data for projected volume kube-api-access-wmmzd for pod openshift-network-diagnostics/network-check-target-s2sh7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:42.158138 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:42.158079 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd podName:5fe99017-3c64-437c-904d-397ce9012add nodeName:}" failed. No retries permitted until 2026-06-08 12:09:50.158059538 +0000 UTC m=+18.273877653 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wmmzd" (UniqueName: "kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd") pod "network-check-target-s2sh7" (UID: "5fe99017-3c64-437c-904d-397ce9012add") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:42.342906 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:42.342799 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:09:42.343064 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:42.342930 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8qk7" podUID="723a030e-60ee-457c-ae18-aac839fd2a5a" Jun 08 12:09:42.343370 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:42.343217 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:09:42.343370 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:42.343335 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2sh7" podUID="5fe99017-3c64-437c-904d-397ce9012add" Jun 08 12:09:43.342315 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:43.341954 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:43.342315 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:43.342075 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pwsz" podUID="4e3e7141-3861-4baa-b7ea-ca348f74a095" Jun 08 12:09:44.341869 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:44.341607 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:09:44.342032 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:44.341663 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:09:44.342032 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:44.341987 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8qk7" podUID="723a030e-60ee-457c-ae18-aac839fd2a5a" Jun 08 12:09:44.342158 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:44.342042 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2sh7" podUID="5fe99017-3c64-437c-904d-397ce9012add" Jun 08 12:09:45.341347 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:45.341312 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:45.341882 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:45.341443 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pwsz" podUID="4e3e7141-3861-4baa-b7ea-ca348f74a095" Jun 08 12:09:46.341751 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:46.341714 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:09:46.342233 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:46.341858 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2sh7" podUID="5fe99017-3c64-437c-904d-397ce9012add" Jun 08 12:09:46.342233 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:46.341903 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:09:46.342233 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:46.342022 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8qk7" podUID="723a030e-60ee-457c-ae18-aac839fd2a5a" Jun 08 12:09:47.342060 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:47.342024 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:47.342510 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:47.342157 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pwsz" podUID="4e3e7141-3861-4baa-b7ea-ca348f74a095" Jun 08 12:09:48.341744 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:48.341710 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:09:48.341927 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:48.341859 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8qk7" podUID="723a030e-60ee-457c-ae18-aac839fd2a5a" Jun 08 12:09:48.342483 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:48.342333 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:09:48.342483 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:48.342447 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2sh7" podUID="5fe99017-3c64-437c-904d-397ce9012add" Jun 08 12:09:49.341602 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:49.341544 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:49.341783 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:49.341669 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pwsz" podUID="4e3e7141-3861-4baa-b7ea-ca348f74a095" Jun 08 12:09:50.017608 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:50.017565 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret\") pod \"global-pull-secret-syncer-7pwsz\" (UID: \"4e3e7141-3861-4baa-b7ea-ca348f74a095\") " pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:50.017608 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:50.017608 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs\") pod \"network-metrics-daemon-g8qk7\" (UID: \"723a030e-60ee-457c-ae18-aac839fd2a5a\") " pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:09:50.018134 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:50.017726 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:50.018134 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:50.017732 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:50.018134 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:50.017786 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs podName:723a030e-60ee-457c-ae18-aac839fd2a5a nodeName:}" failed. No retries permitted until 2026-06-08 12:10:06.0177667 +0000 UTC m=+34.133584835 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs") pod "network-metrics-daemon-g8qk7" (UID: "723a030e-60ee-457c-ae18-aac839fd2a5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:09:50.018134 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:50.017807 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret podName:4e3e7141-3861-4baa-b7ea-ca348f74a095 nodeName:}" failed. No retries permitted until 2026-06-08 12:10:06.017795995 +0000 UTC m=+34.133614117 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret") pod "global-pull-secret-syncer-7pwsz" (UID: "4e3e7141-3861-4baa-b7ea-ca348f74a095") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:09:50.218850 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:50.218805 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmmzd\" (UniqueName: \"kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd\") pod \"network-check-target-s2sh7\" (UID: \"5fe99017-3c64-437c-904d-397ce9012add\") " pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:09:50.219042 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:50.218969 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:09:50.219042 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:50.218995 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:09:50.219042 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:50.219007 2565 projected.go:196] Error preparing data for projected volume kube-api-access-wmmzd for pod openshift-network-diagnostics/network-check-target-s2sh7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:50.219181 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:50.219058 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd podName:5fe99017-3c64-437c-904d-397ce9012add nodeName:}" failed. No retries permitted until 2026-06-08 12:10:06.219042402 +0000 UTC m=+34.334860518 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wmmzd" (UniqueName: "kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd") pod "network-check-target-s2sh7" (UID: "5fe99017-3c64-437c-904d-397ce9012add") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:09:50.342415 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:50.342329 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:09:50.342580 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:50.342330 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:09:50.342580 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:50.342476 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8qk7" podUID="723a030e-60ee-457c-ae18-aac839fd2a5a" Jun 08 12:09:50.342580 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:50.342562 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2sh7" podUID="5fe99017-3c64-437c-904d-397ce9012add" Jun 08 12:09:51.342180 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:51.342089 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:51.342639 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:51.342220 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pwsz" podUID="4e3e7141-3861-4baa-b7ea-ca348f74a095" Jun 08 12:09:52.342727 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:52.342535 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:09:52.342727 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:52.342628 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:09:52.342727 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:52.342664 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8qk7" podUID="723a030e-60ee-457c-ae18-aac839fd2a5a" Jun 08 12:09:52.342727 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:52.342696 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2sh7" podUID="5fe99017-3c64-437c-904d-397ce9012add" Jun 08 12:09:53.341711 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:53.341434 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:53.341711 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:53.341559 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pwsz" podUID="4e3e7141-3861-4baa-b7ea-ca348f74a095" Jun 08 12:09:54.341747 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:54.341594 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:09:54.342615 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:54.341599 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:09:54.342615 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:54.341893 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8qk7" podUID="723a030e-60ee-457c-ae18-aac839fd2a5a" Jun 08 12:09:54.342615 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:54.341954 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2sh7" podUID="5fe99017-3c64-437c-904d-397ce9012add" Jun 08 12:09:54.461637 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:54.461603 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d9dk7" event={"ID":"7680a2d2-3d3f-4a76-88c5-462b61659f38","Type":"ContainerStarted","Data":"8626a81dce49d36c00ef8b8472d72416e16d1b23719e5791bcccef17ccdb0628"} Jun 08 12:09:54.463206 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:54.463173 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4krtw" event={"ID":"6a3de442-4644-42ce-a441-9b867aaf3071","Type":"ContainerStarted","Data":"c26b79dd7ba13ec8536c91cc1d4389f0abc61ea7a4d7dd5c38ba32ff1f15d6c3"} Jun 08 12:09:54.464630 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:54.464606 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k5brj" event={"ID":"2a25093c-ba21-4727-a780-cb3a576fc3bf","Type":"ContainerStarted","Data":"d557b0d63016517c97eb6625b9c7ed48b955b12f3ce52cbc33c803023897494b"} Jun 08 12:09:54.466313 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:54.466284 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8c2bq" event={"ID":"aa07a65f-f29b-4938-8167-03e6245a6228","Type":"ContainerStarted","Data":"cc4e9ab14c2f1e870d64328acfe7af6a1bfe205556c3a6faab08c5eeddf2a7d8"} Jun 08 12:09:54.468134 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:54.468115 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" event={"ID":"59d4373d-5364-409b-955c-9a4cce583241","Type":"ContainerStarted","Data":"40a8d6763db6f01553389bd15d95eade6b96c0e6c32c6ff88031121387289bbd"} Jun 08 12:09:54.469879 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:54.469851 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vrgwf" event={"ID":"ca21fc5a-7e02-47e3-bba1-b6df850bea85","Type":"ContainerStarted","Data":"897eb75ef181aeb6726ec187ac30201a2ffef12ea2f158202171062ce488e6ec"} Jun 08 12:09:54.472160 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:54.472140 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwxhk_1aa340eb-58d2-4e29-9cbd-4f1b831abf58/ovn-acl-logging/0.log" Jun 08 12:09:54.472571 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:54.472552 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" event={"ID":"1aa340eb-58d2-4e29-9cbd-4f1b831abf58","Type":"ContainerStarted","Data":"0611ebe57f2b28f43176d7a8f1a7ca82d4edff248171121cdc572e1a6f31e324"} Jun 08 12:09:54.472653 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:54.472630 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" event={"ID":"1aa340eb-58d2-4e29-9cbd-4f1b831abf58","Type":"ContainerStarted","Data":"fc7595764a0c576ea73446f63678a4c73544caf3462435ffdbb3d63a052aa8d8"} Jun 08 12:09:54.474027 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:54.474008 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6rnhx" event={"ID":"5bcb07d4-39cc-41fa-bf34-e7d119414144","Type":"ContainerStarted","Data":"5063a1613a3070ed9e54d8be7459bf76efcbd3dd5dfc21e8d8273ec898b5996d"} Jun 08 12:09:54.485939 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:54.485898 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-94.ec2.internal" podStartSLOduration=21.485881328 podStartE2EDuration="21.485881328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:09:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:37.461440877 +0000 UTC m=+5.577259017" watchObservedRunningTime="2026-06-08 12:09:54.485881328 +0000 UTC m=+22.601699471" Jun 08 12:09:54.500838 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:54.500782 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4krtw" podStartSLOduration=12.274310672 podStartE2EDuration="22.500769359s" totalImagesPullingTime="10.226458687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:09:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:54.500536334 +0000 UTC m=+22.616354472" watchObservedRunningTime="2026-06-08 12:09:54.500769359 +0000 UTC m=+22.616587524" Jun 08 12:09:54.531640 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:54.531583 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6rnhx" podStartSLOduration=3.703434445 podStartE2EDuration="22.531562934s" totalImagesPullingTime="18.828128489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:09:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:54.514279807 +0000 UTC m=+22.630097945" watchObservedRunningTime="2026-06-08 12:09:54.531562934 +0000 UTC m=+22.647381073" Jun 08 12:09:54.532161 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:54.532120 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k5brj" podStartSLOduration=3.695940162 podStartE2EDuration="22.532105161s" totalImagesPullingTime="18.836164999s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:09:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:54.530902957 +0000 UTC m=+22.646721095" watchObservedRunningTime="2026-06-08 12:09:54.532105161 +0000 UTC m=+22.647923304" Jun 08 12:09:54.548723 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:54.548677 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vrgwf" podStartSLOduration=3.7016569820000003 podStartE2EDuration="22.548660585s" totalImagesPullingTime="18.847003603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:09:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:54.548314652 +0000 UTC m=+22.664132790" watchObservedRunningTime="2026-06-08 12:09:54.548660585 +0000 UTC m=+22.664478723" Jun 08 12:09:54.565075 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:54.565020 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8c2bq" podStartSLOduration=3.742670753 podStartE2EDuration="22.564999816s" totalImagesPullingTime="18.822329063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:09:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:54.564514503 +0000 UTC m=+22.680332641" watchObservedRunningTime="2026-06-08 12:09:54.564999816 +0000 UTC m=+22.680817955" Jun 08 12:09:55.207573 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:55.207538 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4krtw" Jun 08 12:09:55.208269 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:55.208250 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4krtw" Jun 08 12:09:55.341284 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:55.341265 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:55.341390 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:55.341347 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pwsz" podUID="4e3e7141-3861-4baa-b7ea-ca348f74a095" Jun 08 12:09:55.476968 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:55.476781 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vz44k" event={"ID":"df7d634b-fbaa-4493-9c43-84e4dabc4b8d","Type":"ContainerStarted","Data":"34261c0c81280aea3c670fa18422ed068af2a26ae1f3eb6197d66740cdf34b91"} Jun 08 12:09:55.478088 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:55.478064 2565 generic.go:356] "Generic (PLEG): container finished" podID="7680a2d2-3d3f-4a76-88c5-462b61659f38" containerID="8626a81dce49d36c00ef8b8472d72416e16d1b23719e5791bcccef17ccdb0628" exitCode=0 Jun 08 12:09:55.478169 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:55.478153 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d9dk7" event={"ID":"7680a2d2-3d3f-4a76-88c5-462b61659f38","Type":"ContainerDied","Data":"8626a81dce49d36c00ef8b8472d72416e16d1b23719e5791bcccef17ccdb0628"} Jun 08 12:09:55.480677 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:55.480663 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwxhk_1aa340eb-58d2-4e29-9cbd-4f1b831abf58/ovn-acl-logging/0.log" Jun 08 12:09:55.481063 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:55.481041 2565 generic.go:356] "Generic (PLEG): container finished" podID="1aa340eb-58d2-4e29-9cbd-4f1b831abf58" containerID="0611ebe57f2b28f43176d7a8f1a7ca82d4edff248171121cdc572e1a6f31e324" exitCode=1 Jun 08 12:09:55.481161 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:55.481139 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" event={"ID":"1aa340eb-58d2-4e29-9cbd-4f1b831abf58","Type":"ContainerDied","Data":"0611ebe57f2b28f43176d7a8f1a7ca82d4edff248171121cdc572e1a6f31e324"} Jun 08 12:09:55.481227 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:55.481215 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" event={"ID":"1aa340eb-58d2-4e29-9cbd-4f1b831abf58","Type":"ContainerStarted","Data":"fbd16664128308ab46b64a56710bd5efbb41f629923d8a0bc0585544a4d21c59"} Jun 08 12:09:55.481282 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:55.481270 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" event={"ID":"1aa340eb-58d2-4e29-9cbd-4f1b831abf58","Type":"ContainerStarted","Data":"25681a0a5cc7aef16cd2c36901a092a13dbbe0150b64239d2cc8031cceb5fa85"} Jun 08 12:09:55.481330 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:55.481319 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" event={"ID":"1aa340eb-58d2-4e29-9cbd-4f1b831abf58","Type":"ContainerStarted","Data":"53e411a7b700f6158dc0ff324262991e12b115371bfbc59facdb4458094dde21"} Jun 08 12:09:55.481368 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:55.481352 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" event={"ID":"1aa340eb-58d2-4e29-9cbd-4f1b831abf58","Type":"ContainerStarted","Data":"7da117b3f7615bfe6b41b5c3376deca3167b6734166e04a89f9768b9619985d6"} Jun 08 12:09:55.668498 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:55.668476 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 12:09:56.342209 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:56.342103 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T12:09:55.668492874Z","UUID":"41cf3c97-d176-4063-9a06-1aaae50f8c98","Handler":null,"Name":"","Endpoint":""} Jun 08 12:09:56.342833 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:56.342797 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:09:56.343419 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:56.343253 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2sh7" podUID="5fe99017-3c64-437c-904d-397ce9012add" Jun 08 12:09:56.346859 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:56.346601 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:09:56.346859 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:56.346788 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8qk7" podUID="723a030e-60ee-457c-ae18-aac839fd2a5a" Jun 08 12:09:56.348349 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:56.348331 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 12:09:56.348453 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:56.348395 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 12:09:56.486173 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:56.485915 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" event={"ID":"59d4373d-5364-409b-955c-9a4cce583241","Type":"ContainerStarted","Data":"73f80c4ec16b37eeb4741707022c56a85f1ce07ecbbeb82204174e2a23258782"} Jun 08 12:09:56.486173 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:56.485982 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 08 12:09:56.502349 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:56.502301 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vz44k" podStartSLOduration=5.690356682 podStartE2EDuration="24.502284414s" totalImagesPullingTime="18.811927732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:09:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:56.501936559 +0000 UTC m=+24.617754698" watchObservedRunningTime="2026-06-08 12:09:56.502284414 +0000 UTC m=+24.618102553" Jun 08 12:09:57.341276 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:57.341246 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:57.341391 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:57.341372 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pwsz" podUID="4e3e7141-3861-4baa-b7ea-ca348f74a095" Jun 08 12:09:57.491915 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:57.491885 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwxhk_1aa340eb-58d2-4e29-9cbd-4f1b831abf58/ovn-acl-logging/0.log" Jun 08 12:09:57.492477 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:57.492357 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" event={"ID":"1aa340eb-58d2-4e29-9cbd-4f1b831abf58","Type":"ContainerStarted","Data":"c4eb7efc25de33d80c214463344e259fea95c01b459ed012cfc7969b498f1878"} Jun 08 12:09:57.494528 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:57.494507 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" event={"ID":"59d4373d-5364-409b-955c-9a4cce583241","Type":"ContainerStarted","Data":"937434f12adfd59d17341c9d804ffb8d5c2fa6c454d608e2b649621998d28ee4"} Jun 08 12:09:57.514365 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:57.514328 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtm4v" podStartSLOduration=3.804539996 podStartE2EDuration="25.514314992s" totalImagesPullingTime="21.709774996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:09:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:09:57.513111123 +0000 UTC m=+25.628929262" watchObservedRunningTime="2026-06-08 12:09:57.514314992 +0000 UTC m=+25.630133129" Jun 08 12:09:58.341826 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:58.341779 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:09:58.342007 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:58.341911 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2sh7" podUID="5fe99017-3c64-437c-904d-397ce9012add" Jun 08 12:09:58.342007 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:58.341951 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:09:58.342130 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:58.342036 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8qk7" podUID="723a030e-60ee-457c-ae18-aac839fd2a5a" Jun 08 12:09:59.342163 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:09:59.342131 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:09:59.342616 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:09:59.342267 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pwsz" podUID="4e3e7141-3861-4baa-b7ea-ca348f74a095" Jun 08 12:10:00.342509 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:00.342322 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:10:00.342928 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:00.342383 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:10:00.342928 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:00.342594 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8qk7" podUID="723a030e-60ee-457c-ae18-aac839fd2a5a" Jun 08 12:10:00.342928 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:00.342648 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2sh7" podUID="5fe99017-3c64-437c-904d-397ce9012add" Jun 08 12:10:00.501501 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:00.501471 2565 generic.go:356] "Generic (PLEG): container finished" podID="7680a2d2-3d3f-4a76-88c5-462b61659f38" containerID="d24462eb01034621dbd0511f0cd38063990decec02530557ce5154761ecd4d76" exitCode=0 Jun 08 12:10:00.501656 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:00.501564 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d9dk7" event={"ID":"7680a2d2-3d3f-4a76-88c5-462b61659f38","Type":"ContainerDied","Data":"d24462eb01034621dbd0511f0cd38063990decec02530557ce5154761ecd4d76"} Jun 08 12:10:00.505287 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:00.505266 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwxhk_1aa340eb-58d2-4e29-9cbd-4f1b831abf58/ovn-acl-logging/0.log" Jun 08 12:10:00.505644 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:00.505625 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" event={"ID":"1aa340eb-58d2-4e29-9cbd-4f1b831abf58","Type":"ContainerStarted","Data":"cef41089f18e9bacd6ba929aa32870ca72bb056b6963e6b90bf68267884c9af6"} Jun 08 12:10:00.505834 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:00.505806 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:10:00.505891 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:00.505859 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:10:00.506065 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:00.506036 2565 scope.go:117] "RemoveContainer" containerID="0611ebe57f2b28f43176d7a8f1a7ca82d4edff248171121cdc572e1a6f31e324" Jun 08 12:10:00.522487 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:00.522466 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:10:01.341698 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:01.341662 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:10:01.341865 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:01.341781 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pwsz" podUID="4e3e7141-3861-4baa-b7ea-ca348f74a095" Jun 08 12:10:01.473181 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:01.473151 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7pwsz"] Jun 08 12:10:01.475182 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:01.475144 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s2sh7"] Jun 08 12:10:01.475307 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:01.475275 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:10:01.475406 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:01.475381 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2sh7" podUID="5fe99017-3c64-437c-904d-397ce9012add" Jun 08 12:10:01.475941 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:01.475918 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g8qk7"] Jun 08 12:10:01.476036 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:01.476022 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:10:01.476156 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:01.476124 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8qk7" podUID="723a030e-60ee-457c-ae18-aac839fd2a5a" Jun 08 12:10:01.513304 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:01.513279 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwxhk_1aa340eb-58d2-4e29-9cbd-4f1b831abf58/ovn-acl-logging/0.log" Jun 08 12:10:01.513707 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:01.513686 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:10:01.513808 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:01.513680 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" event={"ID":"1aa340eb-58d2-4e29-9cbd-4f1b831abf58","Type":"ContainerStarted","Data":"e96cfe1163b423ec96dae541cc7821cc7dcfb4c696cfa15a68ae75d21ed82e0f"} Jun 08 12:10:01.513808 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:01.513773 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pwsz" podUID="4e3e7141-3861-4baa-b7ea-ca348f74a095" Jun 08 12:10:01.514013 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:01.513991 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:10:01.531320 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:01.531296 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:10:01.544923 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:01.544881 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" podStartSLOduration=10.669982098 podStartE2EDuration="29.544865024s" totalImagesPullingTime="18.874882926s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:09:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:10:01.544320694 +0000 UTC m=+29.660138834" watchObservedRunningTime="2026-06-08 12:10:01.544865024 +0000 UTC m=+29.660683185" Jun 08 12:10:02.507217 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:02.507174 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4krtw" Jun 08 12:10:02.507676 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:02.507328 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 08 12:10:02.508127 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:02.508103 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4krtw" Jun 08 12:10:02.517458 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:02.517434 2565 generic.go:356] "Generic (PLEG): container finished" podID="7680a2d2-3d3f-4a76-88c5-462b61659f38" containerID="a826aa35385e2d2c6d49f82404563c962680effda0fca312a357e7918d2467c5" exitCode=0 Jun 08 12:10:02.517567 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:02.517516 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d9dk7" event={"ID":"7680a2d2-3d3f-4a76-88c5-462b61659f38","Type":"ContainerDied","Data":"a826aa35385e2d2c6d49f82404563c962680effda0fca312a357e7918d2467c5"} Jun 08 12:10:02.604491 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:02.604441 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:02.723438 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:02.723405 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:03.341624 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:03.341589 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:10:03.341769 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:03.341705 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:10:03.341769 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:03.341709 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2sh7" podUID="5fe99017-3c64-437c-904d-397ce9012add" Jun 08 12:10:03.341895 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:03.341714 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:10:03.341895 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:03.341829 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pwsz" podUID="4e3e7141-3861-4baa-b7ea-ca348f74a095" Jun 08 12:10:03.341993 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:03.341975 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8qk7" podUID="723a030e-60ee-457c-ae18-aac839fd2a5a" Jun 08 12:10:04.525536 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:04.525334 2565 generic.go:356] "Generic (PLEG): container finished" podID="7680a2d2-3d3f-4a76-88c5-462b61659f38" containerID="0a1bfdea2e8e68fccd0fb4697f68ebc7216da45f62ae3dbe0d4bd3ea1a75c90e" exitCode=0 Jun 08 12:10:04.525536 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:04.525395 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d9dk7" event={"ID":"7680a2d2-3d3f-4a76-88c5-462b61659f38","Type":"ContainerDied","Data":"0a1bfdea2e8e68fccd0fb4697f68ebc7216da45f62ae3dbe0d4bd3ea1a75c90e"} Jun 08 12:10:05.342181 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:05.342148 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:10:05.342370 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:05.342143 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:10:05.342370 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:05.342284 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7pwsz" podUID="4e3e7141-3861-4baa-b7ea-ca348f74a095" Jun 08 12:10:05.342370 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:05.342354 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s2sh7" podUID="5fe99017-3c64-437c-904d-397ce9012add" Jun 08 12:10:05.342526 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:05.342157 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:10:05.342526 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:05.342464 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8qk7" podUID="723a030e-60ee-457c-ae18-aac839fd2a5a" Jun 08 12:10:05.357205 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:05.357173 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:06.044469 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:06.044429 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret\") pod \"global-pull-secret-syncer-7pwsz\" (UID: \"4e3e7141-3861-4baa-b7ea-ca348f74a095\") " pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:10:06.044469 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:06.044477 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs\") pod \"network-metrics-daemon-g8qk7\" (UID: \"723a030e-60ee-457c-ae18-aac839fd2a5a\") " pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:10:06.045034 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:06.044607 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:10:06.045034 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:06.044609 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 12:10:06.045034 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:06.044673 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs podName:723a030e-60ee-457c-ae18-aac839fd2a5a nodeName:}" failed. No retries permitted until 2026-06-08 12:10:38.044657239 +0000 UTC m=+66.160475371 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs") pod "network-metrics-daemon-g8qk7" (UID: "723a030e-60ee-457c-ae18-aac839fd2a5a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 12:10:06.045034 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:06.044690 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret podName:4e3e7141-3861-4baa-b7ea-ca348f74a095 nodeName:}" failed. No retries permitted until 2026-06-08 12:10:38.044682453 +0000 UTC m=+66.160500568 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret") pod "global-pull-secret-syncer-7pwsz" (UID: "4e3e7141-3861-4baa-b7ea-ca348f74a095") : object "kube-system"/"original-pull-secret" not registered Jun 08 12:10:06.079282 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:06.079236 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:06.179226 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:06.179129 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:06.246071 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:06.246033 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmmzd\" (UniqueName: \"kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd\") pod \"network-check-target-s2sh7\" (UID: \"5fe99017-3c64-437c-904d-397ce9012add\") " pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:10:06.246459 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:06.246213 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 12:10:06.246459 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:06.246237 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 12:10:06.246459 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:06.246249 2565 projected.go:196] Error preparing data for projected volume kube-api-access-wmmzd for pod openshift-network-diagnostics/network-check-target-s2sh7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:10:06.246459 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:06.246312 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd podName:5fe99017-3c64-437c-904d-397ce9012add nodeName:}" failed. No retries permitted until 2026-06-08 12:10:38.246297335 +0000 UTC m=+66.362115474 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wmmzd" (UniqueName: "kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd") pod "network-check-target-s2sh7" (UID: "5fe99017-3c64-437c-904d-397ce9012add") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 12:10:06.763009 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:06.762975 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:06.852929 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:06.852894 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:07.196132 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.196104 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-94.ec2.internal" event="NodeReady" Jun 08 12:10:07.196593 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.196240 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 12:10:07.252140 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.252107 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g28p2"] Jun 08 12:10:07.277883 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.277852 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pn864"] Jun 08 12:10:07.278043 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.277936 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g28p2" Jun 08 12:10:07.282035 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.282013 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8rrt4\"" Jun 08 12:10:07.282035 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.282024 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 12:10:07.282215 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.282139 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 12:10:07.292038 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.292018 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g28p2"] Jun 08 12:10:07.292149 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.292052 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pn864"] Jun 08 12:10:07.292149 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.292123 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pn864" Jun 08 12:10:07.294564 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.294541 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8wpjq\"" Jun 08 12:10:07.294673 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.294580 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 12:10:07.294735 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.294679 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 12:10:07.294790 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.294764 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 12:10:07.342179 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.342154 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:10:07.342318 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.342256 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:10:07.342318 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.342288 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:10:07.344981 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.344960 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 12:10:07.345102 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.345006 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 12:10:07.345102 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.345072 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 12:10:07.345260 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.344960 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 12:10:07.345421 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.345406 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nvw7c\"" Jun 08 12:10:07.345484 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.345437 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h8l7g\"" Jun 08 12:10:07.455106 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.455025 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/433d1661-5360-45df-8679-18cd4f85c03b-tmp-dir\") pod \"dns-default-g28p2\" (UID: \"433d1661-5360-45df-8679-18cd4f85c03b\") " pod="openshift-dns/dns-default-g28p2" Jun 08 12:10:07.455257 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.455190 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gsdt\" (UniqueName: \"kubernetes.io/projected/433d1661-5360-45df-8679-18cd4f85c03b-kube-api-access-4gsdt\") pod \"dns-default-g28p2\" (UID: \"433d1661-5360-45df-8679-18cd4f85c03b\") " pod="openshift-dns/dns-default-g28p2" Jun 08 12:10:07.455324 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.455274 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxz2t\" (UniqueName: \"kubernetes.io/projected/caa618ee-b34d-40f6-9615-8e41e2b90036-kube-api-access-cxz2t\") pod \"ingress-canary-pn864\" (UID: \"caa618ee-b34d-40f6-9615-8e41e2b90036\") " pod="openshift-ingress-canary/ingress-canary-pn864" Jun 08 12:10:07.455324 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.455307 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/caa618ee-b34d-40f6-9615-8e41e2b90036-cert\") pod \"ingress-canary-pn864\" (UID: \"caa618ee-b34d-40f6-9615-8e41e2b90036\") " pod="openshift-ingress-canary/ingress-canary-pn864" Jun 08 12:10:07.455430 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.455337 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/433d1661-5360-45df-8679-18cd4f85c03b-config-volume\") pod \"dns-default-g28p2\" (UID: \"433d1661-5360-45df-8679-18cd4f85c03b\") " pod="openshift-dns/dns-default-g28p2" Jun 08 12:10:07.455430 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.455360 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls\") pod \"dns-default-g28p2\" (UID: \"433d1661-5360-45df-8679-18cd4f85c03b\") " pod="openshift-dns/dns-default-g28p2" Jun 08 12:10:07.556566 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.556533 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gsdt\" (UniqueName: \"kubernetes.io/projected/433d1661-5360-45df-8679-18cd4f85c03b-kube-api-access-4gsdt\") pod \"dns-default-g28p2\" (UID: \"433d1661-5360-45df-8679-18cd4f85c03b\") " pod="openshift-dns/dns-default-g28p2" Jun 08 12:10:07.556566 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.556573 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxz2t\" (UniqueName: \"kubernetes.io/projected/caa618ee-b34d-40f6-9615-8e41e2b90036-kube-api-access-cxz2t\") pod \"ingress-canary-pn864\" (UID: \"caa618ee-b34d-40f6-9615-8e41e2b90036\") " pod="openshift-ingress-canary/ingress-canary-pn864" Jun 08 12:10:07.556855 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.556592 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/caa618ee-b34d-40f6-9615-8e41e2b90036-cert\") pod \"ingress-canary-pn864\" (UID: \"caa618ee-b34d-40f6-9615-8e41e2b90036\") " pod="openshift-ingress-canary/ingress-canary-pn864" Jun 08 12:10:07.556855 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.556620 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/433d1661-5360-45df-8679-18cd4f85c03b-config-volume\") pod \"dns-default-g28p2\" (UID: \"433d1661-5360-45df-8679-18cd4f85c03b\") " pod="openshift-dns/dns-default-g28p2" Jun 08 12:10:07.556855 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.556636 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls\") pod \"dns-default-g28p2\" (UID: \"433d1661-5360-45df-8679-18cd4f85c03b\") " pod="openshift-dns/dns-default-g28p2" Jun 08 12:10:07.556855 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.556655 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/433d1661-5360-45df-8679-18cd4f85c03b-tmp-dir\") pod \"dns-default-g28p2\" (UID: \"433d1661-5360-45df-8679-18cd4f85c03b\") " pod="openshift-dns/dns-default-g28p2" Jun 08 12:10:07.557022 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.556947 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/433d1661-5360-45df-8679-18cd4f85c03b-tmp-dir\") pod \"dns-default-g28p2\" (UID: \"433d1661-5360-45df-8679-18cd4f85c03b\") " pod="openshift-dns/dns-default-g28p2" Jun 08 12:10:07.557171 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:07.557148 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:10:07.557229 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:07.557213 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls podName:433d1661-5360-45df-8679-18cd4f85c03b nodeName:}" failed. No retries permitted until 2026-06-08 12:10:08.057194967 +0000 UTC m=+36.173013085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls") pod "dns-default-g28p2" (UID: "433d1661-5360-45df-8679-18cd4f85c03b") : secret "dns-default-metrics-tls" not found Jun 08 12:10:07.557509 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.557484 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/433d1661-5360-45df-8679-18cd4f85c03b-config-volume\") pod \"dns-default-g28p2\" (UID: \"433d1661-5360-45df-8679-18cd4f85c03b\") " pod="openshift-dns/dns-default-g28p2" Jun 08 12:10:07.562044 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.562010 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/caa618ee-b34d-40f6-9615-8e41e2b90036-cert\") pod \"ingress-canary-pn864\" (UID: \"caa618ee-b34d-40f6-9615-8e41e2b90036\") " pod="openshift-ingress-canary/ingress-canary-pn864" Jun 08 12:10:07.565805 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.565769 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gsdt\" (UniqueName: \"kubernetes.io/projected/433d1661-5360-45df-8679-18cd4f85c03b-kube-api-access-4gsdt\") pod \"dns-default-g28p2\" (UID: \"433d1661-5360-45df-8679-18cd4f85c03b\") " pod="openshift-dns/dns-default-g28p2" Jun 08 12:10:07.566081 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.566054 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxz2t\" (UniqueName: \"kubernetes.io/projected/caa618ee-b34d-40f6-9615-8e41e2b90036-kube-api-access-cxz2t\") pod \"ingress-canary-pn864\" (UID: \"caa618ee-b34d-40f6-9615-8e41e2b90036\") " pod="openshift-ingress-canary/ingress-canary-pn864" Jun 08 12:10:07.601370 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:07.601340 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pn864" Jun 08 12:10:08.052296 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:08.052253 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:08.061199 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:08.061170 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls\") pod \"dns-default-g28p2\" (UID: \"433d1661-5360-45df-8679-18cd4f85c03b\") " pod="openshift-dns/dns-default-g28p2" Jun 08 12:10:08.061333 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:08.061309 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:10:08.061401 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:08.061388 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls podName:433d1661-5360-45df-8679-18cd4f85c03b nodeName:}" failed. No retries permitted until 2026-06-08 12:10:09.061368906 +0000 UTC m=+37.177187039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls") pod "dns-default-g28p2" (UID: "433d1661-5360-45df-8679-18cd4f85c03b") : secret "dns-default-metrics-tls" not found Jun 08 12:10:08.152738 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:08.152697 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:08.557711 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:08.557686 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pn864"] Jun 08 12:10:08.560552 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:10:08.560520 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaa618ee_b34d_40f6_9615_8e41e2b90036.slice/crio-b1800b68cd984cad3fecf826aa89778180d8370a33692f43c585d29c1bedb22b WatchSource:0}: Error finding container b1800b68cd984cad3fecf826aa89778180d8370a33692f43c585d29c1bedb22b: Status 404 returned error can't find the container with id b1800b68cd984cad3fecf826aa89778180d8370a33692f43c585d29c1bedb22b Jun 08 12:10:09.068236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:09.068027 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls\") pod \"dns-default-g28p2\" (UID: \"433d1661-5360-45df-8679-18cd4f85c03b\") " pod="openshift-dns/dns-default-g28p2" Jun 08 12:10:09.068392 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:09.068189 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:10:09.068392 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:09.068355 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls podName:433d1661-5360-45df-8679-18cd4f85c03b nodeName:}" failed. No retries permitted until 2026-06-08 12:10:11.068338318 +0000 UTC m=+39.184156433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls") pod "dns-default-g28p2" (UID: "433d1661-5360-45df-8679-18cd4f85c03b") : secret "dns-default-metrics-tls" not found Jun 08 12:10:09.540272 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:09.540236 2565 generic.go:356] "Generic (PLEG): container finished" podID="7680a2d2-3d3f-4a76-88c5-462b61659f38" containerID="da54b448eedf6e8e32d90537e7a723e627ff75ae10b2598748ebe32348795b76" exitCode=0 Jun 08 12:10:09.540453 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:09.540313 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d9dk7" event={"ID":"7680a2d2-3d3f-4a76-88c5-462b61659f38","Type":"ContainerDied","Data":"da54b448eedf6e8e32d90537e7a723e627ff75ae10b2598748ebe32348795b76"} Jun 08 12:10:09.541582 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:09.541545 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pn864" event={"ID":"caa618ee-b34d-40f6-9615-8e41e2b90036","Type":"ContainerStarted","Data":"b1800b68cd984cad3fecf826aa89778180d8370a33692f43c585d29c1bedb22b"} Jun 08 12:10:10.545131 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:10.545093 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pn864" event={"ID":"caa618ee-b34d-40f6-9615-8e41e2b90036","Type":"ContainerStarted","Data":"335622f461932e607b97437212a050399b54864581ee9dd70c6fdc0d4ca5d7ae"} Jun 08 12:10:10.548117 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:10.548087 2565 generic.go:356] "Generic (PLEG): container finished" podID="7680a2d2-3d3f-4a76-88c5-462b61659f38" containerID="6087016834d1902f742ab0bcb25930b6b99702316a70121d9095077110d7d47d" exitCode=0 Jun 08 12:10:10.548273 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:10.548131 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d9dk7" event={"ID":"7680a2d2-3d3f-4a76-88c5-462b61659f38","Type":"ContainerDied","Data":"6087016834d1902f742ab0bcb25930b6b99702316a70121d9095077110d7d47d"} Jun 08 12:10:10.563510 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:10.563472 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pn864" podStartSLOduration=2.086063006 podStartE2EDuration="3.563458938s" totalImagesPullingTime="1.477395932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:10:10.562858935 +0000 UTC m=+38.678677090" watchObservedRunningTime="2026-06-08 12:10:10.563458938 +0000 UTC m=+38.679277075" Jun 08 12:10:11.080723 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:11.080695 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls\") pod \"dns-default-g28p2\" (UID: \"433d1661-5360-45df-8679-18cd4f85c03b\") " pod="openshift-dns/dns-default-g28p2" Jun 08 12:10:11.080892 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:11.080872 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:10:11.080969 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:11.080948 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls podName:433d1661-5360-45df-8679-18cd4f85c03b nodeName:}" failed. No retries permitted until 2026-06-08 12:10:15.08092744 +0000 UTC m=+43.196745578 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls") pod "dns-default-g28p2" (UID: "433d1661-5360-45df-8679-18cd4f85c03b") : secret "dns-default-metrics-tls" not found Jun 08 12:10:11.500211 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:11.500175 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:11.553141 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:11.553108 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d9dk7" event={"ID":"7680a2d2-3d3f-4a76-88c5-462b61659f38","Type":"ContainerStarted","Data":"44c2b704d06d75034fbe14b7d2af84002506d22db80adcc8fe7d26eda12bb1fc"} Jun 08 12:10:11.576770 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:11.576727 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-d9dk7" podStartSLOduration=10.614610463 podStartE2EDuration="39.57671132s" totalImagesPullingTime="28.962100857s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:09:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:10:11.575499917 +0000 UTC m=+39.691318059" watchObservedRunningTime="2026-06-08 12:10:11.57671132 +0000 UTC m=+39.692529457" Jun 08 12:10:11.580489 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:11.580461 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:11.703765 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:11.703732 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:11.764905 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:11.764838 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:15.107155 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:15.107124 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls\") pod \"dns-default-g28p2\" (UID: \"433d1661-5360-45df-8679-18cd4f85c03b\") " pod="openshift-dns/dns-default-g28p2" Jun 08 12:10:15.107512 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:15.107221 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:10:15.107512 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:15.107282 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls podName:433d1661-5360-45df-8679-18cd4f85c03b nodeName:}" failed. No retries permitted until 2026-06-08 12:10:23.107267313 +0000 UTC m=+51.223085429 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls") pod "dns-default-g28p2" (UID: "433d1661-5360-45df-8679-18cd4f85c03b") : secret "dns-default-metrics-tls" not found Jun 08 12:10:23.160223 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:23.160182 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls\") pod \"dns-default-g28p2\" (UID: \"433d1661-5360-45df-8679-18cd4f85c03b\") " pod="openshift-dns/dns-default-g28p2" Jun 08 12:10:23.160944 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:23.160369 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:10:23.160944 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:23.160457 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls podName:433d1661-5360-45df-8679-18cd4f85c03b nodeName:}" failed. No retries permitted until 2026-06-08 12:10:39.160434018 +0000 UTC m=+67.276252147 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls") pod "dns-default-g28p2" (UID: "433d1661-5360-45df-8679-18cd4f85c03b") : secret "dns-default-metrics-tls" not found Jun 08 12:10:27.726979 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:27.726937 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:27.783505 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:27.783472 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:28.020978 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:28.020899 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:28.075362 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:28.075329 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:33.530977 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:33.530950 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kwxhk" Jun 08 12:10:33.663854 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:33.663798 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:33.741606 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:33.741574 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:38.060175 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:38.060136 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret\") pod \"global-pull-secret-syncer-7pwsz\" (UID: \"4e3e7141-3861-4baa-b7ea-ca348f74a095\") " pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:10:38.060175 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:38.060173 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs\") pod \"network-metrics-daemon-g8qk7\" (UID: \"723a030e-60ee-457c-ae18-aac839fd2a5a\") " pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:10:38.062850 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:38.062806 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 12:10:38.062967 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:38.062949 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 12:10:38.070931 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:38.070910 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 12:10:38.071012 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:38.070994 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs podName:723a030e-60ee-457c-ae18-aac839fd2a5a nodeName:}" failed. No retries permitted until 2026-06-08 12:11:42.070972302 +0000 UTC m=+130.186790418 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs") pod "network-metrics-daemon-g8qk7" (UID: "723a030e-60ee-457c-ae18-aac839fd2a5a") : secret "metrics-daemon-secret" not found Jun 08 12:10:38.074259 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:38.074232 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e3e7141-3861-4baa-b7ea-ca348f74a095-original-pull-secret\") pod \"global-pull-secret-syncer-7pwsz\" (UID: \"4e3e7141-3861-4baa-b7ea-ca348f74a095\") " pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:10:38.253544 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:38.253496 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7pwsz" Jun 08 12:10:38.262118 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:38.262094 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmmzd\" (UniqueName: \"kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd\") pod \"network-check-target-s2sh7\" (UID: \"5fe99017-3c64-437c-904d-397ce9012add\") " pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:10:38.266642 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:38.266556 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 12:10:38.274746 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:38.274721 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 12:10:38.286112 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:38.286091 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmmzd\" (UniqueName: \"kubernetes.io/projected/5fe99017-3c64-437c-904d-397ce9012add-kube-api-access-wmmzd\") pod \"network-check-target-s2sh7\" (UID: \"5fe99017-3c64-437c-904d-397ce9012add\") " pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:10:38.378050 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:38.377982 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7pwsz"] Jun 08 12:10:38.381316 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:10:38.381279 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e3e7141_3861_4baa_b7ea_ca348f74a095.slice/crio-87de5582027d54d30b5f4949852abfe48222cd10f9ef96e9a3164f730d87ec33 WatchSource:0}: Error finding container 87de5582027d54d30b5f4949852abfe48222cd10f9ef96e9a3164f730d87ec33: Status 404 returned error can't find the container with id 87de5582027d54d30b5f4949852abfe48222cd10f9ef96e9a3164f730d87ec33 Jun 08 12:10:38.563358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:38.563330 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nvw7c\"" Jun 08 12:10:38.571528 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:38.571504 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:10:38.620798 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:38.620762 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7pwsz" event={"ID":"4e3e7141-3861-4baa-b7ea-ca348f74a095","Type":"ContainerStarted","Data":"87de5582027d54d30b5f4949852abfe48222cd10f9ef96e9a3164f730d87ec33"} Jun 08 12:10:38.691472 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:38.691437 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s2sh7"] Jun 08 12:10:38.694156 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:10:38.694128 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fe99017_3c64_437c_904d_397ce9012add.slice/crio-d90c61cbe567f796db2d0233db42dafd4d7e2c3ae656fbd2b68a2cc4a2b92fe7 WatchSource:0}: Error finding container d90c61cbe567f796db2d0233db42dafd4d7e2c3ae656fbd2b68a2cc4a2b92fe7: Status 404 returned error can't find the container with id d90c61cbe567f796db2d0233db42dafd4d7e2c3ae656fbd2b68a2cc4a2b92fe7 Jun 08 12:10:39.170305 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:39.170269 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls\") pod \"dns-default-g28p2\" (UID: \"433d1661-5360-45df-8679-18cd4f85c03b\") " pod="openshift-dns/dns-default-g28p2" Jun 08 12:10:39.170752 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:39.170399 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:10:39.170752 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:10:39.170477 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls podName:433d1661-5360-45df-8679-18cd4f85c03b nodeName:}" failed. No retries permitted until 2026-06-08 12:11:11.170455919 +0000 UTC m=+99.286274051 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls") pod "dns-default-g28p2" (UID: "433d1661-5360-45df-8679-18cd4f85c03b") : secret "dns-default-metrics-tls" not found Jun 08 12:10:39.625267 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:39.625229 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s2sh7" event={"ID":"5fe99017-3c64-437c-904d-397ce9012add","Type":"ContainerStarted","Data":"d90c61cbe567f796db2d0233db42dafd4d7e2c3ae656fbd2b68a2cc4a2b92fe7"} Jun 08 12:10:40.506712 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:40.506675 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:40.565251 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:40.565217 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:10:43.637304 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:43.637198 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s2sh7" event={"ID":"5fe99017-3c64-437c-904d-397ce9012add","Type":"ContainerStarted","Data":"4f35adf4b3327446fba0ea21904b02fb58621cd4a49d631225cf463d3d9babcd"} Jun 08 12:10:43.637645 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:43.637340 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:10:43.661700 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:43.661647 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-s2sh7" podStartSLOduration=66.819487043 podStartE2EDuration="1m11.661632836s" totalImagesPullingTime="4.842145793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:09:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:10:43.660986129 +0000 UTC m=+71.776804266" watchObservedRunningTime="2026-06-08 12:10:43.661632836 +0000 UTC m=+71.777450952" Jun 08 12:10:44.641451 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:44.641416 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7pwsz" event={"ID":"4e3e7141-3861-4baa-b7ea-ca348f74a095","Type":"ContainerStarted","Data":"3f10d6692e3eb15eff961cde239595e6f7aa52660ac535070fe4cfa584eca113"} Jun 08 12:10:44.656649 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:10:44.656603 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7pwsz" podStartSLOduration=67.500209699 podStartE2EDuration="1m12.65658763s" totalImagesPullingTime="5.156377931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:09:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:10:44.6565496 +0000 UTC m=+72.772367741" watchObservedRunningTime="2026-06-08 12:10:44.65658763 +0000 UTC m=+72.772405767" Jun 08 12:11:11.186434 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:11:11.186387 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls\") pod \"dns-default-g28p2\" (UID: \"433d1661-5360-45df-8679-18cd4f85c03b\") " pod="openshift-dns/dns-default-g28p2" Jun 08 12:11:11.186774 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:11:11.186525 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:11:11.186774 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:11:11.186600 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls podName:433d1661-5360-45df-8679-18cd4f85c03b nodeName:}" failed. No retries permitted until 2026-06-08 12:12:15.186582418 +0000 UTC m=+163.302400542 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls") pod "dns-default-g28p2" (UID: "433d1661-5360-45df-8679-18cd4f85c03b") : secret "dns-default-metrics-tls" not found Jun 08 12:11:14.643453 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:11:14.643422 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-s2sh7" Jun 08 12:11:42.081015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:11:42.080968 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs\") pod \"network-metrics-daemon-g8qk7\" (UID: \"723a030e-60ee-457c-ae18-aac839fd2a5a\") " pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:11:42.081496 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:11:42.081085 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 12:11:42.081496 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:11:42.081147 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs podName:723a030e-60ee-457c-ae18-aac839fd2a5a nodeName:}" failed. No retries permitted until 2026-06-08 12:13:44.081133239 +0000 UTC m=+252.196951354 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs") pod "network-metrics-daemon-g8qk7" (UID: "723a030e-60ee-457c-ae18-aac839fd2a5a") : secret "metrics-daemon-secret" not found Jun 08 12:12:10.288774 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:12:10.288734 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-g28p2" podUID="433d1661-5360-45df-8679-18cd4f85c03b" Jun 08 12:12:10.366252 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:12:10.366211 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-g8qk7" podUID="723a030e-60ee-457c-ae18-aac839fd2a5a" Jun 08 12:12:10.839503 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:12:10.839475 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g28p2" Jun 08 12:12:15.205778 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:12:15.205689 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls\") pod \"dns-default-g28p2\" (UID: \"433d1661-5360-45df-8679-18cd4f85c03b\") " pod="openshift-dns/dns-default-g28p2" Jun 08 12:12:15.206186 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:12:15.205805 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 12:12:15.206186 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:12:15.205914 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls podName:433d1661-5360-45df-8679-18cd4f85c03b nodeName:}" failed. No retries permitted until 2026-06-08 12:14:17.205898408 +0000 UTC m=+285.321716524 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls") pod "dns-default-g28p2" (UID: "433d1661-5360-45df-8679-18cd4f85c03b") : secret "dns-default-metrics-tls" not found Jun 08 12:12:25.341402 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:12:25.341365 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:12:30.898975 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:12:30.898936 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:20.464787 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.464759 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-l2pq7"] Jun 08 12:13:20.466352 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.466333 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-l2pq7" Jun 08 12:13:20.468084 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.468064 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-86bvt"] Jun 08 12:13:20.468905 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.468879 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 08 12:13:20.469007 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.468915 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 08 12:13:20.469175 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.469159 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:13:20.469371 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.469356 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 08 12:13:20.469440 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.469411 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7njcl\"" Jun 08 12:13:20.469524 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.469508 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vzg7c"] Jun 08 12:13:20.469593 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.469575 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-86bvt" Jun 08 12:13:20.473021 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.472135 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 12:13:20.473021 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.472484 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 08 12:13:20.473021 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.472572 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-g8qjj\"" Jun 08 12:13:20.473021 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.472698 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 08 12:13:20.473021 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.472807 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 12:13:20.474553 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.474496 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-qvcwf"] Jun 08 12:13:20.475570 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.474760 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vzg7c" Jun 08 12:13:20.477210 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.477192 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-fk5fp"] Jun 08 12:13:20.477445 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.477431 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" Jun 08 12:13:20.478265 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.478242 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 08 12:13:20.478373 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.478242 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:13:20.478373 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.478243 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 08 12:13:20.478373 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.478358 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 08 12:13:20.478552 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.478449 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-g962z\"" Jun 08 12:13:20.479203 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.479184 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-l2pq7"] Jun 08 12:13:20.479284 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.479268 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-fk5fp" Jun 08 12:13:20.479339 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.479328 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 08 12:13:20.480611 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.480589 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 08 12:13:20.480719 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.480700 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:13:20.480891 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.480874 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 08 12:13:20.481112 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.481092 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-h8l9p\"" Jun 08 12:13:20.481185 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.481160 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 08 12:13:20.481837 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.481617 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vmmdc\"" Jun 08 12:13:20.481837 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.481711 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 08 12:13:20.482233 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.482216 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 08 12:13:20.483274 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.483252 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vzg7c"] Jun 08 12:13:20.487342 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.487321 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-86bvt"] Jun 08 12:13:20.487588 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.487569 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 08 12:13:20.488244 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.488226 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-fk5fp"] Jun 08 12:13:20.492358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.492338 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-qvcwf"] Jun 08 12:13:20.523552 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.523533 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c6f655c-0584-4430-87ec-ead19aa53dd0-trusted-ca-bundle\") pod \"insights-operator-896549976-86bvt\" (UID: \"3c6f655c-0584-4430-87ec-ead19aa53dd0\") " pod="openshift-insights/insights-operator-896549976-86bvt" Jun 08 12:13:20.523653 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.523560 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c6f655c-0584-4430-87ec-ead19aa53dd0-service-ca-bundle\") pod \"insights-operator-896549976-86bvt\" (UID: \"3c6f655c-0584-4430-87ec-ead19aa53dd0\") " pod="openshift-insights/insights-operator-896549976-86bvt" Jun 08 12:13:20.523653 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.523581 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bccqn\" (UniqueName: \"kubernetes.io/projected/4b9681e8-a3af-4356-b6fc-f87994ccf29b-kube-api-access-bccqn\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-l2pq7\" (UID: \"4b9681e8-a3af-4356-b6fc-f87994ccf29b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-l2pq7" Jun 08 12:13:20.523653 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.523605 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c6f655c-0584-4430-87ec-ead19aa53dd0-tmp\") pod \"insights-operator-896549976-86bvt\" (UID: \"3c6f655c-0584-4430-87ec-ead19aa53dd0\") " pod="openshift-insights/insights-operator-896549976-86bvt" Jun 08 12:13:20.523653 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.523621 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qndwt\" (UniqueName: \"kubernetes.io/projected/cf16c9e4-8b0b-45af-a63d-bb5497a6908d-kube-api-access-qndwt\") pod \"service-ca-operator-6bc5ff68f5-vzg7c\" (UID: \"cf16c9e4-8b0b-45af-a63d-bb5497a6908d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vzg7c" Jun 08 12:13:20.523653 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.523649 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b9681e8-a3af-4356-b6fc-f87994ccf29b-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-l2pq7\" (UID: \"4b9681e8-a3af-4356-b6fc-f87994ccf29b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-l2pq7" Jun 08 12:13:20.523846 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.523663 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/849e7162-23cb-4135-a99d-fc8cbfd20800-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-fk5fp\" (UID: \"849e7162-23cb-4135-a99d-fc8cbfd20800\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-fk5fp" Jun 08 12:13:20.523846 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.523678 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cf16c9e4-8b0b-45af-a63d-bb5497a6908d-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-vzg7c\" (UID: \"cf16c9e4-8b0b-45af-a63d-bb5497a6908d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vzg7c" Jun 08 12:13:20.523846 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.523714 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/731f4b21-0de5-4184-aa7d-05eab33ce31e-config\") pod \"console-operator-668fdbf85c-qvcwf\" (UID: \"731f4b21-0de5-4184-aa7d-05eab33ce31e\") " pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" Jun 08 12:13:20.523846 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.523785 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3c6f655c-0584-4430-87ec-ead19aa53dd0-snapshots\") pod \"insights-operator-896549976-86bvt\" (UID: \"3c6f655c-0584-4430-87ec-ead19aa53dd0\") " pod="openshift-insights/insights-operator-896549976-86bvt" Jun 08 12:13:20.523846 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.523808 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/731f4b21-0de5-4184-aa7d-05eab33ce31e-serving-cert\") pod \"console-operator-668fdbf85c-qvcwf\" (UID: \"731f4b21-0de5-4184-aa7d-05eab33ce31e\") " pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" Jun 08 12:13:20.523846 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.523842 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/731f4b21-0de5-4184-aa7d-05eab33ce31e-trusted-ca\") pod \"console-operator-668fdbf85c-qvcwf\" (UID: \"731f4b21-0de5-4184-aa7d-05eab33ce31e\") " pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" Jun 08 12:13:20.524043 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.523858 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqxw9\" (UniqueName: \"kubernetes.io/projected/3c6f655c-0584-4430-87ec-ead19aa53dd0-kube-api-access-zqxw9\") pod \"insights-operator-896549976-86bvt\" (UID: \"3c6f655c-0584-4430-87ec-ead19aa53dd0\") " pod="openshift-insights/insights-operator-896549976-86bvt" Jun 08 12:13:20.524043 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.523875 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cf16c9e4-8b0b-45af-a63d-bb5497a6908d-config\") pod \"service-ca-operator-6bc5ff68f5-vzg7c\" (UID: \"cf16c9e4-8b0b-45af-a63d-bb5497a6908d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vzg7c" Jun 08 12:13:20.524043 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.523892 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b9681e8-a3af-4356-b6fc-f87994ccf29b-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-l2pq7\" (UID: \"4b9681e8-a3af-4356-b6fc-f87994ccf29b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-l2pq7" Jun 08 12:13:20.524043 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.523908 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/849e7162-23cb-4135-a99d-fc8cbfd20800-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-fk5fp\" (UID: \"849e7162-23cb-4135-a99d-fc8cbfd20800\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-fk5fp" Jun 08 12:13:20.524043 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.523937 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsjwb\" (UniqueName: \"kubernetes.io/projected/731f4b21-0de5-4184-aa7d-05eab33ce31e-kube-api-access-xsjwb\") pod \"console-operator-668fdbf85c-qvcwf\" (UID: \"731f4b21-0de5-4184-aa7d-05eab33ce31e\") " pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" Jun 08 12:13:20.524043 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.523963 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c6f655c-0584-4430-87ec-ead19aa53dd0-serving-cert\") pod \"insights-operator-896549976-86bvt\" (UID: \"3c6f655c-0584-4430-87ec-ead19aa53dd0\") " pod="openshift-insights/insights-operator-896549976-86bvt" Jun 08 12:13:20.567248 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.567223 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ww6tn"] Jun 08 12:13:20.569198 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.569185 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ww6tn" Jun 08 12:13:20.571866 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.571838 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-h8ml2"] Jun 08 12:13:20.572009 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.571898 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 08 12:13:20.573085 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.572913 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gb7p7\"" Jun 08 12:13:20.573085 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.573001 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 12:13:20.573085 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.573013 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 12:13:20.573391 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.573377 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 08 12:13:20.573636 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.573621 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-h8ml2" Jun 08 12:13:20.576324 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.576306 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nvbhf\"" Jun 08 12:13:20.576453 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.576304 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 08 12:13:20.576655 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.576582 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:13:20.582173 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.582153 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ww6tn"] Jun 08 12:13:20.584280 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.584262 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-h8ml2"] Jun 08 12:13:20.590836 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.590799 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:20.624198 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.624170 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsjwb\" (UniqueName: \"kubernetes.io/projected/731f4b21-0de5-4184-aa7d-05eab33ce31e-kube-api-access-xsjwb\") pod \"console-operator-668fdbf85c-qvcwf\" (UID: \"731f4b21-0de5-4184-aa7d-05eab33ce31e\") " pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" Jun 08 12:13:20.624306 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.624209 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/13f7ee1f-daae-4663-88e0-4be29a8927d8-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-ww6tn\" (UID: \"13f7ee1f-daae-4663-88e0-4be29a8927d8\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ww6tn" Jun 08 12:13:20.624306 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.624235 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c6f655c-0584-4430-87ec-ead19aa53dd0-trusted-ca-bundle\") pod \"insights-operator-896549976-86bvt\" (UID: \"3c6f655c-0584-4430-87ec-ead19aa53dd0\") " pod="openshift-insights/insights-operator-896549976-86bvt" Jun 08 12:13:20.624306 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.624261 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bccqn\" (UniqueName: \"kubernetes.io/projected/4b9681e8-a3af-4356-b6fc-f87994ccf29b-kube-api-access-bccqn\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-l2pq7\" (UID: \"4b9681e8-a3af-4356-b6fc-f87994ccf29b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-l2pq7" Jun 08 12:13:20.624424 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.624318 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9mzp\" (UniqueName: \"kubernetes.io/projected/82196494-14a7-469a-9647-b3c98b0bb4c5-kube-api-access-r9mzp\") pod \"volume-data-source-validator-78dd696465-h8ml2\" (UID: \"82196494-14a7-469a-9647-b3c98b0bb4c5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-h8ml2" Jun 08 12:13:20.624424 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.624374 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qndwt\" (UniqueName: \"kubernetes.io/projected/cf16c9e4-8b0b-45af-a63d-bb5497a6908d-kube-api-access-qndwt\") pod \"service-ca-operator-6bc5ff68f5-vzg7c\" (UID: \"cf16c9e4-8b0b-45af-a63d-bb5497a6908d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vzg7c" Jun 08 12:13:20.624513 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.624425 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b9681e8-a3af-4356-b6fc-f87994ccf29b-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-l2pq7\" (UID: \"4b9681e8-a3af-4356-b6fc-f87994ccf29b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-l2pq7" Jun 08 12:13:20.624513 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.624449 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/731f4b21-0de5-4184-aa7d-05eab33ce31e-config\") pod \"console-operator-668fdbf85c-qvcwf\" (UID: \"731f4b21-0de5-4184-aa7d-05eab33ce31e\") " pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" Jun 08 12:13:20.624513 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.624467 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b9681e8-a3af-4356-b6fc-f87994ccf29b-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-l2pq7\" (UID: \"4b9681e8-a3af-4356-b6fc-f87994ccf29b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-l2pq7" Jun 08 12:13:20.624513 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.624485 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cf16c9e4-8b0b-45af-a63d-bb5497a6908d-config\") pod \"service-ca-operator-6bc5ff68f5-vzg7c\" (UID: \"cf16c9e4-8b0b-45af-a63d-bb5497a6908d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vzg7c" Jun 08 12:13:20.624709 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.624608 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13f7ee1f-daae-4663-88e0-4be29a8927d8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ww6tn\" (UID: \"13f7ee1f-daae-4663-88e0-4be29a8927d8\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ww6tn" Jun 08 12:13:20.624709 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.624642 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2l4d\" (UniqueName: \"kubernetes.io/projected/13f7ee1f-daae-4663-88e0-4be29a8927d8-kube-api-access-p2l4d\") pod \"cluster-monitoring-operator-74bbf69bbb-ww6tn\" (UID: \"13f7ee1f-daae-4663-88e0-4be29a8927d8\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ww6tn" Jun 08 12:13:20.624709 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.624672 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqxw9\" (UniqueName: \"kubernetes.io/projected/3c6f655c-0584-4430-87ec-ead19aa53dd0-kube-api-access-zqxw9\") pod \"insights-operator-896549976-86bvt\" (UID: \"3c6f655c-0584-4430-87ec-ead19aa53dd0\") " pod="openshift-insights/insights-operator-896549976-86bvt" Jun 08 12:13:20.624883 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.624732 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c6f655c-0584-4430-87ec-ead19aa53dd0-serving-cert\") pod \"insights-operator-896549976-86bvt\" (UID: \"3c6f655c-0584-4430-87ec-ead19aa53dd0\") " pod="openshift-insights/insights-operator-896549976-86bvt" Jun 08 12:13:20.625020 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.624997 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c6f655c-0584-4430-87ec-ead19aa53dd0-service-ca-bundle\") pod \"insights-operator-896549976-86bvt\" (UID: \"3c6f655c-0584-4430-87ec-ead19aa53dd0\") " pod="openshift-insights/insights-operator-896549976-86bvt" Jun 08 12:13:20.625120 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.625099 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cf16c9e4-8b0b-45af-a63d-bb5497a6908d-config\") pod \"service-ca-operator-6bc5ff68f5-vzg7c\" (UID: \"cf16c9e4-8b0b-45af-a63d-bb5497a6908d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vzg7c" Jun 08 12:13:20.625230 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.625208 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c6f655c-0584-4430-87ec-ead19aa53dd0-trusted-ca-bundle\") pod \"insights-operator-896549976-86bvt\" (UID: \"3c6f655c-0584-4430-87ec-ead19aa53dd0\") " pod="openshift-insights/insights-operator-896549976-86bvt" Jun 08 12:13:20.625297 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.625204 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c6f655c-0584-4430-87ec-ead19aa53dd0-tmp\") pod \"insights-operator-896549976-86bvt\" (UID: \"3c6f655c-0584-4430-87ec-ead19aa53dd0\") " pod="openshift-insights/insights-operator-896549976-86bvt" Jun 08 12:13:20.625297 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.625264 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b9681e8-a3af-4356-b6fc-f87994ccf29b-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-l2pq7\" (UID: \"4b9681e8-a3af-4356-b6fc-f87994ccf29b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-l2pq7" Jun 08 12:13:20.625297 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.625285 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/731f4b21-0de5-4184-aa7d-05eab33ce31e-serving-cert\") pod \"console-operator-668fdbf85c-qvcwf\" (UID: \"731f4b21-0de5-4184-aa7d-05eab33ce31e\") " pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" Jun 08 12:13:20.625457 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.625314 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/731f4b21-0de5-4184-aa7d-05eab33ce31e-trusted-ca\") pod \"console-operator-668fdbf85c-qvcwf\" (UID: \"731f4b21-0de5-4184-aa7d-05eab33ce31e\") " pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" Jun 08 12:13:20.625457 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.625374 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/731f4b21-0de5-4184-aa7d-05eab33ce31e-config\") pod \"console-operator-668fdbf85c-qvcwf\" (UID: \"731f4b21-0de5-4184-aa7d-05eab33ce31e\") " pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" Jun 08 12:13:20.625562 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.625508 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c6f655c-0584-4430-87ec-ead19aa53dd0-service-ca-bundle\") pod \"insights-operator-896549976-86bvt\" (UID: \"3c6f655c-0584-4430-87ec-ead19aa53dd0\") " pod="openshift-insights/insights-operator-896549976-86bvt" Jun 08 12:13:20.625885 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.625862 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c6f655c-0584-4430-87ec-ead19aa53dd0-tmp\") pod \"insights-operator-896549976-86bvt\" (UID: \"3c6f655c-0584-4430-87ec-ead19aa53dd0\") " pod="openshift-insights/insights-operator-896549976-86bvt" Jun 08 12:13:20.626063 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:20.626043 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 12:13:20.626125 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:20.626111 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/849e7162-23cb-4135-a99d-fc8cbfd20800-networking-console-plugin-cert podName:849e7162-23cb-4135-a99d-fc8cbfd20800 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:21.126094129 +0000 UTC m=+229.241912246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/849e7162-23cb-4135-a99d-fc8cbfd20800-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-fk5fp" (UID: "849e7162-23cb-4135-a99d-fc8cbfd20800") : secret "networking-console-plugin-cert" not found Jun 08 12:13:20.626234 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.625508 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/849e7162-23cb-4135-a99d-fc8cbfd20800-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-fk5fp\" (UID: \"849e7162-23cb-4135-a99d-fc8cbfd20800\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-fk5fp" Jun 08 12:13:20.626403 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.626370 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cf16c9e4-8b0b-45af-a63d-bb5497a6908d-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-vzg7c\" (UID: \"cf16c9e4-8b0b-45af-a63d-bb5497a6908d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vzg7c" Jun 08 12:13:20.626538 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.626524 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3c6f655c-0584-4430-87ec-ead19aa53dd0-snapshots\") pod \"insights-operator-896549976-86bvt\" (UID: \"3c6f655c-0584-4430-87ec-ead19aa53dd0\") " pod="openshift-insights/insights-operator-896549976-86bvt" Jun 08 12:13:20.626653 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.626626 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/731f4b21-0de5-4184-aa7d-05eab33ce31e-trusted-ca\") pod \"console-operator-668fdbf85c-qvcwf\" (UID: \"731f4b21-0de5-4184-aa7d-05eab33ce31e\") " pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" Jun 08 12:13:20.626798 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.626642 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/849e7162-23cb-4135-a99d-fc8cbfd20800-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-fk5fp\" (UID: \"849e7162-23cb-4135-a99d-fc8cbfd20800\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-fk5fp" Jun 08 12:13:20.627469 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.627440 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c6f655c-0584-4430-87ec-ead19aa53dd0-serving-cert\") pod \"insights-operator-896549976-86bvt\" (UID: \"3c6f655c-0584-4430-87ec-ead19aa53dd0\") " pod="openshift-insights/insights-operator-896549976-86bvt" Jun 08 12:13:20.627560 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.627511 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3c6f655c-0584-4430-87ec-ead19aa53dd0-snapshots\") pod \"insights-operator-896549976-86bvt\" (UID: \"3c6f655c-0584-4430-87ec-ead19aa53dd0\") " pod="openshift-insights/insights-operator-896549976-86bvt" Jun 08 12:13:20.628102 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.627920 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b9681e8-a3af-4356-b6fc-f87994ccf29b-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-l2pq7\" (UID: \"4b9681e8-a3af-4356-b6fc-f87994ccf29b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-l2pq7" Jun 08 12:13:20.628924 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.628654 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/731f4b21-0de5-4184-aa7d-05eab33ce31e-serving-cert\") pod \"console-operator-668fdbf85c-qvcwf\" (UID: \"731f4b21-0de5-4184-aa7d-05eab33ce31e\") " pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" Jun 08 12:13:20.631521 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.631499 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/849e7162-23cb-4135-a99d-fc8cbfd20800-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-fk5fp\" (UID: \"849e7162-23cb-4135-a99d-fc8cbfd20800\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-fk5fp" Jun 08 12:13:20.633508 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.633476 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cf16c9e4-8b0b-45af-a63d-bb5497a6908d-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-vzg7c\" (UID: \"cf16c9e4-8b0b-45af-a63d-bb5497a6908d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vzg7c" Jun 08 12:13:20.633893 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.633870 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqxw9\" (UniqueName: \"kubernetes.io/projected/3c6f655c-0584-4430-87ec-ead19aa53dd0-kube-api-access-zqxw9\") pod \"insights-operator-896549976-86bvt\" (UID: \"3c6f655c-0584-4430-87ec-ead19aa53dd0\") " pod="openshift-insights/insights-operator-896549976-86bvt" Jun 08 12:13:20.634027 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.634004 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qndwt\" (UniqueName: \"kubernetes.io/projected/cf16c9e4-8b0b-45af-a63d-bb5497a6908d-kube-api-access-qndwt\") pod \"service-ca-operator-6bc5ff68f5-vzg7c\" (UID: \"cf16c9e4-8b0b-45af-a63d-bb5497a6908d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vzg7c" Jun 08 12:13:20.634094 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.634048 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsjwb\" (UniqueName: \"kubernetes.io/projected/731f4b21-0de5-4184-aa7d-05eab33ce31e-kube-api-access-xsjwb\") pod \"console-operator-668fdbf85c-qvcwf\" (UID: \"731f4b21-0de5-4184-aa7d-05eab33ce31e\") " pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" Jun 08 12:13:20.634094 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.634069 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bccqn\" (UniqueName: \"kubernetes.io/projected/4b9681e8-a3af-4356-b6fc-f87994ccf29b-kube-api-access-bccqn\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-l2pq7\" (UID: \"4b9681e8-a3af-4356-b6fc-f87994ccf29b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-l2pq7" Jun 08 12:13:20.660389 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.660355 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5b7fc957f7-d6lvs"] Jun 08 12:13:20.663104 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.663087 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-797ffd8674-tqbhc"] Jun 08 12:13:20.663219 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.663203 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:20.665108 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.665091 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.665658 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.665640 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 08 12:13:20.665890 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.665876 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 08 12:13:20.665890 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.665877 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-x9mgc\"" Jun 08 12:13:20.666031 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.665927 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 12:13:20.666141 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.666126 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 08 12:13:20.666211 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.666147 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 12:13:20.666211 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.666199 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 08 12:13:20.667441 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.667426 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 08 12:13:20.667563 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.667526 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 08 12:13:20.667684 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.667669 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-txkmd\"" Jun 08 12:13:20.667754 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.667681 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 08 12:13:20.673577 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.673560 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 08 12:13:20.677365 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.677341 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b7fc957f7-d6lvs"] Jun 08 12:13:20.678640 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.678621 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-797ffd8674-tqbhc"] Jun 08 12:13:20.727434 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.727370 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-tls\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.727434 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.727401 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31212e59-0c60-4c2c-bb16-c0aa87017897-installation-pull-secrets\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.727434 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.727420 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74x4m\" (UniqueName: \"kubernetes.io/projected/d33beb41-9adf-42a6-9888-140d58450017-kube-api-access-74x4m\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:20.727595 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.727446 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d33beb41-9adf-42a6-9888-140d58450017-service-ca-bundle\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:20.727595 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.727484 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-metrics-certs\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:20.727595 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.727511 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13f7ee1f-daae-4663-88e0-4be29a8927d8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ww6tn\" (UID: \"13f7ee1f-daae-4663-88e0-4be29a8927d8\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ww6tn" Jun 08 12:13:20.727595 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.727529 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2l4d\" (UniqueName: \"kubernetes.io/projected/13f7ee1f-daae-4663-88e0-4be29a8927d8-kube-api-access-p2l4d\") pod \"cluster-monitoring-operator-74bbf69bbb-ww6tn\" (UID: \"13f7ee1f-daae-4663-88e0-4be29a8927d8\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ww6tn" Jun 08 12:13:20.727595 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.727548 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31212e59-0c60-4c2c-bb16-c0aa87017897-ca-trust-extracted\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.727595 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.727563 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-bound-sa-token\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.727595 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.727586 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31212e59-0c60-4c2c-bb16-c0aa87017897-image-registry-private-configuration\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.727870 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:20.727598 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 12:13:20.727870 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.727660 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-certificates\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.727870 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.727695 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-default-certificate\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:20.727870 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:20.727723 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13f7ee1f-daae-4663-88e0-4be29a8927d8-cluster-monitoring-operator-tls podName:13f7ee1f-daae-4663-88e0-4be29a8927d8 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:21.227704444 +0000 UTC m=+229.343522560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13f7ee1f-daae-4663-88e0-4be29a8927d8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-ww6tn" (UID: "13f7ee1f-daae-4663-88e0-4be29a8927d8") : secret "cluster-monitoring-operator-tls" not found Jun 08 12:13:20.727870 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.727789 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqk6k\" (UniqueName: \"kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-kube-api-access-vqk6k\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.727870 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.727841 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/13f7ee1f-daae-4663-88e0-4be29a8927d8-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-ww6tn\" (UID: \"13f7ee1f-daae-4663-88e0-4be29a8927d8\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ww6tn" Jun 08 12:13:20.727870 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.727863 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31212e59-0c60-4c2c-bb16-c0aa87017897-trusted-ca\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.728081 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.727886 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-stats-auth\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:20.728081 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.727913 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9mzp\" (UniqueName: \"kubernetes.io/projected/82196494-14a7-469a-9647-b3c98b0bb4c5-kube-api-access-r9mzp\") pod \"volume-data-source-validator-78dd696465-h8ml2\" (UID: \"82196494-14a7-469a-9647-b3c98b0bb4c5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-h8ml2" Jun 08 12:13:20.728406 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.728389 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/13f7ee1f-daae-4663-88e0-4be29a8927d8-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-ww6tn\" (UID: \"13f7ee1f-daae-4663-88e0-4be29a8927d8\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ww6tn" Jun 08 12:13:20.735661 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.735635 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9mzp\" (UniqueName: \"kubernetes.io/projected/82196494-14a7-469a-9647-b3c98b0bb4c5-kube-api-access-r9mzp\") pod \"volume-data-source-validator-78dd696465-h8ml2\" (UID: \"82196494-14a7-469a-9647-b3c98b0bb4c5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-h8ml2" Jun 08 12:13:20.735911 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.735890 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2l4d\" (UniqueName: \"kubernetes.io/projected/13f7ee1f-daae-4663-88e0-4be29a8927d8-kube-api-access-p2l4d\") pod \"cluster-monitoring-operator-74bbf69bbb-ww6tn\" (UID: \"13f7ee1f-daae-4663-88e0-4be29a8927d8\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ww6tn" Jun 08 12:13:20.780883 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.780852 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-l2pq7" Jun 08 12:13:20.789827 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.789793 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-86bvt" Jun 08 12:13:20.796902 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.796884 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vzg7c" Jun 08 12:13:20.802263 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.802245 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" Jun 08 12:13:20.828804 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.828759 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-stats-auth\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:20.828976 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.828829 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-tls\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.828976 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.828860 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31212e59-0c60-4c2c-bb16-c0aa87017897-installation-pull-secrets\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.828976 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.828885 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74x4m\" (UniqueName: \"kubernetes.io/projected/d33beb41-9adf-42a6-9888-140d58450017-kube-api-access-74x4m\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:20.828976 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.828910 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d33beb41-9adf-42a6-9888-140d58450017-service-ca-bundle\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:20.828976 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.828933 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-metrics-certs\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:20.828976 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.828974 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31212e59-0c60-4c2c-bb16-c0aa87017897-ca-trust-extracted\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.829258 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.828997 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-bound-sa-token\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.829258 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.829024 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31212e59-0c60-4c2c-bb16-c0aa87017897-image-registry-private-configuration\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.829258 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.829117 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-certificates\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.829258 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.829145 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-default-certificate\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:20.829258 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.829169 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqk6k\" (UniqueName: \"kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-kube-api-access-vqk6k\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.829258 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.829199 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31212e59-0c60-4c2c-bb16-c0aa87017897-trusted-ca\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.829629 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:20.829485 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 12:13:20.829629 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:20.829560 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-metrics-certs podName:d33beb41-9adf-42a6-9888-140d58450017 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:21.329537445 +0000 UTC m=+229.445355581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-metrics-certs") pod "router-default-5b7fc957f7-d6lvs" (UID: "d33beb41-9adf-42a6-9888-140d58450017") : secret "router-metrics-certs-default" not found Jun 08 12:13:20.830357 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.830273 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31212e59-0c60-4c2c-bb16-c0aa87017897-trusted-ca\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.830516 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:20.830475 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d33beb41-9adf-42a6-9888-140d58450017-service-ca-bundle podName:d33beb41-9adf-42a6-9888-140d58450017 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:21.330456297 +0000 UTC m=+229.446274430 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d33beb41-9adf-42a6-9888-140d58450017-service-ca-bundle") pod "router-default-5b7fc957f7-d6lvs" (UID: "d33beb41-9adf-42a6-9888-140d58450017") : configmap references non-existent config key: service-ca.crt Jun 08 12:13:20.830888 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:20.830706 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:13:20.830888 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:20.830726 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-797ffd8674-tqbhc: secret "image-registry-tls" not found Jun 08 12:13:20.830888 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:20.830773 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-tls podName:31212e59-0c60-4c2c-bb16-c0aa87017897 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:21.330757566 +0000 UTC m=+229.446575701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-tls") pod "image-registry-797ffd8674-tqbhc" (UID: "31212e59-0c60-4c2c-bb16-c0aa87017897") : secret "image-registry-tls" not found Jun 08 12:13:20.831123 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.831100 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31212e59-0c60-4c2c-bb16-c0aa87017897-ca-trust-extracted\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.831997 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.831920 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-certificates\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.833066 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.833029 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31212e59-0c60-4c2c-bb16-c0aa87017897-installation-pull-secrets\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.834401 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.834361 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-default-certificate\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:20.834540 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.834511 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-stats-auth\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:20.836376 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.835199 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31212e59-0c60-4c2c-bb16-c0aa87017897-image-registry-private-configuration\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.844021 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.843945 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74x4m\" (UniqueName: \"kubernetes.io/projected/d33beb41-9adf-42a6-9888-140d58450017-kube-api-access-74x4m\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:20.844290 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.844262 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqk6k\" (UniqueName: \"kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-kube-api-access-vqk6k\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.845312 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.844939 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:20.845312 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.845273 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-bound-sa-token\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:20.884466 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.884398 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-h8ml2" Jun 08 12:13:20.943230 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.943191 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:20.947368 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.945503 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-l2pq7"] Jun 08 12:13:20.951561 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:13:20.950536 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b9681e8_a3af_4356_b6fc_f87994ccf29b.slice/crio-da581371beb6af95c679cae9137c6e19479da70b7cb3931f1be1ae156f4b0659 WatchSource:0}: Error finding container da581371beb6af95c679cae9137c6e19479da70b7cb3931f1be1ae156f4b0659: Status 404 returned error can't find the container with id da581371beb6af95c679cae9137c6e19479da70b7cb3931f1be1ae156f4b0659 Jun 08 12:13:20.966930 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.966778 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-86bvt"] Jun 08 12:13:20.969674 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:13:20.969652 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c6f655c_0584_4430_87ec_ead19aa53dd0.slice/crio-15885e8211947ce6f044768cb3767f1488d8e3f75d4a2b79cacd722f4af4a4ce WatchSource:0}: Error finding container 15885e8211947ce6f044768cb3767f1488d8e3f75d4a2b79cacd722f4af4a4ce: Status 404 returned error can't find the container with id 15885e8211947ce6f044768cb3767f1488d8e3f75d4a2b79cacd722f4af4a4ce Jun 08 12:13:20.985241 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:20.985212 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vzg7c"] Jun 08 12:13:20.988325 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:13:20.988301 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf16c9e4_8b0b_45af_a63d_bb5497a6908d.slice/crio-74595897d5e58e5cca2ecfa1c31ad2e2649455e28a6fd0b5a75669eaaeab1831 WatchSource:0}: Error finding container 74595897d5e58e5cca2ecfa1c31ad2e2649455e28a6fd0b5a75669eaaeab1831: Status 404 returned error can't find the container with id 74595897d5e58e5cca2ecfa1c31ad2e2649455e28a6fd0b5a75669eaaeab1831 Jun 08 12:13:21.004960 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:21.004931 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-qvcwf"] Jun 08 12:13:21.006990 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:21.006959 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vzg7c" event={"ID":"cf16c9e4-8b0b-45af-a63d-bb5497a6908d","Type":"ContainerStarted","Data":"74595897d5e58e5cca2ecfa1c31ad2e2649455e28a6fd0b5a75669eaaeab1831"} Jun 08 12:13:21.007953 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:13:21.007929 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod731f4b21_0de5_4184_aa7d_05eab33ce31e.slice/crio-97e599dfad757c00352aabfc70f95b31b32707d24b154b3b99fbf6b39aec4e04 WatchSource:0}: Error finding container 97e599dfad757c00352aabfc70f95b31b32707d24b154b3b99fbf6b39aec4e04: Status 404 returned error can't find the container with id 97e599dfad757c00352aabfc70f95b31b32707d24b154b3b99fbf6b39aec4e04 Jun 08 12:13:21.008268 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:21.008244 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-l2pq7" event={"ID":"4b9681e8-a3af-4356-b6fc-f87994ccf29b","Type":"ContainerStarted","Data":"da581371beb6af95c679cae9137c6e19479da70b7cb3931f1be1ae156f4b0659"} Jun 08 12:13:21.009692 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:21.009390 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-86bvt" event={"ID":"3c6f655c-0584-4430-87ec-ead19aa53dd0","Type":"ContainerStarted","Data":"15885e8211947ce6f044768cb3767f1488d8e3f75d4a2b79cacd722f4af4a4ce"} Jun 08 12:13:21.030487 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:21.030469 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-h8ml2"] Jun 08 12:13:21.032478 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:13:21.032458 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82196494_14a7_469a_9647_b3c98b0bb4c5.slice/crio-8b61fe8cc65cc9d98319c49b1ee474e53b94ba6b0d9a66cb2c85700f004ecb99 WatchSource:0}: Error finding container 8b61fe8cc65cc9d98319c49b1ee474e53b94ba6b0d9a66cb2c85700f004ecb99: Status 404 returned error can't find the container with id 8b61fe8cc65cc9d98319c49b1ee474e53b94ba6b0d9a66cb2c85700f004ecb99 Jun 08 12:13:21.132798 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:21.132774 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/849e7162-23cb-4135-a99d-fc8cbfd20800-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-fk5fp\" (UID: \"849e7162-23cb-4135-a99d-fc8cbfd20800\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-fk5fp" Jun 08 12:13:21.132933 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:21.132915 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 12:13:21.132981 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:21.132972 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/849e7162-23cb-4135-a99d-fc8cbfd20800-networking-console-plugin-cert podName:849e7162-23cb-4135-a99d-fc8cbfd20800 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:22.132958123 +0000 UTC m=+230.248776240 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/849e7162-23cb-4135-a99d-fc8cbfd20800-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-fk5fp" (UID: "849e7162-23cb-4135-a99d-fc8cbfd20800") : secret "networking-console-plugin-cert" not found Jun 08 12:13:21.233622 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:21.233563 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13f7ee1f-daae-4663-88e0-4be29a8927d8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ww6tn\" (UID: \"13f7ee1f-daae-4663-88e0-4be29a8927d8\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ww6tn" Jun 08 12:13:21.233711 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:21.233677 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 12:13:21.233755 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:21.233722 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13f7ee1f-daae-4663-88e0-4be29a8927d8-cluster-monitoring-operator-tls podName:13f7ee1f-daae-4663-88e0-4be29a8927d8 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:22.233709491 +0000 UTC m=+230.349527610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13f7ee1f-daae-4663-88e0-4be29a8927d8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-ww6tn" (UID: "13f7ee1f-daae-4663-88e0-4be29a8927d8") : secret "cluster-monitoring-operator-tls" not found Jun 08 12:13:21.334082 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:21.334053 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-tls\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:21.334198 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:21.334090 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d33beb41-9adf-42a6-9888-140d58450017-service-ca-bundle\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:21.334198 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:21.334110 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-metrics-certs\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:21.334279 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:21.334208 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:13:21.334279 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:21.334225 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-797ffd8674-tqbhc: secret "image-registry-tls" not found Jun 08 12:13:21.334279 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:21.334224 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d33beb41-9adf-42a6-9888-140d58450017-service-ca-bundle podName:d33beb41-9adf-42a6-9888-140d58450017 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:22.33420875 +0000 UTC m=+230.450026866 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d33beb41-9adf-42a6-9888-140d58450017-service-ca-bundle") pod "router-default-5b7fc957f7-d6lvs" (UID: "d33beb41-9adf-42a6-9888-140d58450017") : configmap references non-existent config key: service-ca.crt Jun 08 12:13:21.334279 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:21.334272 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-tls podName:31212e59-0c60-4c2c-bb16-c0aa87017897 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:22.334260209 +0000 UTC m=+230.450078325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-tls") pod "image-registry-797ffd8674-tqbhc" (UID: "31212e59-0c60-4c2c-bb16-c0aa87017897") : secret "image-registry-tls" not found Jun 08 12:13:21.334428 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:21.334277 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 12:13:21.334428 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:21.334331 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-metrics-certs podName:d33beb41-9adf-42a6-9888-140d58450017 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:22.334316789 +0000 UTC m=+230.450134925 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-metrics-certs") pod "router-default-5b7fc957f7-d6lvs" (UID: "d33beb41-9adf-42a6-9888-140d58450017") : secret "router-metrics-certs-default" not found Jun 08 12:13:22.015560 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:22.015444 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-h8ml2" event={"ID":"82196494-14a7-469a-9647-b3c98b0bb4c5","Type":"ContainerStarted","Data":"8b61fe8cc65cc9d98319c49b1ee474e53b94ba6b0d9a66cb2c85700f004ecb99"} Jun 08 12:13:22.018184 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:22.018150 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" event={"ID":"731f4b21-0de5-4184-aa7d-05eab33ce31e","Type":"ContainerStarted","Data":"97e599dfad757c00352aabfc70f95b31b32707d24b154b3b99fbf6b39aec4e04"} Jun 08 12:13:22.141164 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:22.141123 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/849e7162-23cb-4135-a99d-fc8cbfd20800-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-fk5fp\" (UID: \"849e7162-23cb-4135-a99d-fc8cbfd20800\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-fk5fp" Jun 08 12:13:22.141349 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:22.141332 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 12:13:22.141405 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:22.141398 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/849e7162-23cb-4135-a99d-fc8cbfd20800-networking-console-plugin-cert podName:849e7162-23cb-4135-a99d-fc8cbfd20800 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:24.141379308 +0000 UTC m=+232.257197426 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/849e7162-23cb-4135-a99d-fc8cbfd20800-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-fk5fp" (UID: "849e7162-23cb-4135-a99d-fc8cbfd20800") : secret "networking-console-plugin-cert" not found Jun 08 12:13:22.241790 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:22.241748 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13f7ee1f-daae-4663-88e0-4be29a8927d8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ww6tn\" (UID: \"13f7ee1f-daae-4663-88e0-4be29a8927d8\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ww6tn" Jun 08 12:13:22.241985 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:22.241935 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 12:13:22.242048 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:22.242009 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13f7ee1f-daae-4663-88e0-4be29a8927d8-cluster-monitoring-operator-tls podName:13f7ee1f-daae-4663-88e0-4be29a8927d8 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:24.241990042 +0000 UTC m=+232.357808158 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13f7ee1f-daae-4663-88e0-4be29a8927d8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-ww6tn" (UID: "13f7ee1f-daae-4663-88e0-4be29a8927d8") : secret "cluster-monitoring-operator-tls" not found Jun 08 12:13:22.342909 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:22.342584 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-tls\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:22.342909 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:22.342642 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d33beb41-9adf-42a6-9888-140d58450017-service-ca-bundle\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:22.342909 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:22.342672 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-metrics-certs\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:22.342909 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:22.342735 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:13:22.342909 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:22.342758 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-797ffd8674-tqbhc: secret "image-registry-tls" not found Jun 08 12:13:22.342909 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:22.342795 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 12:13:22.342909 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:22.342836 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-tls podName:31212e59-0c60-4c2c-bb16-c0aa87017897 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:24.342800448 +0000 UTC m=+232.458618570 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-tls") pod "image-registry-797ffd8674-tqbhc" (UID: "31212e59-0c60-4c2c-bb16-c0aa87017897") : secret "image-registry-tls" not found Jun 08 12:13:22.342909 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:22.342863 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-metrics-certs podName:d33beb41-9adf-42a6-9888-140d58450017 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:24.342847315 +0000 UTC m=+232.458665434 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-metrics-certs") pod "router-default-5b7fc957f7-d6lvs" (UID: "d33beb41-9adf-42a6-9888-140d58450017") : secret "router-metrics-certs-default" not found Jun 08 12:13:22.343435 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:22.342929 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d33beb41-9adf-42a6-9888-140d58450017-service-ca-bundle podName:d33beb41-9adf-42a6-9888-140d58450017 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:24.342918562 +0000 UTC m=+232.458736680 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d33beb41-9adf-42a6-9888-140d58450017-service-ca-bundle") pod "router-default-5b7fc957f7-d6lvs" (UID: "d33beb41-9adf-42a6-9888-140d58450017") : configmap references non-existent config key: service-ca.crt Jun 08 12:13:23.022224 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:23.022184 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-h8ml2" event={"ID":"82196494-14a7-469a-9647-b3c98b0bb4c5","Type":"ContainerStarted","Data":"0063c71acdd8dc809873c65878ee30e2b66cb31f94bd3066821a21cb37c32626"} Jun 08 12:13:23.040476 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:23.040420 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-h8ml2" podStartSLOduration=1.6800762059999998 podStartE2EDuration="3.040398862s" totalImagesPullingTime="1.360322656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:13:23.039192149 +0000 UTC m=+231.155010288" watchObservedRunningTime="2026-06-08 12:13:23.040398862 +0000 UTC m=+231.156217003" Jun 08 12:13:23.173662 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:23.173603 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:23.238077 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:23.238031 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:24.159765 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:24.159725 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/849e7162-23cb-4135-a99d-fc8cbfd20800-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-fk5fp\" (UID: \"849e7162-23cb-4135-a99d-fc8cbfd20800\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-fk5fp" Jun 08 12:13:24.160286 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:24.159897 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 12:13:24.160286 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:24.159965 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/849e7162-23cb-4135-a99d-fc8cbfd20800-networking-console-plugin-cert podName:849e7162-23cb-4135-a99d-fc8cbfd20800 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:28.1599487 +0000 UTC m=+236.275766818 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/849e7162-23cb-4135-a99d-fc8cbfd20800-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-fk5fp" (UID: "849e7162-23cb-4135-a99d-fc8cbfd20800") : secret "networking-console-plugin-cert" not found Jun 08 12:13:24.260806 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:24.260763 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13f7ee1f-daae-4663-88e0-4be29a8927d8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ww6tn\" (UID: \"13f7ee1f-daae-4663-88e0-4be29a8927d8\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ww6tn" Jun 08 12:13:24.260990 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:24.260924 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 12:13:24.260990 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:24.260987 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13f7ee1f-daae-4663-88e0-4be29a8927d8-cluster-monitoring-operator-tls podName:13f7ee1f-daae-4663-88e0-4be29a8927d8 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:28.260972244 +0000 UTC m=+236.376790360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13f7ee1f-daae-4663-88e0-4be29a8927d8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-ww6tn" (UID: "13f7ee1f-daae-4663-88e0-4be29a8927d8") : secret "cluster-monitoring-operator-tls" not found Jun 08 12:13:24.361569 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:24.361540 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-tls\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:24.361725 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:24.361580 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d33beb41-9adf-42a6-9888-140d58450017-service-ca-bundle\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:24.361725 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:24.361597 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-metrics-certs\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:24.361725 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:24.361674 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 12:13:24.361725 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:24.361709 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d33beb41-9adf-42a6-9888-140d58450017-service-ca-bundle podName:d33beb41-9adf-42a6-9888-140d58450017 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:28.361689941 +0000 UTC m=+236.477508058 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d33beb41-9adf-42a6-9888-140d58450017-service-ca-bundle") pod "router-default-5b7fc957f7-d6lvs" (UID: "d33beb41-9adf-42a6-9888-140d58450017") : configmap references non-existent config key: service-ca.crt Jun 08 12:13:24.361903 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:24.361732 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-metrics-certs podName:d33beb41-9adf-42a6-9888-140d58450017 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:28.361724001 +0000 UTC m=+236.477542121 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-metrics-certs") pod "router-default-5b7fc957f7-d6lvs" (UID: "d33beb41-9adf-42a6-9888-140d58450017") : secret "router-metrics-certs-default" not found Jun 08 12:13:24.361903 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:24.361744 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:13:24.361903 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:24.361759 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-797ffd8674-tqbhc: secret "image-registry-tls" not found Jun 08 12:13:24.361903 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:24.361793 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-tls podName:31212e59-0c60-4c2c-bb16-c0aa87017897 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:28.361780598 +0000 UTC m=+236.477598717 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-tls") pod "image-registry-797ffd8674-tqbhc" (UID: "31212e59-0c60-4c2c-bb16-c0aa87017897") : secret "image-registry-tls" not found Jun 08 12:13:25.030198 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:25.030153 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-l2pq7" event={"ID":"4b9681e8-a3af-4356-b6fc-f87994ccf29b","Type":"ContainerStarted","Data":"8f39726b949c5fc1bd2c8408dded282044dae7ce1f7ae92f947edc737aa22ecd"} Jun 08 12:13:25.032752 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:25.032717 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-86bvt" event={"ID":"3c6f655c-0584-4430-87ec-ead19aa53dd0","Type":"ContainerStarted","Data":"3cca16001d7d015c791b55409d536fb05e627f6ee45034d94dce7ec6660fdd91"} Jun 08 12:13:25.034826 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:25.034779 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vzg7c" event={"ID":"cf16c9e4-8b0b-45af-a63d-bb5497a6908d","Type":"ContainerStarted","Data":"b1c290e009cd78410cba50b00d1bbdd9e7c4bbdbd2e78c4e116bef2438921fd3"} Jun 08 12:13:25.038886 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:25.038353 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" event={"ID":"731f4b21-0de5-4184-aa7d-05eab33ce31e","Type":"ContainerStarted","Data":"8d39ddc6578c19a1e00ee01b782f43c41b6b9076a45a19d7761e01d4f0824d0e"} Jun 08 12:13:25.038886 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:25.038621 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" Jun 08 12:13:25.039749 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:25.039710 2565 patch_prober.go:28] interesting pod/console-operator-668fdbf85c-qvcwf container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.134.0.12:8443/readyz\": dial tcp 10.134.0.12:8443: connect: connection refused" start-of-body= Jun 08 12:13:25.039845 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:25.039770 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" podUID="731f4b21-0de5-4184-aa7d-05eab33ce31e" containerName="console-operator" probeResult="failure" output="Get \"https://10.134.0.12:8443/readyz\": dial tcp 10.134.0.12:8443: connect: connection refused" Jun 08 12:13:25.049669 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:25.049626 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-l2pq7" podStartSLOduration=1.1010824399999999 podStartE2EDuration="5.049608655s" totalImagesPullingTime="3.948526215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:13:25.048020619 +0000 UTC m=+233.163838757" watchObservedRunningTime="2026-06-08 12:13:25.049608655 +0000 UTC m=+233.165426797" Jun 08 12:13:25.065388 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:25.065341 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" podStartSLOduration=1.222166249 podStartE2EDuration="5.065325511s" totalImagesPullingTime="3.843159262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:13:25.06455549 +0000 UTC m=+233.180373628" watchObservedRunningTime="2026-06-08 12:13:25.065325511 +0000 UTC m=+233.181143650" Jun 08 12:13:25.080670 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:25.080622 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vzg7c" podStartSLOduration=1.214097002 podStartE2EDuration="5.080607572s" totalImagesPullingTime="3.86651057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:13:25.080106435 +0000 UTC m=+233.195924577" watchObservedRunningTime="2026-06-08 12:13:25.080607572 +0000 UTC m=+233.196425711" Jun 08 12:13:25.099959 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:25.099905 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-86bvt" podStartSLOduration=1.21286192 podStartE2EDuration="5.099887681s" totalImagesPullingTime="3.887025761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:13:25.098223074 +0000 UTC m=+233.214041213" watchObservedRunningTime="2026-06-08 12:13:25.099887681 +0000 UTC m=+233.215705821" Jun 08 12:13:25.983930 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:25.983836 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:26.043852 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:26.043808 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/0.log" Jun 08 12:13:26.044023 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:26.043858 2565 generic.go:356] "Generic (PLEG): container finished" podID="731f4b21-0de5-4184-aa7d-05eab33ce31e" containerID="8d39ddc6578c19a1e00ee01b782f43c41b6b9076a45a19d7761e01d4f0824d0e" exitCode=255 Jun 08 12:13:26.044023 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:26.043961 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" event={"ID":"731f4b21-0de5-4184-aa7d-05eab33ce31e","Type":"ContainerDied","Data":"8d39ddc6578c19a1e00ee01b782f43c41b6b9076a45a19d7761e01d4f0824d0e"} Jun 08 12:13:26.044181 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:26.044166 2565 scope.go:117] "RemoveContainer" containerID="8d39ddc6578c19a1e00ee01b782f43c41b6b9076a45a19d7761e01d4f0824d0e" Jun 08 12:13:27.051994 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:27.051965 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/1.log" Jun 08 12:13:27.052415 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:27.052375 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/0.log" Jun 08 12:13:27.052491 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:27.052416 2565 generic.go:356] "Generic (PLEG): container finished" podID="731f4b21-0de5-4184-aa7d-05eab33ce31e" containerID="c2807f3728bf102ddabe6e95813c02b412a0959b4b1e555081d5e73ae10550da" exitCode=255 Jun 08 12:13:27.052491 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:27.052464 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" event={"ID":"731f4b21-0de5-4184-aa7d-05eab33ce31e","Type":"ContainerDied","Data":"c2807f3728bf102ddabe6e95813c02b412a0959b4b1e555081d5e73ae10550da"} Jun 08 12:13:27.052593 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:27.052565 2565 scope.go:117] "RemoveContainer" containerID="8d39ddc6578c19a1e00ee01b782f43c41b6b9076a45a19d7761e01d4f0824d0e" Jun 08 12:13:27.052770 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:27.052751 2565 scope.go:117] "RemoveContainer" containerID="c2807f3728bf102ddabe6e95813c02b412a0959b4b1e555081d5e73ae10550da" Jun 08 12:13:27.052986 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:27.052967 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-qvcwf_openshift-console-operator(731f4b21-0de5-4184-aa7d-05eab33ce31e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" podUID="731f4b21-0de5-4184-aa7d-05eab33ce31e" Jun 08 12:13:27.608929 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:27.608896 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:27.697827 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:27.697791 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8c2bq_aa07a65f-f29b-4938-8167-03e6245a6228/dns-node-resolver/0.log" Jun 08 12:13:28.056237 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:28.056209 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/1.log" Jun 08 12:13:28.056602 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:28.056508 2565 scope.go:117] "RemoveContainer" containerID="c2807f3728bf102ddabe6e95813c02b412a0959b4b1e555081d5e73ae10550da" Jun 08 12:13:28.056668 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:28.056649 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-qvcwf_openshift-console-operator(731f4b21-0de5-4184-aa7d-05eab33ce31e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" podUID="731f4b21-0de5-4184-aa7d-05eab33ce31e" Jun 08 12:13:28.198093 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:28.198058 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/849e7162-23cb-4135-a99d-fc8cbfd20800-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-fk5fp\" (UID: \"849e7162-23cb-4135-a99d-fc8cbfd20800\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-fk5fp" Jun 08 12:13:28.198265 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:28.198192 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 12:13:28.198265 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:28.198251 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/849e7162-23cb-4135-a99d-fc8cbfd20800-networking-console-plugin-cert podName:849e7162-23cb-4135-a99d-fc8cbfd20800 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:36.198236415 +0000 UTC m=+244.314054531 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/849e7162-23cb-4135-a99d-fc8cbfd20800-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-fk5fp" (UID: "849e7162-23cb-4135-a99d-fc8cbfd20800") : secret "networking-console-plugin-cert" not found Jun 08 12:13:28.298932 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:28.298902 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13f7ee1f-daae-4663-88e0-4be29a8927d8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ww6tn\" (UID: \"13f7ee1f-daae-4663-88e0-4be29a8927d8\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ww6tn" Jun 08 12:13:28.299068 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:28.299033 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 12:13:28.299107 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:28.299088 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13f7ee1f-daae-4663-88e0-4be29a8927d8-cluster-monitoring-operator-tls podName:13f7ee1f-daae-4663-88e0-4be29a8927d8 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:36.299074838 +0000 UTC m=+244.414892953 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13f7ee1f-daae-4663-88e0-4be29a8927d8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-ww6tn" (UID: "13f7ee1f-daae-4663-88e0-4be29a8927d8") : secret "cluster-monitoring-operator-tls" not found Jun 08 12:13:28.399328 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:28.399294 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-tls\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:28.399476 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:28.399340 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d33beb41-9adf-42a6-9888-140d58450017-service-ca-bundle\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:28.399476 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:28.399365 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-metrics-certs\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:28.399476 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:28.399442 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:13:28.399476 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:28.399455 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 12:13:28.399476 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:28.399460 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-797ffd8674-tqbhc: secret "image-registry-tls" not found Jun 08 12:13:28.399630 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:28.399490 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d33beb41-9adf-42a6-9888-140d58450017-service-ca-bundle podName:d33beb41-9adf-42a6-9888-140d58450017 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:36.399474415 +0000 UTC m=+244.515292532 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d33beb41-9adf-42a6-9888-140d58450017-service-ca-bundle") pod "router-default-5b7fc957f7-d6lvs" (UID: "d33beb41-9adf-42a6-9888-140d58450017") : configmap references non-existent config key: service-ca.crt Jun 08 12:13:28.399630 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:28.399512 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-metrics-certs podName:d33beb41-9adf-42a6-9888-140d58450017 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:36.39950449 +0000 UTC m=+244.515322605 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-metrics-certs") pod "router-default-5b7fc957f7-d6lvs" (UID: "d33beb41-9adf-42a6-9888-140d58450017") : secret "router-metrics-certs-default" not found Jun 08 12:13:28.399630 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:28.399521 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-tls podName:31212e59-0c60-4c2c-bb16-c0aa87017897 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:36.3995163 +0000 UTC m=+244.515334416 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-tls") pod "image-registry-797ffd8674-tqbhc" (UID: "31212e59-0c60-4c2c-bb16-c0aa87017897") : secret "image-registry-tls" not found Jun 08 12:13:28.557630 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:28.557596 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:28.659971 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:28.659887 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:28.697707 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:28.697686 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6rnhx_5bcb07d4-39cc-41fa-bf34-e7d119414144/node-ca/0.log" Jun 08 12:13:28.852117 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:28.852084 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:28.913589 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:28.913513 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:29.778609 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:29.778572 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:29.899529 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:29.899503 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pn864_caa618ee-b34d-40f6-9615-8e41e2b90036/serve-healthcheck-canary/0.log" Jun 08 12:13:30.802773 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:30.802691 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" Jun 08 12:13:30.803133 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:30.803034 2565 scope.go:117] "RemoveContainer" containerID="c2807f3728bf102ddabe6e95813c02b412a0959b4b1e555081d5e73ae10550da" Jun 08 12:13:30.803190 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:30.803169 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-qvcwf_openshift-console-operator(731f4b21-0de5-4184-aa7d-05eab33ce31e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" podUID="731f4b21-0de5-4184-aa7d-05eab33ce31e" Jun 08 12:13:32.717796 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:32.717761 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:32.883281 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:32.883244 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:33.039133 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:33.039048 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:33.139362 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:33.139326 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:33.240010 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:33.239981 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:33.332897 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:33.332796 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:33.777361 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:33.777332 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:34.371421 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:34.371391 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:34.972053 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:34.972017 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:35.038609 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:35.038571 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" Jun 08 12:13:35.038945 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:35.038932 2565 scope.go:117] "RemoveContainer" containerID="c2807f3728bf102ddabe6e95813c02b412a0959b4b1e555081d5e73ae10550da" Jun 08 12:13:35.039105 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:35.039085 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-qvcwf_openshift-console-operator(731f4b21-0de5-4184-aa7d-05eab33ce31e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" podUID="731f4b21-0de5-4184-aa7d-05eab33ce31e" Jun 08 12:13:35.165901 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:35.165864 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:35.390600 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:35.390569 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:35.577768 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:35.577740 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:36.232242 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:36.232208 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:36.264310 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:36.264280 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/849e7162-23cb-4135-a99d-fc8cbfd20800-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-fk5fp\" (UID: \"849e7162-23cb-4135-a99d-fc8cbfd20800\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-fk5fp" Jun 08 12:13:36.264450 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:36.264421 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 12:13:36.264498 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:36.264479 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/849e7162-23cb-4135-a99d-fc8cbfd20800-networking-console-plugin-cert podName:849e7162-23cb-4135-a99d-fc8cbfd20800 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:52.264464336 +0000 UTC m=+260.380282455 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/849e7162-23cb-4135-a99d-fc8cbfd20800-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-fk5fp" (UID: "849e7162-23cb-4135-a99d-fc8cbfd20800") : secret "networking-console-plugin-cert" not found Jun 08 12:13:36.365337 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:36.365303 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13f7ee1f-daae-4663-88e0-4be29a8927d8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ww6tn\" (UID: \"13f7ee1f-daae-4663-88e0-4be29a8927d8\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ww6tn" Jun 08 12:13:36.365514 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:36.365473 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 12:13:36.365580 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:36.365546 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13f7ee1f-daae-4663-88e0-4be29a8927d8-cluster-monitoring-operator-tls podName:13f7ee1f-daae-4663-88e0-4be29a8927d8 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:52.365525582 +0000 UTC m=+260.481343718 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/13f7ee1f-daae-4663-88e0-4be29a8927d8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-ww6tn" (UID: "13f7ee1f-daae-4663-88e0-4be29a8927d8") : secret "cluster-monitoring-operator-tls" not found Jun 08 12:13:36.412972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:36.412941 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:36.466026 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:36.465996 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-tls\") pod \"image-registry-797ffd8674-tqbhc\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:36.466137 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:36.466033 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d33beb41-9adf-42a6-9888-140d58450017-service-ca-bundle\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:36.466137 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:36.466051 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-metrics-certs\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:36.466216 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:36.466142 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 12:13:36.466216 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:36.466145 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 12:13:36.466216 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:36.466155 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d33beb41-9adf-42a6-9888-140d58450017-service-ca-bundle podName:d33beb41-9adf-42a6-9888-140d58450017 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:52.466139922 +0000 UTC m=+260.581958038 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d33beb41-9adf-42a6-9888-140d58450017-service-ca-bundle") pod "router-default-5b7fc957f7-d6lvs" (UID: "d33beb41-9adf-42a6-9888-140d58450017") : configmap references non-existent config key: service-ca.crt Jun 08 12:13:36.466216 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:36.466162 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-797ffd8674-tqbhc: secret "image-registry-tls" not found Jun 08 12:13:36.466216 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:36.466179 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-metrics-certs podName:d33beb41-9adf-42a6-9888-140d58450017 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:52.46616858 +0000 UTC m=+260.581986696 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-metrics-certs") pod "router-default-5b7fc957f7-d6lvs" (UID: "d33beb41-9adf-42a6-9888-140d58450017") : secret "router-metrics-certs-default" not found Jun 08 12:13:36.466393 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:36.466219 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-tls podName:31212e59-0c60-4c2c-bb16-c0aa87017897 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:52.466195163 +0000 UTC m=+260.582013279 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-tls") pod "image-registry-797ffd8674-tqbhc" (UID: "31212e59-0c60-4c2c-bb16-c0aa87017897") : secret "image-registry-tls" not found Jun 08 12:13:36.771621 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:36.771579 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:36.836685 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:36.836653 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:37.141001 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:37.140969 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:37.245601 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:37.245571 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:37.371703 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:37.371676 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:37.973437 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:37.973390 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:38.332240 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:38.332158 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:38.432682 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:38.432653 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:38.788825 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:38.788793 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:39.018013 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:39.017980 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:39.170200 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:39.170162 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:39.569023 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:39.568942 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:39.766776 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:39.766744 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:40.368994 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:40.368965 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:40.570189 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:40.570153 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:40.990754 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:40.990715 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:41.768263 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:41.768219 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:42.171120 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:42.171086 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:42.376218 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:42.376187 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:42.572808 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:42.572724 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:42.777679 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:42.777632 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:43.376091 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:43.376058 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:43.574256 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:43.574224 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:44.128678 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:44.128643 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs\") pod \"network-metrics-daemon-g8qk7\" (UID: \"723a030e-60ee-457c-ae18-aac839fd2a5a\") " pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:13:44.130955 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:44.130933 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/723a030e-60ee-457c-ae18-aac839fd2a5a-metrics-certs\") pod \"network-metrics-daemon-g8qk7\" (UID: \"723a030e-60ee-457c-ae18-aac839fd2a5a\") " pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:13:44.244767 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:44.244735 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h8l7g\"" Jun 08 12:13:44.253063 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:44.253045 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8qk7" Jun 08 12:13:44.375545 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:44.375513 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g8qk7"] Jun 08 12:13:44.378165 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:13:44.378140 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod723a030e_60ee_457c_ae18_aac839fd2a5a.slice/crio-8ae0e25302138ef7b170ca6a97e184e8f802e9ce743a365b79e5b882d49298e2 WatchSource:0}: Error finding container 8ae0e25302138ef7b170ca6a97e184e8f802e9ce743a365b79e5b882d49298e2: Status 404 returned error can't find the container with id 8ae0e25302138ef7b170ca6a97e184e8f802e9ce743a365b79e5b882d49298e2 Jun 08 12:13:45.108052 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:45.108015 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g8qk7" event={"ID":"723a030e-60ee-457c-ae18-aac839fd2a5a","Type":"ContainerStarted","Data":"8ae0e25302138ef7b170ca6a97e184e8f802e9ce743a365b79e5b882d49298e2"} Jun 08 12:13:45.167257 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:45.167222 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:45.268474 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:45.268425 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:46.112258 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:46.112220 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g8qk7" event={"ID":"723a030e-60ee-457c-ae18-aac839fd2a5a","Type":"ContainerStarted","Data":"ffba2a15a7e1dc43a8f187802ba7cd85e071b671f8bbf65ea7c5780bc9920d4f"} Jun 08 12:13:46.112430 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:46.112286 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g8qk7" event={"ID":"723a030e-60ee-457c-ae18-aac839fd2a5a","Type":"ContainerStarted","Data":"25a4a0e84ba9171b8bb2f4c394691ffdeb2e0171c7f6ce5f8b204aca2bf17813"} Jun 08 12:13:46.128890 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:46.128843 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g8qk7" podStartSLOduration=253.322577386 podStartE2EDuration="4m14.128804891s" totalImagesPullingTime="806.227505ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:09:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:13:46.128640942 +0000 UTC m=+254.244459082" watchObservedRunningTime="2026-06-08 12:13:46.128804891 +0000 UTC m=+254.244623029" Jun 08 12:13:48.722462 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.722429 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-446r8"] Jun 08 12:13:48.751921 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.751893 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-797ffd8674-tqbhc"] Jun 08 12:13:48.752082 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.751982 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-446r8"] Jun 08 12:13:48.752132 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.752082 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-446r8" Jun 08 12:13:48.752205 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:48.752180 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" podUID="31212e59-0c60-4c2c-bb16-c0aa87017897" Jun 08 12:13:48.754525 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.754503 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 12:13:48.754632 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.754504 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kznpq\"" Jun 08 12:13:48.754632 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.754545 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 12:13:48.793946 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.793915 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:48.863702 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.863677 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/574bd504-23e6-470e-9f16-f001e3beeb34-crio-socket\") pod \"insights-runtime-extractor-446r8\" (UID: \"574bd504-23e6-470e-9f16-f001e3beeb34\") " pod="openshift-insights/insights-runtime-extractor-446r8" Jun 08 12:13:48.863801 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.863711 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/574bd504-23e6-470e-9f16-f001e3beeb34-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-446r8\" (UID: \"574bd504-23e6-470e-9f16-f001e3beeb34\") " pod="openshift-insights/insights-runtime-extractor-446r8" Jun 08 12:13:48.863801 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.863782 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/574bd504-23e6-470e-9f16-f001e3beeb34-data-volume\") pod \"insights-runtime-extractor-446r8\" (UID: \"574bd504-23e6-470e-9f16-f001e3beeb34\") " pod="openshift-insights/insights-runtime-extractor-446r8" Jun 08 12:13:48.863910 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.863802 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8222\" (UniqueName: \"kubernetes.io/projected/574bd504-23e6-470e-9f16-f001e3beeb34-kube-api-access-n8222\") pod \"insights-runtime-extractor-446r8\" (UID: \"574bd504-23e6-470e-9f16-f001e3beeb34\") " pod="openshift-insights/insights-runtime-extractor-446r8" Jun 08 12:13:48.863910 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.863867 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/574bd504-23e6-470e-9f16-f001e3beeb34-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-446r8\" (UID: \"574bd504-23e6-470e-9f16-f001e3beeb34\") " pod="openshift-insights/insights-runtime-extractor-446r8" Jun 08 12:13:48.893503 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.893472 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:48.964974 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.964950 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/574bd504-23e6-470e-9f16-f001e3beeb34-data-volume\") pod \"insights-runtime-extractor-446r8\" (UID: \"574bd504-23e6-470e-9f16-f001e3beeb34\") " pod="openshift-insights/insights-runtime-extractor-446r8" Jun 08 12:13:48.965081 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.964977 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8222\" (UniqueName: \"kubernetes.io/projected/574bd504-23e6-470e-9f16-f001e3beeb34-kube-api-access-n8222\") pod \"insights-runtime-extractor-446r8\" (UID: \"574bd504-23e6-470e-9f16-f001e3beeb34\") " pod="openshift-insights/insights-runtime-extractor-446r8" Jun 08 12:13:48.965081 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.965003 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/574bd504-23e6-470e-9f16-f001e3beeb34-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-446r8\" (UID: \"574bd504-23e6-470e-9f16-f001e3beeb34\") " pod="openshift-insights/insights-runtime-extractor-446r8" Jun 08 12:13:48.965219 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.965202 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/574bd504-23e6-470e-9f16-f001e3beeb34-crio-socket\") pod \"insights-runtime-extractor-446r8\" (UID: \"574bd504-23e6-470e-9f16-f001e3beeb34\") " pod="openshift-insights/insights-runtime-extractor-446r8" Jun 08 12:13:48.965275 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.965232 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/574bd504-23e6-470e-9f16-f001e3beeb34-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-446r8\" (UID: \"574bd504-23e6-470e-9f16-f001e3beeb34\") " pod="openshift-insights/insights-runtime-extractor-446r8" Jun 08 12:13:48.965323 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.965292 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/574bd504-23e6-470e-9f16-f001e3beeb34-data-volume\") pod \"insights-runtime-extractor-446r8\" (UID: \"574bd504-23e6-470e-9f16-f001e3beeb34\") " pod="openshift-insights/insights-runtime-extractor-446r8" Jun 08 12:13:48.965364 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.965332 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/574bd504-23e6-470e-9f16-f001e3beeb34-crio-socket\") pod \"insights-runtime-extractor-446r8\" (UID: \"574bd504-23e6-470e-9f16-f001e3beeb34\") " pod="openshift-insights/insights-runtime-extractor-446r8" Jun 08 12:13:48.965705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.965689 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/574bd504-23e6-470e-9f16-f001e3beeb34-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-446r8\" (UID: \"574bd504-23e6-470e-9f16-f001e3beeb34\") " pod="openshift-insights/insights-runtime-extractor-446r8" Jun 08 12:13:48.967403 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.967386 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/574bd504-23e6-470e-9f16-f001e3beeb34-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-446r8\" (UID: \"574bd504-23e6-470e-9f16-f001e3beeb34\") " pod="openshift-insights/insights-runtime-extractor-446r8" Jun 08 12:13:48.974907 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:48.974858 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8222\" (UniqueName: \"kubernetes.io/projected/574bd504-23e6-470e-9f16-f001e3beeb34-kube-api-access-n8222\") pod \"insights-runtime-extractor-446r8\" (UID: \"574bd504-23e6-470e-9f16-f001e3beeb34\") " pod="openshift-insights/insights-runtime-extractor-446r8" Jun 08 12:13:49.061339 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.061322 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-446r8" Jun 08 12:13:49.123059 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.123029 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:49.149719 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.149682 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:49.210078 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.210044 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-446r8"] Jun 08 12:13:49.212897 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:13:49.212874 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod574bd504_23e6_470e_9f16_f001e3beeb34.slice/crio-0453bcb7f7c48c21a1c1c6de8627facb5bd450653d321321b0f5647675492177 WatchSource:0}: Error finding container 0453bcb7f7c48c21a1c1c6de8627facb5bd450653d321321b0f5647675492177: Status 404 returned error can't find the container with id 0453bcb7f7c48c21a1c1c6de8627facb5bd450653d321321b0f5647675492177 Jun 08 12:13:49.267047 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.267029 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-certificates\") pod \"31212e59-0c60-4c2c-bb16-c0aa87017897\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " Jun 08 12:13:49.267138 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.267079 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31212e59-0c60-4c2c-bb16-c0aa87017897-installation-pull-secrets\") pod \"31212e59-0c60-4c2c-bb16-c0aa87017897\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " Jun 08 12:13:49.267138 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.267104 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31212e59-0c60-4c2c-bb16-c0aa87017897-ca-trust-extracted\") pod \"31212e59-0c60-4c2c-bb16-c0aa87017897\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " Jun 08 12:13:49.267138 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.267121 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31212e59-0c60-4c2c-bb16-c0aa87017897-image-registry-private-configuration\") pod \"31212e59-0c60-4c2c-bb16-c0aa87017897\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " Jun 08 12:13:49.267293 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.267146 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqk6k\" (UniqueName: \"kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-kube-api-access-vqk6k\") pod \"31212e59-0c60-4c2c-bb16-c0aa87017897\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " Jun 08 12:13:49.267293 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.267187 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-bound-sa-token\") pod \"31212e59-0c60-4c2c-bb16-c0aa87017897\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " Jun 08 12:13:49.267293 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.267212 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31212e59-0c60-4c2c-bb16-c0aa87017897-trusted-ca\") pod \"31212e59-0c60-4c2c-bb16-c0aa87017897\" (UID: \"31212e59-0c60-4c2c-bb16-c0aa87017897\") " Jun 08 12:13:49.267454 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.267389 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "31212e59-0c60-4c2c-bb16-c0aa87017897" (UID: "31212e59-0c60-4c2c-bb16-c0aa87017897"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:13:49.267515 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.267484 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-certificates\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:13:49.267648 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.267622 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31212e59-0c60-4c2c-bb16-c0aa87017897-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "31212e59-0c60-4c2c-bb16-c0aa87017897" (UID: "31212e59-0c60-4c2c-bb16-c0aa87017897"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:13:49.268015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.267802 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31212e59-0c60-4c2c-bb16-c0aa87017897-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "31212e59-0c60-4c2c-bb16-c0aa87017897" (UID: "31212e59-0c60-4c2c-bb16-c0aa87017897"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:13:49.269371 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.269344 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31212e59-0c60-4c2c-bb16-c0aa87017897-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "31212e59-0c60-4c2c-bb16-c0aa87017897" (UID: "31212e59-0c60-4c2c-bb16-c0aa87017897"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:13:49.269371 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.269354 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-kube-api-access-vqk6k" (OuterVolumeSpecName: "kube-api-access-vqk6k") pod "31212e59-0c60-4c2c-bb16-c0aa87017897" (UID: "31212e59-0c60-4c2c-bb16-c0aa87017897"). InnerVolumeSpecName "kube-api-access-vqk6k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:13:49.269482 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.269369 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "31212e59-0c60-4c2c-bb16-c0aa87017897" (UID: "31212e59-0c60-4c2c-bb16-c0aa87017897"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:13:49.269804 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.269783 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31212e59-0c60-4c2c-bb16-c0aa87017897-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "31212e59-0c60-4c2c-bb16-c0aa87017897" (UID: "31212e59-0c60-4c2c-bb16-c0aa87017897"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:13:49.341619 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.341599 2565 scope.go:117] "RemoveContainer" containerID="c2807f3728bf102ddabe6e95813c02b412a0959b4b1e555081d5e73ae10550da" Jun 08 12:13:49.368539 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.368518 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-bound-sa-token\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:13:49.368639 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.368541 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31212e59-0c60-4c2c-bb16-c0aa87017897-trusted-ca\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:13:49.368639 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.368555 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31212e59-0c60-4c2c-bb16-c0aa87017897-installation-pull-secrets\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:13:49.368639 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.368568 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31212e59-0c60-4c2c-bb16-c0aa87017897-ca-trust-extracted\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:13:49.368639 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.368582 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31212e59-0c60-4c2c-bb16-c0aa87017897-image-registry-private-configuration\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:13:49.368639 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:49.368596 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqk6k\" (UniqueName: \"kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-kube-api-access-vqk6k\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:13:50.128336 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:50.128305 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-446r8" event={"ID":"574bd504-23e6-470e-9f16-f001e3beeb34","Type":"ContainerStarted","Data":"4b777aa829ecaac3ed05aebdbc08dbc5622cde96c7c9cfb1de27a05378bef2b4"} Jun 08 12:13:50.128937 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:50.128365 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-446r8" event={"ID":"574bd504-23e6-470e-9f16-f001e3beeb34","Type":"ContainerStarted","Data":"a343f1e127e65d24e5470d5e5c7c5648cbca19d988417ab47afe752f524ce545"} Jun 08 12:13:50.128937 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:50.128396 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-446r8" event={"ID":"574bd504-23e6-470e-9f16-f001e3beeb34","Type":"ContainerStarted","Data":"0453bcb7f7c48c21a1c1c6de8627facb5bd450653d321321b0f5647675492177"} Jun 08 12:13:50.129768 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:50.129746 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/2.log" Jun 08 12:13:50.130142 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:50.130125 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/1.log" Jun 08 12:13:50.130225 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:50.130158 2565 generic.go:356] "Generic (PLEG): container finished" podID="731f4b21-0de5-4184-aa7d-05eab33ce31e" containerID="da79ba313bb8862ee235d514aa2a3530f0d31001c7ccbae39aca929454291a7d" exitCode=255 Jun 08 12:13:50.130286 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:50.130226 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-797ffd8674-tqbhc" Jun 08 12:13:50.130286 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:50.130230 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" event={"ID":"731f4b21-0de5-4184-aa7d-05eab33ce31e","Type":"ContainerDied","Data":"da79ba313bb8862ee235d514aa2a3530f0d31001c7ccbae39aca929454291a7d"} Jun 08 12:13:50.130404 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:50.130290 2565 scope.go:117] "RemoveContainer" containerID="c2807f3728bf102ddabe6e95813c02b412a0959b4b1e555081d5e73ae10550da" Jun 08 12:13:50.130861 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:50.130607 2565 scope.go:117] "RemoveContainer" containerID="da79ba313bb8862ee235d514aa2a3530f0d31001c7ccbae39aca929454291a7d" Jun 08 12:13:50.130861 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:50.130799 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-qvcwf_openshift-console-operator(731f4b21-0de5-4184-aa7d-05eab33ce31e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" podUID="731f4b21-0de5-4184-aa7d-05eab33ce31e" Jun 08 12:13:50.184863 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:50.184841 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-797ffd8674-tqbhc"] Jun 08 12:13:50.188284 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:50.188263 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-797ffd8674-tqbhc"] Jun 08 12:13:50.275326 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:50.275249 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31212e59-0c60-4c2c-bb16-c0aa87017897-registry-tls\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:13:50.345011 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:50.344987 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31212e59-0c60-4c2c-bb16-c0aa87017897" path="/var/lib/kubelet/pods/31212e59-0c60-4c2c-bb16-c0aa87017897/volumes" Jun 08 12:13:50.802962 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:50.802929 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" Jun 08 12:13:51.134731 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:51.134709 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/2.log" Jun 08 12:13:51.135096 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:51.135009 2565 scope.go:117] "RemoveContainer" containerID="da79ba313bb8862ee235d514aa2a3530f0d31001c7ccbae39aca929454291a7d" Jun 08 12:13:51.135155 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:51.135136 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-qvcwf_openshift-console-operator(731f4b21-0de5-4184-aa7d-05eab33ce31e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" podUID="731f4b21-0de5-4184-aa7d-05eab33ce31e" Jun 08 12:13:52.290986 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:52.290947 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/849e7162-23cb-4135-a99d-fc8cbfd20800-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-fk5fp\" (UID: \"849e7162-23cb-4135-a99d-fc8cbfd20800\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-fk5fp" Jun 08 12:13:52.293591 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:52.293564 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/849e7162-23cb-4135-a99d-fc8cbfd20800-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-fk5fp\" (UID: \"849e7162-23cb-4135-a99d-fc8cbfd20800\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-fk5fp" Jun 08 12:13:52.309111 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:52.309089 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vmmdc\"" Jun 08 12:13:52.317282 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:52.317264 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-fk5fp" Jun 08 12:13:52.391351 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:52.391312 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13f7ee1f-daae-4663-88e0-4be29a8927d8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ww6tn\" (UID: \"13f7ee1f-daae-4663-88e0-4be29a8927d8\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ww6tn" Jun 08 12:13:52.394060 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:52.394035 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/13f7ee1f-daae-4663-88e0-4be29a8927d8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-ww6tn\" (UID: \"13f7ee1f-daae-4663-88e0-4be29a8927d8\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ww6tn" Jun 08 12:13:52.492659 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:52.492613 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d33beb41-9adf-42a6-9888-140d58450017-service-ca-bundle\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:52.492659 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:52.492659 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-metrics-certs\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:52.493364 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:52.493337 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d33beb41-9adf-42a6-9888-140d58450017-service-ca-bundle\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:52.495322 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:52.495297 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d33beb41-9adf-42a6-9888-140d58450017-metrics-certs\") pod \"router-default-5b7fc957f7-d6lvs\" (UID: \"d33beb41-9adf-42a6-9888-140d58450017\") " pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:52.681632 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:52.681594 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gb7p7\"" Jun 08 12:13:52.688881 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:52.688857 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ww6tn" Jun 08 12:13:52.777681 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:52.777654 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-x9mgc\"" Jun 08 12:13:52.786064 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:52.785118 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:52.858150 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:52.856248 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ww6tn"] Jun 08 12:13:52.884363 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:52.883766 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-fk5fp"] Jun 08 12:13:52.890869 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:13:52.890804 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod849e7162_23cb_4135_a99d_fc8cbfd20800.slice/crio-d8166796a0e774d8b77b09d01eb2b5130de0c262aaf4e76ee910327dd44d793b WatchSource:0}: Error finding container d8166796a0e774d8b77b09d01eb2b5130de0c262aaf4e76ee910327dd44d793b: Status 404 returned error can't find the container with id d8166796a0e774d8b77b09d01eb2b5130de0c262aaf4e76ee910327dd44d793b Jun 08 12:13:52.946048 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:52.946028 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b7fc957f7-d6lvs"] Jun 08 12:13:52.948247 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:13:52.948221 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd33beb41_9adf_42a6_9888_140d58450017.slice/crio-6ac1b33f29695b2bb807ff284228df4ba90d5ea9e3e87d202f58b6a37fd29ce0 WatchSource:0}: Error finding container 6ac1b33f29695b2bb807ff284228df4ba90d5ea9e3e87d202f58b6a37fd29ce0: Status 404 returned error can't find the container with id 6ac1b33f29695b2bb807ff284228df4ba90d5ea9e3e87d202f58b6a37fd29ce0 Jun 08 12:13:53.142974 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:53.142943 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ww6tn" event={"ID":"13f7ee1f-daae-4663-88e0-4be29a8927d8","Type":"ContainerStarted","Data":"ed5797e6d38ccb50c250db728c7e0632006e7d4c7871c9169d02e9c74aeeea22"} Jun 08 12:13:53.144919 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:53.144892 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-446r8" event={"ID":"574bd504-23e6-470e-9f16-f001e3beeb34","Type":"ContainerStarted","Data":"4abc7cb049b67a2dd03dadde55c740e378480e52d581a68964fef078f70cf125"} Jun 08 12:13:53.146388 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:53.146368 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" event={"ID":"d33beb41-9adf-42a6-9888-140d58450017","Type":"ContainerStarted","Data":"c684bd55acee0557bcb158a78db398e677c4ba10af46301cfdeb4284bcb17502"} Jun 08 12:13:53.146488 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:53.146409 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" event={"ID":"d33beb41-9adf-42a6-9888-140d58450017","Type":"ContainerStarted","Data":"6ac1b33f29695b2bb807ff284228df4ba90d5ea9e3e87d202f58b6a37fd29ce0"} Jun 08 12:13:53.149615 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:53.149580 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-fk5fp" event={"ID":"849e7162-23cb-4135-a99d-fc8cbfd20800","Type":"ContainerStarted","Data":"d8166796a0e774d8b77b09d01eb2b5130de0c262aaf4e76ee910327dd44d793b"} Jun 08 12:13:53.167195 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:53.167087 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-446r8" podStartSLOduration=1.783296977 podStartE2EDuration="5.167067057s" totalImagesPullingTime="3.38377008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:13:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:13:53.165480798 +0000 UTC m=+261.281298937" watchObservedRunningTime="2026-06-08 12:13:53.167067057 +0000 UTC m=+261.282885198" Jun 08 12:13:53.185188 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:53.185147 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" podStartSLOduration=33.185132844 podStartE2EDuration="33.185132844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:13:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:13:53.184410921 +0000 UTC m=+261.300229059" watchObservedRunningTime="2026-06-08 12:13:53.185132844 +0000 UTC m=+261.300950981" Jun 08 12:13:53.786540 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:53.786507 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:53.789297 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:53.789274 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:54.153750 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:54.153722 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:54.155217 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:54.155195 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5b7fc957f7-d6lvs" Jun 08 12:13:55.038935 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:55.038891 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" Jun 08 12:13:55.039380 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:55.039322 2565 scope.go:117] "RemoveContainer" containerID="da79ba313bb8862ee235d514aa2a3530f0d31001c7ccbae39aca929454291a7d" Jun 08 12:13:55.039536 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:55.039513 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-qvcwf_openshift-console-operator(731f4b21-0de5-4184-aa7d-05eab33ce31e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" podUID="731f4b21-0de5-4184-aa7d-05eab33ce31e" Jun 08 12:13:55.158039 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:55.158008 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-fk5fp" event={"ID":"849e7162-23cb-4135-a99d-fc8cbfd20800","Type":"ContainerStarted","Data":"b63463d4a2751fc1b2455b89eaf5581dcc8a59c53256f69e1607730b4f9ddaf9"} Jun 08 12:13:55.174956 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:55.174915 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-fk5fp" podStartSLOduration=33.814414645 podStartE2EDuration="35.174895086s" totalImagesPullingTime="1.360480441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:13:55.173797582 +0000 UTC m=+263.289615722" watchObservedRunningTime="2026-06-08 12:13:55.174895086 +0000 UTC m=+263.290713232" Jun 08 12:13:55.294645 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:55.294542 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:55.362775 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:55.362737 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:55.506018 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:55.505976 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:55.655141 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:55.655112 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:55.672928 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:55.672895 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-7jfkl"] Jun 08 12:13:55.676015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:55.675999 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-7jfkl" Jun 08 12:13:55.678605 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:55.678587 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 08 12:13:55.678716 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:55.678700 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-66sj2\"" Jun 08 12:13:55.687391 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:55.687371 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-7jfkl"] Jun 08 12:13:55.818955 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:55.818928 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/054972c3-2e21-48ab-9b23-962398e4364b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-7jfkl\" (UID: \"054972c3-2e21-48ab-9b23-962398e4364b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-7jfkl" Jun 08 12:13:55.861581 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:55.861548 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:55.919529 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:55.919463 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/054972c3-2e21-48ab-9b23-962398e4364b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-7jfkl\" (UID: \"054972c3-2e21-48ab-9b23-962398e4364b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-7jfkl" Jun 08 12:13:55.921969 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:55.921943 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/054972c3-2e21-48ab-9b23-962398e4364b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-7jfkl\" (UID: \"054972c3-2e21-48ab-9b23-962398e4364b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-7jfkl" Jun 08 12:13:55.984916 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:55.984892 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-7jfkl" Jun 08 12:13:56.109478 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:56.109446 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-7jfkl"] Jun 08 12:13:56.112216 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:13:56.112188 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod054972c3_2e21_48ab_9b23_962398e4364b.slice/crio-15bbf8e94d62ee9af2fd33c7f4be5055ce734460081f501a698d87ccf887ffec WatchSource:0}: Error finding container 15bbf8e94d62ee9af2fd33c7f4be5055ce734460081f501a698d87ccf887ffec: Status 404 returned error can't find the container with id 15bbf8e94d62ee9af2fd33c7f4be5055ce734460081f501a698d87ccf887ffec Jun 08 12:13:56.162111 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:56.162086 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-7jfkl" event={"ID":"054972c3-2e21-48ab-9b23-962398e4364b","Type":"ContainerStarted","Data":"15bbf8e94d62ee9af2fd33c7f4be5055ce734460081f501a698d87ccf887ffec"} Jun 08 12:13:56.163436 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:56.163408 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ww6tn" event={"ID":"13f7ee1f-daae-4663-88e0-4be29a8927d8","Type":"ContainerStarted","Data":"7d8eac4d63453af1b23ab6c5568014e27d72d955662f38e214f2427e338b9955"} Jun 08 12:13:56.181622 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:56.181559 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-ww6tn" podStartSLOduration=33.961709741 podStartE2EDuration="36.181545943s" totalImagesPullingTime="2.219836202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:13:56.180363888 +0000 UTC m=+264.296182039" watchObservedRunningTime="2026-06-08 12:13:56.181545943 +0000 UTC m=+264.297364080" Jun 08 12:13:58.171668 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.171632 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-7jfkl" event={"ID":"054972c3-2e21-48ab-9b23-962398e4364b","Type":"ContainerStarted","Data":"de0181778c4fc1124d0654096810e07b86fdcfc6acc149d1488846f930c39a28"} Jun 08 12:13:58.172100 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.171808 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-7jfkl" Jun 08 12:13:58.176178 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.176160 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-7jfkl" Jun 08 12:13:58.190027 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.189985 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-7jfkl" podStartSLOduration=2.025577038 podStartE2EDuration="3.189972629s" totalImagesPullingTime="1.164395591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:13:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:13:58.188879038 +0000 UTC m=+266.304697176" watchObservedRunningTime="2026-06-08 12:13:58.189972629 +0000 UTC m=+266.305791135" Jun 08 12:13:58.695414 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.695380 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:58.731372 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.731348 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-6wr2n"] Jun 08 12:13:58.734548 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.734533 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-6wr2n" Jun 08 12:13:58.737001 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.736980 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 08 12:13:58.737895 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.737876 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 08 12:13:58.737961 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.737901 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 12:13:58.737961 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.737923 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-trdpv\"" Jun 08 12:13:58.744192 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.744174 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ee41dd7-f05b-4f35-ab3b-bea879d64993-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-6wr2n\" (UID: \"8ee41dd7-f05b-4f35-ab3b-bea879d64993\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6wr2n" Jun 08 12:13:58.744288 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.744208 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ee41dd7-f05b-4f35-ab3b-bea879d64993-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-6wr2n\" (UID: \"8ee41dd7-f05b-4f35-ab3b-bea879d64993\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6wr2n" Jun 08 12:13:58.744288 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.744247 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ee41dd7-f05b-4f35-ab3b-bea879d64993-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-6wr2n\" (UID: \"8ee41dd7-f05b-4f35-ab3b-bea879d64993\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6wr2n" Jun 08 12:13:58.744383 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.744286 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55zfr\" (UniqueName: \"kubernetes.io/projected/8ee41dd7-f05b-4f35-ab3b-bea879d64993-kube-api-access-55zfr\") pod \"prometheus-operator-7f7d445d84-6wr2n\" (UID: \"8ee41dd7-f05b-4f35-ab3b-bea879d64993\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6wr2n" Jun 08 12:13:58.745431 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.745405 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-6wr2n"] Jun 08 12:13:58.763405 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.763379 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:58.845274 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.845252 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55zfr\" (UniqueName: \"kubernetes.io/projected/8ee41dd7-f05b-4f35-ab3b-bea879d64993-kube-api-access-55zfr\") pod \"prometheus-operator-7f7d445d84-6wr2n\" (UID: \"8ee41dd7-f05b-4f35-ab3b-bea879d64993\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6wr2n" Jun 08 12:13:58.845377 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.845300 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ee41dd7-f05b-4f35-ab3b-bea879d64993-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-6wr2n\" (UID: \"8ee41dd7-f05b-4f35-ab3b-bea879d64993\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6wr2n" Jun 08 12:13:58.845377 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.845324 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ee41dd7-f05b-4f35-ab3b-bea879d64993-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-6wr2n\" (UID: \"8ee41dd7-f05b-4f35-ab3b-bea879d64993\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6wr2n" Jun 08 12:13:58.845377 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.845348 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ee41dd7-f05b-4f35-ab3b-bea879d64993-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-6wr2n\" (UID: \"8ee41dd7-f05b-4f35-ab3b-bea879d64993\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6wr2n" Jun 08 12:13:58.845525 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:58.845482 2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 08 12:13:58.845577 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:13:58.845554 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee41dd7-f05b-4f35-ab3b-bea879d64993-prometheus-operator-tls podName:8ee41dd7-f05b-4f35-ab3b-bea879d64993 nodeName:}" failed. No retries permitted until 2026-06-08 12:13:59.345534617 +0000 UTC m=+267.461352752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8ee41dd7-f05b-4f35-ab3b-bea879d64993-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-6wr2n" (UID: "8ee41dd7-f05b-4f35-ab3b-bea879d64993") : secret "prometheus-operator-tls" not found Jun 08 12:13:58.845979 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.845962 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ee41dd7-f05b-4f35-ab3b-bea879d64993-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-6wr2n\" (UID: \"8ee41dd7-f05b-4f35-ab3b-bea879d64993\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6wr2n" Jun 08 12:13:58.847717 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.847700 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ee41dd7-f05b-4f35-ab3b-bea879d64993-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-6wr2n\" (UID: \"8ee41dd7-f05b-4f35-ab3b-bea879d64993\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6wr2n" Jun 08 12:13:58.855829 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:58.855793 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55zfr\" (UniqueName: \"kubernetes.io/projected/8ee41dd7-f05b-4f35-ab3b-bea879d64993-kube-api-access-55zfr\") pod \"prometheus-operator-7f7d445d84-6wr2n\" (UID: \"8ee41dd7-f05b-4f35-ab3b-bea879d64993\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6wr2n" Jun 08 12:13:59.239446 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:59.239413 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:13:59.348978 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:59.348949 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ee41dd7-f05b-4f35-ab3b-bea879d64993-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-6wr2n\" (UID: \"8ee41dd7-f05b-4f35-ab3b-bea879d64993\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6wr2n" Jun 08 12:13:59.351385 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:59.351366 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8ee41dd7-f05b-4f35-ab3b-bea879d64993-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-6wr2n\" (UID: \"8ee41dd7-f05b-4f35-ab3b-bea879d64993\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-6wr2n" Jun 08 12:13:59.643423 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:59.643386 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-6wr2n" Jun 08 12:13:59.769871 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:13:59.769842 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-6wr2n"] Jun 08 12:13:59.772409 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:13:59.772388 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee41dd7_f05b_4f35_ab3b_bea879d64993.slice/crio-036e1de186e35ba87229cf7447c28c43f4c57d00c41df9cd1d86330d73361ed7 WatchSource:0}: Error finding container 036e1de186e35ba87229cf7447c28c43f4c57d00c41df9cd1d86330d73361ed7: Status 404 returned error can't find the container with id 036e1de186e35ba87229cf7447c28c43f4c57d00c41df9cd1d86330d73361ed7 Jun 08 12:14:00.179745 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:00.179705 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-6wr2n" event={"ID":"8ee41dd7-f05b-4f35-ab3b-bea879d64993","Type":"ContainerStarted","Data":"036e1de186e35ba87229cf7447c28c43f4c57d00c41df9cd1d86330d73361ed7"} Jun 08 12:14:01.385409 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:01.385379 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:02.190145 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:02.190109 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-6wr2n" event={"ID":"8ee41dd7-f05b-4f35-ab3b-bea879d64993","Type":"ContainerStarted","Data":"da5692b2164d140d1af5c9a4de3de51a9e5a5f7458f66f31d02151cd086a94a3"} Jun 08 12:14:02.190321 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:02.190192 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-6wr2n" event={"ID":"8ee41dd7-f05b-4f35-ab3b-bea879d64993","Type":"ContainerStarted","Data":"3c0f5fb4fe6bf6712ce20cbf9f327fbf82d10a1db762b7b8effe14604cea946e"} Jun 08 12:14:02.208875 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:02.208806 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-6wr2n" podStartSLOduration=2.859700491 podStartE2EDuration="4.208792748s" totalImagesPullingTime="1.349092257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:14:02.207313806 +0000 UTC m=+270.323131943" watchObservedRunningTime="2026-06-08 12:14:02.208792748 +0000 UTC m=+270.324610885" Jun 08 12:14:03.850464 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:03.850421 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:03.947395 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:03.947359 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:04.065279 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.065239 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:04.088639 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.088604 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-8bhff"] Jun 08 12:14:04.092166 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.092145 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb"] Jun 08 12:14:04.092278 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.092255 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8bhff" Jun 08 12:14:04.094690 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.094670 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 08 12:14:04.094805 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.094712 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2892r\"" Jun 08 12:14:04.094967 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.094953 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 08 12:14:04.095279 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.095257 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" Jun 08 12:14:04.097393 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.097372 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-8zmh8\"" Jun 08 12:14:04.097616 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.097600 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 08 12:14:04.097715 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.097697 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 08 12:14:04.097798 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.097780 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 08 12:14:04.104717 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.104664 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-8bhff"] Jun 08 12:14:04.108071 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.108048 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb"] Jun 08 12:14:04.114513 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.114489 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r5qpz"] Jun 08 12:14:04.117591 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.117575 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.120223 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.120203 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 12:14:04.120509 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.120495 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4h642\"" Jun 08 12:14:04.120684 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.120667 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 12:14:04.121383 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.121370 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 12:14:04.146932 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.146912 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:04.177991 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.177966 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a263f58-da15-4162-9ce6-4ebc07f7bc01-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-8bhff\" (UID: \"4a263f58-da15-4162-9ce6-4ebc07f7bc01\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8bhff" Jun 08 12:14:04.178093 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.177994 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-node-exporter-textfile\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.178093 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.178014 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-node-exporter-tls\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.178093 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.178033 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-node-exporter-wtmp\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.178205 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.178092 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/320b65f6-3e0b-4719-baa9-bc6adb11fbe8-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-bwknb\" (UID: \"320b65f6-3e0b-4719-baa9-bc6adb11fbe8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" Jun 08 12:14:04.178205 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.178118 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/320b65f6-3e0b-4719-baa9-bc6adb11fbe8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-bwknb\" (UID: \"320b65f6-3e0b-4719-baa9-bc6adb11fbe8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" Jun 08 12:14:04.178205 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.178142 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a263f58-da15-4162-9ce6-4ebc07f7bc01-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-8bhff\" (UID: \"4a263f58-da15-4162-9ce6-4ebc07f7bc01\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8bhff" Jun 08 12:14:04.178205 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.178156 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-sys\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.178205 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.178173 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.178205 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.178198 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-metrics-client-ca\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.178399 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.178235 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/320b65f6-3e0b-4719-baa9-bc6adb11fbe8-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-bwknb\" (UID: \"320b65f6-3e0b-4719-baa9-bc6adb11fbe8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" Jun 08 12:14:04.178399 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.178251 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-root\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.178399 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.178264 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h59c\" (UniqueName: \"kubernetes.io/projected/320b65f6-3e0b-4719-baa9-bc6adb11fbe8-kube-api-access-6h59c\") pod \"kube-state-metrics-57bbf8bfb5-bwknb\" (UID: \"320b65f6-3e0b-4719-baa9-bc6adb11fbe8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" Jun 08 12:14:04.178399 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.178289 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf6kb\" (UniqueName: \"kubernetes.io/projected/4a263f58-da15-4162-9ce6-4ebc07f7bc01-kube-api-access-wf6kb\") pod \"openshift-state-metrics-65f78d5c66-8bhff\" (UID: \"4a263f58-da15-4162-9ce6-4ebc07f7bc01\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8bhff" Jun 08 12:14:04.178399 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.178322 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/320b65f6-3e0b-4719-baa9-bc6adb11fbe8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-bwknb\" (UID: \"320b65f6-3e0b-4719-baa9-bc6adb11fbe8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" Jun 08 12:14:04.178399 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.178341 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxgcp\" (UniqueName: \"kubernetes.io/projected/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-kube-api-access-mxgcp\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.178399 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.178387 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a263f58-da15-4162-9ce6-4ebc07f7bc01-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-8bhff\" (UID: \"4a263f58-da15-4162-9ce6-4ebc07f7bc01\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8bhff" Jun 08 12:14:04.178617 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.178406 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/320b65f6-3e0b-4719-baa9-bc6adb11fbe8-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-bwknb\" (UID: \"320b65f6-3e0b-4719-baa9-bc6adb11fbe8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" Jun 08 12:14:04.178617 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.178424 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-node-exporter-accelerators-collector-config\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.231170 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.231144 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:04.278866 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.278837 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a263f58-da15-4162-9ce6-4ebc07f7bc01-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-8bhff\" (UID: \"4a263f58-da15-4162-9ce6-4ebc07f7bc01\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8bhff" Jun 08 12:14:04.278969 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.278873 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/320b65f6-3e0b-4719-baa9-bc6adb11fbe8-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-bwknb\" (UID: \"320b65f6-3e0b-4719-baa9-bc6adb11fbe8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" Jun 08 12:14:04.278969 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.278900 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-node-exporter-accelerators-collector-config\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.279079 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.279027 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a263f58-da15-4162-9ce6-4ebc07f7bc01-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-8bhff\" (UID: \"4a263f58-da15-4162-9ce6-4ebc07f7bc01\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8bhff" Jun 08 12:14:04.279079 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.279060 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-node-exporter-textfile\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.279185 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.279087 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-node-exporter-tls\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.279185 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.279118 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-node-exporter-wtmp\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.279185 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.279146 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/320b65f6-3e0b-4719-baa9-bc6adb11fbe8-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-bwknb\" (UID: \"320b65f6-3e0b-4719-baa9-bc6adb11fbe8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" Jun 08 12:14:04.279185 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.279172 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/320b65f6-3e0b-4719-baa9-bc6adb11fbe8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-bwknb\" (UID: \"320b65f6-3e0b-4719-baa9-bc6adb11fbe8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" Jun 08 12:14:04.279393 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.279208 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a263f58-da15-4162-9ce6-4ebc07f7bc01-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-8bhff\" (UID: \"4a263f58-da15-4162-9ce6-4ebc07f7bc01\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8bhff" Jun 08 12:14:04.279393 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.279231 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-sys\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.279393 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.279256 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.279393 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.279295 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-metrics-client-ca\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.279393 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.279331 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/320b65f6-3e0b-4719-baa9-bc6adb11fbe8-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-bwknb\" (UID: \"320b65f6-3e0b-4719-baa9-bc6adb11fbe8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" Jun 08 12:14:04.279393 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.279372 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-root\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.279666 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.279397 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h59c\" (UniqueName: \"kubernetes.io/projected/320b65f6-3e0b-4719-baa9-bc6adb11fbe8-kube-api-access-6h59c\") pod \"kube-state-metrics-57bbf8bfb5-bwknb\" (UID: \"320b65f6-3e0b-4719-baa9-bc6adb11fbe8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" Jun 08 12:14:04.279666 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.279402 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-node-exporter-textfile\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.279666 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.279434 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-node-exporter-wtmp\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.279666 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.279449 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf6kb\" (UniqueName: \"kubernetes.io/projected/4a263f58-da15-4162-9ce6-4ebc07f7bc01-kube-api-access-wf6kb\") pod \"openshift-state-metrics-65f78d5c66-8bhff\" (UID: \"4a263f58-da15-4162-9ce6-4ebc07f7bc01\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8bhff" Jun 08 12:14:04.279666 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.279513 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/320b65f6-3e0b-4719-baa9-bc6adb11fbe8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-bwknb\" (UID: \"320b65f6-3e0b-4719-baa9-bc6adb11fbe8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" Jun 08 12:14:04.279666 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.279540 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxgcp\" (UniqueName: \"kubernetes.io/projected/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-kube-api-access-mxgcp\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.279975 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.279883 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/320b65f6-3e0b-4719-baa9-bc6adb11fbe8-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-bwknb\" (UID: \"320b65f6-3e0b-4719-baa9-bc6adb11fbe8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" Jun 08 12:14:04.279975 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.279942 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-sys\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.280774 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.280409 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/320b65f6-3e0b-4719-baa9-bc6adb11fbe8-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-bwknb\" (UID: \"320b65f6-3e0b-4719-baa9-bc6adb11fbe8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" Jun 08 12:14:04.280774 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.280487 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-root\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.280774 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.280618 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/320b65f6-3e0b-4719-baa9-bc6adb11fbe8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-bwknb\" (UID: \"320b65f6-3e0b-4719-baa9-bc6adb11fbe8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" Jun 08 12:14:04.280774 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.280734 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-metrics-client-ca\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.281033 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.280923 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a263f58-da15-4162-9ce6-4ebc07f7bc01-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-8bhff\" (UID: \"4a263f58-da15-4162-9ce6-4ebc07f7bc01\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8bhff" Jun 08 12:14:04.281033 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.280924 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-node-exporter-accelerators-collector-config\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.282255 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.282214 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a263f58-da15-4162-9ce6-4ebc07f7bc01-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-8bhff\" (UID: \"4a263f58-da15-4162-9ce6-4ebc07f7bc01\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8bhff" Jun 08 12:14:04.282384 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.282363 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.282384 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.282377 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a263f58-da15-4162-9ce6-4ebc07f7bc01-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-8bhff\" (UID: \"4a263f58-da15-4162-9ce6-4ebc07f7bc01\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8bhff" Jun 08 12:14:04.282648 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.282629 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/320b65f6-3e0b-4719-baa9-bc6adb11fbe8-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-bwknb\" (UID: \"320b65f6-3e0b-4719-baa9-bc6adb11fbe8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" Jun 08 12:14:04.283134 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.283111 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-node-exporter-tls\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.283193 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.283134 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/320b65f6-3e0b-4719-baa9-bc6adb11fbe8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-bwknb\" (UID: \"320b65f6-3e0b-4719-baa9-bc6adb11fbe8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" Jun 08 12:14:04.287419 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.287393 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf6kb\" (UniqueName: \"kubernetes.io/projected/4a263f58-da15-4162-9ce6-4ebc07f7bc01-kube-api-access-wf6kb\") pod \"openshift-state-metrics-65f78d5c66-8bhff\" (UID: \"4a263f58-da15-4162-9ce6-4ebc07f7bc01\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8bhff" Jun 08 12:14:04.287697 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.287676 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h59c\" (UniqueName: \"kubernetes.io/projected/320b65f6-3e0b-4719-baa9-bc6adb11fbe8-kube-api-access-6h59c\") pod \"kube-state-metrics-57bbf8bfb5-bwknb\" (UID: \"320b65f6-3e0b-4719-baa9-bc6adb11fbe8\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" Jun 08 12:14:04.288577 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.288555 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxgcp\" (UniqueName: \"kubernetes.io/projected/2c1f6f38-34fa-4ddc-8442-2f7903793a9c-kube-api-access-mxgcp\") pod \"node-exporter-r5qpz\" (UID: \"2c1f6f38-34fa-4ddc-8442-2f7903793a9c\") " pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.329150 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.329119 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:04.403804 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.403775 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8bhff" Jun 08 12:14:04.409967 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.409950 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" Jun 08 12:14:04.425777 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.425747 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r5qpz" Jun 08 12:14:04.431690 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.431653 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:04.439722 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:14:04.439699 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c1f6f38_34fa_4ddc_8442_2f7903793a9c.slice/crio-c953e9ebbd2910a3d40c5f5be8d15e8ab5fbf755cce603ed8ffacbc5a53b8063 WatchSource:0}: Error finding container c953e9ebbd2910a3d40c5f5be8d15e8ab5fbf755cce603ed8ffacbc5a53b8063: Status 404 returned error can't find the container with id c953e9ebbd2910a3d40c5f5be8d15e8ab5fbf755cce603ed8ffacbc5a53b8063 Jun 08 12:14:04.532242 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.532210 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:04.546318 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.546293 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb"] Jun 08 12:14:04.548600 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:14:04.548574 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod320b65f6_3e0b_4719_baa9_bc6adb11fbe8.slice/crio-ea42ed44f01b932041fad0cb14d0db52eb93afd6ceb6308dc0d0f72c3ed5489f WatchSource:0}: Error finding container ea42ed44f01b932041fad0cb14d0db52eb93afd6ceb6308dc0d0f72c3ed5489f: Status 404 returned error can't find the container with id ea42ed44f01b932041fad0cb14d0db52eb93afd6ceb6308dc0d0f72c3ed5489f Jun 08 12:14:04.568354 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.566535 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-8bhff"] Jun 08 12:14:04.571911 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:14:04.571887 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a263f58_da15_4162_9ce6_4ebc07f7bc01.slice/crio-6153d09f3055c370441a226bdf004664b317faf54154fac98cff0594b4b56fbd WatchSource:0}: Error finding container 6153d09f3055c370441a226bdf004664b317faf54154fac98cff0594b4b56fbd: Status 404 returned error can't find the container with id 6153d09f3055c370441a226bdf004664b317faf54154fac98cff0594b4b56fbd Jun 08 12:14:04.631689 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:04.631646 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:05.095163 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.095057 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:05.184263 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.183906 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:14:05.185426 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.185399 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:05.188657 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.188588 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.191184 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.191160 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 12:14:05.191385 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.191363 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 12:14:05.191459 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.191395 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hnsng\"" Jun 08 12:14:05.192146 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.192116 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 12:14:05.192262 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.192169 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 12:14:05.192262 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.192170 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 12:14:05.192366 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.192310 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 12:14:05.192485 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.192471 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 12:14:05.193125 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.192949 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 12:14:05.193125 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.193006 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 12:14:05.204985 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.202980 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r5qpz" event={"ID":"2c1f6f38-34fa-4ddc-8442-2f7903793a9c","Type":"ContainerStarted","Data":"c953e9ebbd2910a3d40c5f5be8d15e8ab5fbf755cce603ed8ffacbc5a53b8063"} Jun 08 12:14:05.205471 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.205406 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" event={"ID":"320b65f6-3e0b-4719-baa9-bc6adb11fbe8","Type":"ContainerStarted","Data":"ea42ed44f01b932041fad0cb14d0db52eb93afd6ceb6308dc0d0f72c3ed5489f"} Jun 08 12:14:05.205975 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.205951 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:14:05.212655 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.212618 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8bhff" event={"ID":"4a263f58-da15-4162-9ce6-4ebc07f7bc01","Type":"ContainerStarted","Data":"1d9763a4cabb3023e52ae33c125d6ef0e938f6a441ab4c6a9b13aa3d088b17ae"} Jun 08 12:14:05.212761 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.212674 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8bhff" event={"ID":"4a263f58-da15-4162-9ce6-4ebc07f7bc01","Type":"ContainerStarted","Data":"201666c26ec96b4fba03c529eec1e7d22eb33899e8c604d1acda771c0fbc83b4"} Jun 08 12:14:05.212761 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.212701 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8bhff" event={"ID":"4a263f58-da15-4162-9ce6-4ebc07f7bc01","Type":"ContainerStarted","Data":"6153d09f3055c370441a226bdf004664b317faf54154fac98cff0594b4b56fbd"} Jun 08 12:14:05.290435 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.290010 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfxmq\" (UniqueName: \"kubernetes.io/projected/f3297f5f-682a-4e43-a607-f4bcf92fff95-kube-api-access-dfxmq\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.290435 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.290096 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3297f5f-682a-4e43-a607-f4bcf92fff95-config-out\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.290435 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.290163 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.290435 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.290195 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.290435 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.290225 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-config-volume\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.290435 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.290274 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-web-config\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.290435 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.290304 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3297f5f-682a-4e43-a607-f4bcf92fff95-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.290435 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.290344 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f3297f5f-682a-4e43-a607-f4bcf92fff95-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.290435 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.290369 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3297f5f-682a-4e43-a607-f4bcf92fff95-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.290435 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.290420 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.291105 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.290507 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.291105 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.290548 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3297f5f-682a-4e43-a607-f4bcf92fff95-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.291105 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.290602 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.391923 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.391886 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.392101 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.391948 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfxmq\" (UniqueName: \"kubernetes.io/projected/f3297f5f-682a-4e43-a607-f4bcf92fff95-kube-api-access-dfxmq\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.392101 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.391975 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3297f5f-682a-4e43-a607-f4bcf92fff95-config-out\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.392101 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.392020 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.392101 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.392048 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.392101 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.392075 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-config-volume\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.392364 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.392115 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-web-config\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.392364 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.392147 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3297f5f-682a-4e43-a607-f4bcf92fff95-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.392364 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.392186 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f3297f5f-682a-4e43-a607-f4bcf92fff95-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.392364 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.392210 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3297f5f-682a-4e43-a607-f4bcf92fff95-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.392364 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.392233 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.392364 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.392270 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.392364 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.392302 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3297f5f-682a-4e43-a607-f4bcf92fff95-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.392691 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:14:05.392439 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f3297f5f-682a-4e43-a607-f4bcf92fff95-alertmanager-trusted-ca-bundle podName:f3297f5f-682a-4e43-a607-f4bcf92fff95 nodeName:}" failed. No retries permitted until 2026-06-08 12:14:05.892420176 +0000 UTC m=+274.008238296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/f3297f5f-682a-4e43-a607-f4bcf92fff95-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "f3297f5f-682a-4e43-a607-f4bcf92fff95") : configmap references non-existent config key: ca-bundle.crt Jun 08 12:14:05.392755 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:14:05.392741 2565 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 08 12:14:05.392831 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:14:05.392798 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-main-tls podName:f3297f5f-682a-4e43-a607-f4bcf92fff95 nodeName:}" failed. No retries permitted until 2026-06-08 12:14:05.892781013 +0000 UTC m=+274.008599135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "f3297f5f-682a-4e43-a607-f4bcf92fff95") : secret "alertmanager-main-tls" not found Jun 08 12:14:05.393018 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.392934 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f3297f5f-682a-4e43-a607-f4bcf92fff95-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.393558 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.393532 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3297f5f-682a-4e43-a607-f4bcf92fff95-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.396199 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.395310 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3297f5f-682a-4e43-a607-f4bcf92fff95-config-out\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.396199 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.395488 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.396764 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.396737 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3297f5f-682a-4e43-a607-f4bcf92fff95-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.398240 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.397782 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.398240 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.398203 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-config-volume\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.398644 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.398601 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.399423 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.399393 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-web-config\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.399586 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.399562 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.403421 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.403399 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfxmq\" (UniqueName: \"kubernetes.io/projected/f3297f5f-682a-4e43-a607-f4bcf92fff95-kube-api-access-dfxmq\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.659452 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.659376 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:05.898557 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.898527 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.898739 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.898583 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3297f5f-682a-4e43-a607-f4bcf92fff95-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.899465 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.899433 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3297f5f-682a-4e43-a607-f4bcf92fff95-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:05.901393 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:05.901371 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:06.091793 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.091768 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv"] Jun 08 12:14:06.096743 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.096721 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.099546 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.099260 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 08 12:14:06.099546 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.099282 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 08 12:14:06.099546 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.099306 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 08 12:14:06.099546 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.099342 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 08 12:14:06.099546 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.099260 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 08 12:14:06.099546 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.099538 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-sxjk4\"" Jun 08 12:14:06.100158 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.100113 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:14:06.100518 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.100355 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-akh6j559p9cj1\"" Jun 08 12:14:06.107180 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.107158 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv"] Jun 08 12:14:06.201088 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.200582 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/178e71f4-2694-4616-b847-bd42250ecc84-metrics-client-ca\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.201088 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.200636 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/178e71f4-2694-4616-b847-bd42250ecc84-secret-thanos-querier-tls\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.201088 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.200664 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/178e71f4-2694-4616-b847-bd42250ecc84-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.201088 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.200694 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/178e71f4-2694-4616-b847-bd42250ecc84-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.201088 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.200753 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/178e71f4-2694-4616-b847-bd42250ecc84-secret-grpc-tls\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.201088 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.200784 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m97t\" (UniqueName: \"kubernetes.io/projected/178e71f4-2694-4616-b847-bd42250ecc84-kube-api-access-9m97t\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.201088 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.200827 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/178e71f4-2694-4616-b847-bd42250ecc84-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.201088 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.200870 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/178e71f4-2694-4616-b847-bd42250ecc84-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.218394 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.218230 2565 generic.go:356] "Generic (PLEG): container finished" podID="2c1f6f38-34fa-4ddc-8442-2f7903793a9c" containerID="2e3954094deb36a69363c14532b9753970d03937e90f85f8ab1609233d9b229f" exitCode=0 Jun 08 12:14:06.218394 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.218323 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r5qpz" event={"ID":"2c1f6f38-34fa-4ddc-8442-2f7903793a9c","Type":"ContainerDied","Data":"2e3954094deb36a69363c14532b9753970d03937e90f85f8ab1609233d9b229f"} Jun 08 12:14:06.224955 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.224027 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" event={"ID":"320b65f6-3e0b-4719-baa9-bc6adb11fbe8","Type":"ContainerStarted","Data":"18b1012f75c4af651c6ce428a737c783edcaedc2c1dad68c657cbc29a6c6d757"} Jun 08 12:14:06.224955 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.224082 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" event={"ID":"320b65f6-3e0b-4719-baa9-bc6adb11fbe8","Type":"ContainerStarted","Data":"1f7b050dafd2420a1227325de60c5fc951eb666b69dc9428210106b0e48a56a8"} Jun 08 12:14:06.295172 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.295134 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:14:06.297298 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:14:06.297272 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3297f5f_682a_4e43_a607_f4bcf92fff95.slice/crio-01db2e20a7810bb7ae6d05d80e59ce4f50e4513ddd002177404d7b81a26a1d8c WatchSource:0}: Error finding container 01db2e20a7810bb7ae6d05d80e59ce4f50e4513ddd002177404d7b81a26a1d8c: Status 404 returned error can't find the container with id 01db2e20a7810bb7ae6d05d80e59ce4f50e4513ddd002177404d7b81a26a1d8c Jun 08 12:14:06.302180 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.302132 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/178e71f4-2694-4616-b847-bd42250ecc84-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.303184 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.302230 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/178e71f4-2694-4616-b847-bd42250ecc84-metrics-client-ca\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.303184 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.302271 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/178e71f4-2694-4616-b847-bd42250ecc84-secret-thanos-querier-tls\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.303184 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.302295 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/178e71f4-2694-4616-b847-bd42250ecc84-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.303184 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.302336 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/178e71f4-2694-4616-b847-bd42250ecc84-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.303184 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.302428 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/178e71f4-2694-4616-b847-bd42250ecc84-secret-grpc-tls\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.303184 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.302461 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m97t\" (UniqueName: \"kubernetes.io/projected/178e71f4-2694-4616-b847-bd42250ecc84-kube-api-access-9m97t\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.303184 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.302488 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/178e71f4-2694-4616-b847-bd42250ecc84-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.303573 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.303431 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/178e71f4-2694-4616-b847-bd42250ecc84-metrics-client-ca\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.306348 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.306302 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/178e71f4-2694-4616-b847-bd42250ecc84-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.306542 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.306520 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/178e71f4-2694-4616-b847-bd42250ecc84-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.306899 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.306842 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/178e71f4-2694-4616-b847-bd42250ecc84-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.307152 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.307131 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/178e71f4-2694-4616-b847-bd42250ecc84-secret-thanos-querier-tls\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.307228 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.307178 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/178e71f4-2694-4616-b847-bd42250ecc84-secret-grpc-tls\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.307628 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.307606 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/178e71f4-2694-4616-b847-bd42250ecc84-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.318772 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.318335 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m97t\" (UniqueName: \"kubernetes.io/projected/178e71f4-2694-4616-b847-bd42250ecc84-kube-api-access-9m97t\") pod \"thanos-querier-7cc6bdfcc8-dtbpv\" (UID: \"178e71f4-2694-4616-b847-bd42250ecc84\") " pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.418997 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.418967 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:06.567516 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:06.567488 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv"] Jun 08 12:14:06.568916 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:14:06.568889 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod178e71f4_2694_4616_b847_bd42250ecc84.slice/crio-4d5d4cb027391230865af5b38de74781d4711100846258c5deb6aaed48bb7906 WatchSource:0}: Error finding container 4d5d4cb027391230865af5b38de74781d4711100846258c5deb6aaed48bb7906: Status 404 returned error can't find the container with id 4d5d4cb027391230865af5b38de74781d4711100846258c5deb6aaed48bb7906 Jun 08 12:14:07.032451 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:07.032411 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:07.136704 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:07.136647 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:07.230440 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:07.230403 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" event={"ID":"178e71f4-2694-4616-b847-bd42250ecc84","Type":"ContainerStarted","Data":"4d5d4cb027391230865af5b38de74781d4711100846258c5deb6aaed48bb7906"} Jun 08 12:14:07.232883 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:07.232850 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f3297f5f-682a-4e43-a607-f4bcf92fff95","Type":"ContainerStarted","Data":"01db2e20a7810bb7ae6d05d80e59ce4f50e4513ddd002177404d7b81a26a1d8c"} Jun 08 12:14:07.235699 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:07.235670 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r5qpz" event={"ID":"2c1f6f38-34fa-4ddc-8442-2f7903793a9c","Type":"ContainerStarted","Data":"4842e77573bbf3af53490c38311d5da617e2677713a3d989e272e55277ea1392"} Jun 08 12:14:07.235837 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:07.235723 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r5qpz" event={"ID":"2c1f6f38-34fa-4ddc-8442-2f7903793a9c","Type":"ContainerStarted","Data":"a5c1bfc196c4f1141a807c5aa5b112abb4a5a813f004b305100beb03340a346e"} Jun 08 12:14:07.236237 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:07.236210 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:07.239236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:07.239099 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" event={"ID":"320b65f6-3e0b-4719-baa9-bc6adb11fbe8","Type":"ContainerStarted","Data":"abd6f405df7f8349508165df0ab5e226e7c1629683e1b0835bb94e470087168e"} Jun 08 12:14:07.257490 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:07.257434 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r5qpz" podStartSLOduration=1.59013362 podStartE2EDuration="3.257418445s" totalImagesPullingTime="1.557650972s" totalInitContainerRuntime="109.633853ms" isStatefulPod=true podCreationTimestamp="2026-06-08 12:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:14:07.256420148 +0000 UTC m=+275.372238314" watchObservedRunningTime="2026-06-08 12:14:07.257418445 +0000 UTC m=+275.373236560" Jun 08 12:14:07.276217 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:07.276163 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-bwknb" podStartSLOduration=1.824906973 podStartE2EDuration="3.276145103s" totalImagesPullingTime="1.45123813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:14:07.276086267 +0000 UTC m=+275.391904405" watchObservedRunningTime="2026-06-08 12:14:07.276145103 +0000 UTC m=+275.391963241" Jun 08 12:14:07.342653 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:07.342577 2565 scope.go:117] "RemoveContainer" containerID="da79ba313bb8862ee235d514aa2a3530f0d31001c7ccbae39aca929454291a7d" Jun 08 12:14:07.342786 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:14:07.342753 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-qvcwf_openshift-console-operator(731f4b21-0de5-4184-aa7d-05eab33ce31e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" podUID="731f4b21-0de5-4184-aa7d-05eab33ce31e" Jun 08 12:14:08.246205 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:08.246164 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8bhff" event={"ID":"4a263f58-da15-4162-9ce6-4ebc07f7bc01","Type":"ContainerStarted","Data":"077e11d811c0b5037c46a2c01f3e2847a0874689fb998e0fa79724f38dbb1744"} Jun 08 12:14:08.247923 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:08.247892 2565 generic.go:356] "Generic (PLEG): container finished" podID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerID="0130669bcdb2409cab8392d3086267401920134db5957b0b4a1e15deb01e9353" exitCode=0 Jun 08 12:14:08.248052 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:08.247980 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f3297f5f-682a-4e43-a607-f4bcf92fff95","Type":"ContainerDied","Data":"0130669bcdb2409cab8392d3086267401920134db5957b0b4a1e15deb01e9353"} Jun 08 12:14:08.265525 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:08.265484 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-8bhff" podStartSLOduration=1.384850422 podStartE2EDuration="4.265467771s" totalImagesPullingTime="2.880617349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:14:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:14:08.264123837 +0000 UTC m=+276.379941981" watchObservedRunningTime="2026-06-08 12:14:08.265467771 +0000 UTC m=+276.381285911" Jun 08 12:14:08.862764 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:08.862737 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-f4ptf"] Jun 08 12:14:08.867069 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:08.867044 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-f4ptf" Jun 08 12:14:08.867914 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:08.867889 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:08.869430 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:08.869410 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 08 12:14:08.869530 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:08.869508 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-dbbm6\"" Jun 08 12:14:08.876523 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:08.876499 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-f4ptf"] Jun 08 12:14:08.927860 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:08.927833 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9aa82ba9-0cdb-49a2-97c4-825ffaeb1f0a-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-f4ptf\" (UID: \"9aa82ba9-0cdb-49a2-97c4-825ffaeb1f0a\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-f4ptf" Jun 08 12:14:08.927991 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:08.927961 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqm2w\" (UniqueName: \"kubernetes.io/projected/9aa82ba9-0cdb-49a2-97c4-825ffaeb1f0a-kube-api-access-zqm2w\") pod \"monitoring-plugin-76b68cc874-f4ptf\" (UID: \"9aa82ba9-0cdb-49a2-97c4-825ffaeb1f0a\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-f4ptf" Jun 08 12:14:09.029389 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.029315 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqm2w\" (UniqueName: \"kubernetes.io/projected/9aa82ba9-0cdb-49a2-97c4-825ffaeb1f0a-kube-api-access-zqm2w\") pod \"monitoring-plugin-76b68cc874-f4ptf\" (UID: \"9aa82ba9-0cdb-49a2-97c4-825ffaeb1f0a\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-f4ptf" Jun 08 12:14:09.029389 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.029384 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9aa82ba9-0cdb-49a2-97c4-825ffaeb1f0a-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-f4ptf\" (UID: \"9aa82ba9-0cdb-49a2-97c4-825ffaeb1f0a\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-f4ptf" Jun 08 12:14:09.029560 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:14:09.029483 2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 08 12:14:09.029560 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:14:09.029542 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aa82ba9-0cdb-49a2-97c4-825ffaeb1f0a-monitoring-plugin-cert podName:9aa82ba9-0cdb-49a2-97c4-825ffaeb1f0a nodeName:}" failed. No retries permitted until 2026-06-08 12:14:09.529524186 +0000 UTC m=+277.645342302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/9aa82ba9-0cdb-49a2-97c4-825ffaeb1f0a-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-f4ptf" (UID: "9aa82ba9-0cdb-49a2-97c4-825ffaeb1f0a") : secret "monitoring-plugin-cert" not found Jun 08 12:14:09.041188 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.041141 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqm2w\" (UniqueName: \"kubernetes.io/projected/9aa82ba9-0cdb-49a2-97c4-825ffaeb1f0a-kube-api-access-zqm2w\") pod \"monitoring-plugin-76b68cc874-f4ptf\" (UID: \"9aa82ba9-0cdb-49a2-97c4-825ffaeb1f0a\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-f4ptf" Jun 08 12:14:09.224607 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.224561 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:09.254244 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.254205 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" event={"ID":"178e71f4-2694-4616-b847-bd42250ecc84","Type":"ContainerStarted","Data":"88c7e730b444bb819b33d4f0104a1426def4934cf732ac5a17462d8f6b7e6a1b"} Jun 08 12:14:09.254646 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.254317 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" event={"ID":"178e71f4-2694-4616-b847-bd42250ecc84","Type":"ContainerStarted","Data":"048dc194cbfe4bf43968b862c5508fb776b1d6b41881544b12c6691802641647"} Jun 08 12:14:09.254646 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.254362 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" event={"ID":"178e71f4-2694-4616-b847-bd42250ecc84","Type":"ContainerStarted","Data":"137b0fd2323b573dd821690c4f232f69c5e5c0503eb0fe5e37b3367020ef737d"} Jun 08 12:14:09.327851 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.327746 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp"] Jun 08 12:14:09.332086 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.332062 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.334664 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.334611 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6jx4b\"" Jun 08 12:14:09.334806 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.334648 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 08 12:14:09.335182 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.335020 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 08 12:14:09.335182 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.335084 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 08 12:14:09.335182 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.335148 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 08 12:14:09.335398 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.335373 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 08 12:14:09.342171 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.342148 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 08 12:14:09.343473 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.343452 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp"] Jun 08 12:14:09.431988 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.431958 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/adf4772b-a9f3-4185-9218-ab140455f591-federate-client-tls\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.432137 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.431994 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lghgx\" (UniqueName: \"kubernetes.io/projected/adf4772b-a9f3-4185-9218-ab140455f591-kube-api-access-lghgx\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.432137 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.432017 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adf4772b-a9f3-4185-9218-ab140455f591-metrics-client-ca\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.432137 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.432101 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/adf4772b-a9f3-4185-9218-ab140455f591-telemeter-client-tls\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.432267 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.432161 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/adf4772b-a9f3-4185-9218-ab140455f591-secret-telemeter-client\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.432267 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.432207 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adf4772b-a9f3-4185-9218-ab140455f591-serving-certs-ca-bundle\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.432267 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.432258 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/adf4772b-a9f3-4185-9218-ab140455f591-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.432367 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.432276 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adf4772b-a9f3-4185-9218-ab140455f591-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.533358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.533322 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adf4772b-a9f3-4185-9218-ab140455f591-serving-certs-ca-bundle\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.533529 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.533394 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/adf4772b-a9f3-4185-9218-ab140455f591-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.533529 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.533424 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adf4772b-a9f3-4185-9218-ab140455f591-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.533529 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.533468 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/adf4772b-a9f3-4185-9218-ab140455f591-federate-client-tls\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.533529 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.533493 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lghgx\" (UniqueName: \"kubernetes.io/projected/adf4772b-a9f3-4185-9218-ab140455f591-kube-api-access-lghgx\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.533529 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.533517 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adf4772b-a9f3-4185-9218-ab140455f591-metrics-client-ca\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.533797 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.533557 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/adf4772b-a9f3-4185-9218-ab140455f591-telemeter-client-tls\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.533797 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.533583 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9aa82ba9-0cdb-49a2-97c4-825ffaeb1f0a-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-f4ptf\" (UID: \"9aa82ba9-0cdb-49a2-97c4-825ffaeb1f0a\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-f4ptf" Jun 08 12:14:09.533797 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.533640 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/adf4772b-a9f3-4185-9218-ab140455f591-secret-telemeter-client\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.534396 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.534077 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adf4772b-a9f3-4185-9218-ab140455f591-serving-certs-ca-bundle\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.534396 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.534341 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adf4772b-a9f3-4185-9218-ab140455f591-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.534563 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.534402 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adf4772b-a9f3-4185-9218-ab140455f591-metrics-client-ca\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.537139 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.537098 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/adf4772b-a9f3-4185-9218-ab140455f591-telemeter-client-tls\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.537299 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.537258 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9aa82ba9-0cdb-49a2-97c4-825ffaeb1f0a-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-f4ptf\" (UID: \"9aa82ba9-0cdb-49a2-97c4-825ffaeb1f0a\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-f4ptf" Jun 08 12:14:09.537369 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.537325 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/adf4772b-a9f3-4185-9218-ab140455f591-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.537430 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.537364 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/adf4772b-a9f3-4185-9218-ab140455f591-secret-telemeter-client\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.537644 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.537624 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/adf4772b-a9f3-4185-9218-ab140455f591-federate-client-tls\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.548239 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.548213 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lghgx\" (UniqueName: \"kubernetes.io/projected/adf4772b-a9f3-4185-9218-ab140455f591-kube-api-access-lghgx\") pod \"telemeter-client-7d6bbcd6c9-9rrtp\" (UID: \"adf4772b-a9f3-4185-9218-ab140455f591\") " pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.645037 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.645012 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" Jun 08 12:14:09.776922 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.776890 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-f4ptf" Jun 08 12:14:09.802329 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.802297 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp"] Jun 08 12:14:09.833168 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:14:09.833145 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf4772b_a9f3_4185_9218_ab140455f591.slice/crio-a86e16e474d496ec9efe2f21d0b7d1e707009083ebf868d612057c327d4996c2 WatchSource:0}: Error finding container a86e16e474d496ec9efe2f21d0b7d1e707009083ebf868d612057c327d4996c2: Status 404 returned error can't find the container with id a86e16e474d496ec9efe2f21d0b7d1e707009083ebf868d612057c327d4996c2 Jun 08 12:14:09.960638 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:09.960525 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-f4ptf"] Jun 08 12:14:09.962586 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:14:09.962567 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aa82ba9_0cdb_49a2_97c4_825ffaeb1f0a.slice/crio-cf6fc79a8106e0c34d5f276251ca274290ba646103ac56a684183adde9a6227c WatchSource:0}: Error finding container cf6fc79a8106e0c34d5f276251ca274290ba646103ac56a684183adde9a6227c: Status 404 returned error can't find the container with id cf6fc79a8106e0c34d5f276251ca274290ba646103ac56a684183adde9a6227c Jun 08 12:14:10.263155 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:10.263072 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" event={"ID":"178e71f4-2694-4616-b847-bd42250ecc84","Type":"ContainerStarted","Data":"660a7cf097437a2631313009c0d625247885c02a32d76b2258da48982c6294dc"} Jun 08 12:14:10.263597 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:10.263161 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" event={"ID":"178e71f4-2694-4616-b847-bd42250ecc84","Type":"ContainerStarted","Data":"b1aa65b2889f45a43c29c3c86aad4f12404801246ad0b5d519d32ef56dc2aa3c"} Jun 08 12:14:10.263597 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:10.263207 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" event={"ID":"178e71f4-2694-4616-b847-bd42250ecc84","Type":"ContainerStarted","Data":"6f1c7052cea887c96f5d60804ef9e4443efb9e0d75f0147b926186d3decb013d"} Jun 08 12:14:10.263597 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:10.263256 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:10.264470 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:10.264399 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" event={"ID":"adf4772b-a9f3-4185-9218-ab140455f591","Type":"ContainerStarted","Data":"a86e16e474d496ec9efe2f21d0b7d1e707009083ebf868d612057c327d4996c2"} Jun 08 12:14:10.265781 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:10.265754 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-f4ptf" event={"ID":"9aa82ba9-0cdb-49a2-97c4-825ffaeb1f0a","Type":"ContainerStarted","Data":"cf6fc79a8106e0c34d5f276251ca274290ba646103ac56a684183adde9a6227c"} Jun 08 12:14:10.291128 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:10.291071 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" podStartSLOduration=1.168831062 podStartE2EDuration="4.291052957s" totalImagesPullingTime="3.122221895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:14:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:14:10.288899808 +0000 UTC m=+278.404717946" watchObservedRunningTime="2026-06-08 12:14:10.291052957 +0000 UTC m=+278.406871097" Jun 08 12:14:10.344191 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:10.344151 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:11.279546 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:11.279508 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f3297f5f-682a-4e43-a607-f4bcf92fff95","Type":"ContainerStarted","Data":"98aec2c3fc803ff6eac37ce66d49551735bfd2939519247a0f41f82b1dd78bb4"} Jun 08 12:14:11.280008 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:11.279607 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f3297f5f-682a-4e43-a607-f4bcf92fff95","Type":"ContainerStarted","Data":"e9b95cf92cd76ee2927a2abf328f7500a0ec8f1da2fea1dc5d29cefad40d8010"} Jun 08 12:14:11.280008 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:11.279667 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f3297f5f-682a-4e43-a607-f4bcf92fff95","Type":"ContainerStarted","Data":"d1a9d43b1a17aec75e144ec6ba072baa43475fdf20b4c6f4d7ef278962ccd090"} Jun 08 12:14:11.280008 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:11.279695 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f3297f5f-682a-4e43-a607-f4bcf92fff95","Type":"ContainerStarted","Data":"66ac42abc9e96288b1590ea41683e6e7f44ddb0f24a527aff5611a65eea53eee"} Jun 08 12:14:11.280008 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:11.279763 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f3297f5f-682a-4e43-a607-f4bcf92fff95","Type":"ContainerStarted","Data":"8069705aa5ab32842d7fb8cf49e7f4df7f81bb05e62064037dfadf06ec49386c"} Jun 08 12:14:11.280008 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:11.279800 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f3297f5f-682a-4e43-a607-f4bcf92fff95","Type":"ContainerStarted","Data":"1084b10ecc69bedf898928282e1e32f98a76091f9cfb45703f77f8f14406fa19"} Jun 08 12:14:11.311496 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:11.311363 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.773041128 podStartE2EDuration="6.311344335s" totalImagesPullingTime="3.519258078s" totalInitContainerRuntime="19.045129ms" isStatefulPod=false podCreationTimestamp="2026-06-08 12:14:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:14:11.309713176 +0000 UTC m=+279.425531326" watchObservedRunningTime="2026-06-08 12:14:11.311344335 +0000 UTC m=+279.427162452" Jun 08 12:14:13.290698 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:13.290657 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" event={"ID":"adf4772b-a9f3-4185-9218-ab140455f591","Type":"ContainerStarted","Data":"c30c3f27fd1511c55d1b94d9eb8a147682d34e2825a2d5f05295d0cb20c433b0"} Jun 08 12:14:13.291216 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:13.290758 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" event={"ID":"adf4772b-a9f3-4185-9218-ab140455f591","Type":"ContainerStarted","Data":"7fb905142442baf7caff765f7b4c6e019202c173628af6f61ae42428f4e30009"} Jun 08 12:14:13.291216 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:13.290788 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" event={"ID":"adf4772b-a9f3-4185-9218-ab140455f591","Type":"ContainerStarted","Data":"58b7d67d48f8b77bfec96024f63fe39fe68173751f15cef346e058bc10fbcf7f"} Jun 08 12:14:13.292134 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:13.292107 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-f4ptf" event={"ID":"9aa82ba9-0cdb-49a2-97c4-825ffaeb1f0a","Type":"ContainerStarted","Data":"cd3c7a023eedda167c199e3ea97429b8636dadd1840719c367e1d81e8f84e256"} Jun 08 12:14:13.292221 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:13.292151 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-f4ptf" Jun 08 12:14:13.296928 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:13.296903 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-f4ptf" Jun 08 12:14:13.314373 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:13.314331 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7d6bbcd6c9-9rrtp" podStartSLOduration=1.691742707 podStartE2EDuration="4.314318002s" totalImagesPullingTime="2.622575295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:14:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:14:13.312768835 +0000 UTC m=+281.428586985" watchObservedRunningTime="2026-06-08 12:14:13.314318002 +0000 UTC m=+281.430136130" Jun 08 12:14:13.329099 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:13.329060 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-f4ptf" podStartSLOduration=2.814928779 podStartE2EDuration="5.329048354s" totalImagesPullingTime="2.514119575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:14:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:14:13.327652459 +0000 UTC m=+281.443470597" watchObservedRunningTime="2026-06-08 12:14:13.329048354 +0000 UTC m=+281.444866514" Jun 08 12:14:13.840629 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:14:13.840591 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-g28p2" podUID="433d1661-5360-45df-8679-18cd4f85c03b" Jun 08 12:14:14.296213 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:14.296181 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g28p2" Jun 08 12:14:16.285279 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:16.285247 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7cc6bdfcc8-dtbpv" Jun 08 12:14:17.305040 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:17.305002 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls\") pod \"dns-default-g28p2\" (UID: \"433d1661-5360-45df-8679-18cd4f85c03b\") " pod="openshift-dns/dns-default-g28p2" Jun 08 12:14:17.307483 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:17.307457 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/433d1661-5360-45df-8679-18cd4f85c03b-metrics-tls\") pod \"dns-default-g28p2\" (UID: \"433d1661-5360-45df-8679-18cd4f85c03b\") " pod="openshift-dns/dns-default-g28p2" Jun 08 12:14:17.605452 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:17.605359 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8rrt4\"" Jun 08 12:14:17.608592 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:17.608575 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g28p2" Jun 08 12:14:17.739759 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:17.739727 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g28p2"] Jun 08 12:14:17.743180 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:14:17.743156 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod433d1661_5360_45df_8679_18cd4f85c03b.slice/crio-1d1f761f26d8c19e3c5e4bdab5a19c455d4ed46d19ec20fa81b3165a8612968e WatchSource:0}: Error finding container 1d1f761f26d8c19e3c5e4bdab5a19c455d4ed46d19ec20fa81b3165a8612968e: Status 404 returned error can't find the container with id 1d1f761f26d8c19e3c5e4bdab5a19c455d4ed46d19ec20fa81b3165a8612968e Jun 08 12:14:18.313876 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:18.313840 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g28p2" event={"ID":"433d1661-5360-45df-8679-18cd4f85c03b","Type":"ContainerStarted","Data":"1d1f761f26d8c19e3c5e4bdab5a19c455d4ed46d19ec20fa81b3165a8612968e"} Jun 08 12:14:18.342504 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:18.342466 2565 scope.go:117] "RemoveContainer" containerID="da79ba313bb8862ee235d514aa2a3530f0d31001c7ccbae39aca929454291a7d" Jun 08 12:14:19.271454 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:19.271417 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:19.322518 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:19.322489 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/2.log" Jun 08 12:14:19.322995 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:19.322620 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" event={"ID":"731f4b21-0de5-4184-aa7d-05eab33ce31e","Type":"ContainerStarted","Data":"f374b842f26575dceca6faa61ed1e020b4b0997d9128273f1182e340fd6a0144"} Jun 08 12:14:19.322995 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:19.322983 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" Jun 08 12:14:19.328276 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:19.328252 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-qvcwf" Jun 08 12:14:19.411187 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:19.411151 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:19.546947 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:19.546786 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:19.747219 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:19.747179 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:19.913974 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:19.913942 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:20.015017 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:20.014972 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:20.320342 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:20.320258 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:20.328288 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:20.328257 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g28p2" event={"ID":"433d1661-5360-45df-8679-18cd4f85c03b","Type":"ContainerStarted","Data":"caeacb61f03516c675d962788810b3eefc3d0d11bf7d04abb0e211b73a0d2b39"} Jun 08 12:14:20.328665 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:20.328317 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g28p2" event={"ID":"433d1661-5360-45df-8679-18cd4f85c03b","Type":"ContainerStarted","Data":"13f0486bb04bc7c57593e863f9b77dce3ba6e2218cf5a82dd8e44174e5609317"} Jun 08 12:14:20.328665 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:20.328522 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g28p2" Jun 08 12:14:20.346763 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:20.346719 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-g28p2" podStartSLOduration=251.646712002 podStartE2EDuration="4m13.346705668s" totalImagesPullingTime="1.699993666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:14:20.345470413 +0000 UTC m=+288.461288564" watchObservedRunningTime="2026-06-08 12:14:20.346705668 +0000 UTC m=+288.462523806" Jun 08 12:14:20.420746 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:20.420711 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:20.948146 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:20.948110 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:21.154868 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:21.154836 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:21.405365 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:21.405333 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:21.505932 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:21.505898 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:22.145560 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:22.145524 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:24.166159 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:24.166104 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:24.539476 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:24.539396 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:26.947007 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:26.946967 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:27.013266 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:27.013232 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:28.593775 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.593739 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f74df9c9d-vqhvm"] Jun 08 12:14:28.599402 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.599379 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:28.601917 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.601891 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 08 12:14:28.602044 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.602006 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 08 12:14:28.602114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.602099 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 08 12:14:28.602169 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.602137 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 08 12:14:28.602221 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.602209 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 08 12:14:28.602321 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.602302 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hw4wv\"" Jun 08 12:14:28.602386 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.602308 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 08 12:14:28.602386 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.602346 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 08 12:14:28.607874 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.607854 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f74df9c9d-vqhvm"] Jun 08 12:14:28.701049 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.701024 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01ed4d08-30c4-4367-bdf4-29778f61225b-console-serving-cert\") pod \"console-7f74df9c9d-vqhvm\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:28.701159 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.701059 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt7qz\" (UniqueName: \"kubernetes.io/projected/01ed4d08-30c4-4367-bdf4-29778f61225b-kube-api-access-vt7qz\") pod \"console-7f74df9c9d-vqhvm\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:28.701221 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.701152 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01ed4d08-30c4-4367-bdf4-29778f61225b-console-oauth-config\") pod \"console-7f74df9c9d-vqhvm\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:28.701221 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.701178 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01ed4d08-30c4-4367-bdf4-29778f61225b-service-ca\") pod \"console-7f74df9c9d-vqhvm\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:28.701221 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.701207 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01ed4d08-30c4-4367-bdf4-29778f61225b-console-config\") pod \"console-7f74df9c9d-vqhvm\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:28.701311 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.701223 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01ed4d08-30c4-4367-bdf4-29778f61225b-oauth-serving-cert\") pod \"console-7f74df9c9d-vqhvm\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:28.801962 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.801940 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01ed4d08-30c4-4367-bdf4-29778f61225b-console-config\") pod \"console-7f74df9c9d-vqhvm\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:28.802067 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.801967 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01ed4d08-30c4-4367-bdf4-29778f61225b-oauth-serving-cert\") pod \"console-7f74df9c9d-vqhvm\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:28.802067 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.801998 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01ed4d08-30c4-4367-bdf4-29778f61225b-console-serving-cert\") pod \"console-7f74df9c9d-vqhvm\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:28.802067 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.802027 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt7qz\" (UniqueName: \"kubernetes.io/projected/01ed4d08-30c4-4367-bdf4-29778f61225b-kube-api-access-vt7qz\") pod \"console-7f74df9c9d-vqhvm\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:28.802213 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.802103 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01ed4d08-30c4-4367-bdf4-29778f61225b-console-oauth-config\") pod \"console-7f74df9c9d-vqhvm\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:28.802213 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.802129 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01ed4d08-30c4-4367-bdf4-29778f61225b-service-ca\") pod \"console-7f74df9c9d-vqhvm\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:28.802744 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.802724 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01ed4d08-30c4-4367-bdf4-29778f61225b-service-ca\") pod \"console-7f74df9c9d-vqhvm\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:28.802874 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.802733 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01ed4d08-30c4-4367-bdf4-29778f61225b-console-config\") pod \"console-7f74df9c9d-vqhvm\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:28.802874 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.802741 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01ed4d08-30c4-4367-bdf4-29778f61225b-oauth-serving-cert\") pod \"console-7f74df9c9d-vqhvm\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:28.804531 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.804513 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01ed4d08-30c4-4367-bdf4-29778f61225b-console-oauth-config\") pod \"console-7f74df9c9d-vqhvm\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:28.804594 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.804577 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01ed4d08-30c4-4367-bdf4-29778f61225b-console-serving-cert\") pod \"console-7f74df9c9d-vqhvm\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:28.809851 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.809829 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt7qz\" (UniqueName: \"kubernetes.io/projected/01ed4d08-30c4-4367-bdf4-29778f61225b-kube-api-access-vt7qz\") pod \"console-7f74df9c9d-vqhvm\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:28.909734 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:28.909702 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:29.036237 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:29.036213 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f74df9c9d-vqhvm"] Jun 08 12:14:29.038212 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:14:29.038187 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ed4d08_30c4_4367_bdf4_29778f61225b.slice/crio-f694c7cbd6476018167f123892dcf2dab6ce3018862fefe115a04f3c1b234e1f WatchSource:0}: Error finding container f694c7cbd6476018167f123892dcf2dab6ce3018862fefe115a04f3c1b234e1f: Status 404 returned error can't find the container with id f694c7cbd6476018167f123892dcf2dab6ce3018862fefe115a04f3c1b234e1f Jun 08 12:14:29.138555 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:29.138513 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:29.243204 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:29.243129 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:29.364230 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:29.364196 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f74df9c9d-vqhvm" event={"ID":"01ed4d08-30c4-4367-bdf4-29778f61225b","Type":"ContainerStarted","Data":"f694c7cbd6476018167f123892dcf2dab6ce3018862fefe115a04f3c1b234e1f"} Jun 08 12:14:30.334954 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:30.334918 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g28p2" Jun 08 12:14:31.375778 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:31.375737 2565 generic.go:356] "Generic (PLEG): container finished" podID="4b9681e8-a3af-4356-b6fc-f87994ccf29b" containerID="8f39726b949c5fc1bd2c8408dded282044dae7ce1f7ae92f947edc737aa22ecd" exitCode=0 Jun 08 12:14:31.376197 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:31.375829 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-l2pq7" event={"ID":"4b9681e8-a3af-4356-b6fc-f87994ccf29b","Type":"ContainerDied","Data":"8f39726b949c5fc1bd2c8408dded282044dae7ce1f7ae92f947edc737aa22ecd"} Jun 08 12:14:31.376263 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:31.376225 2565 scope.go:117] "RemoveContainer" containerID="8f39726b949c5fc1bd2c8408dded282044dae7ce1f7ae92f947edc737aa22ecd" Jun 08 12:14:32.433455 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:32.433426 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/2.log" Jun 08 12:14:32.434777 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:32.434751 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/2.log" Jun 08 12:14:32.446832 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:32.446792 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwxhk_1aa340eb-58d2-4e29-9cbd-4f1b831abf58/ovn-acl-logging/0.log" Jun 08 12:14:32.447881 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:32.447864 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwxhk_1aa340eb-58d2-4e29-9cbd-4f1b831abf58/ovn-acl-logging/0.log" Jun 08 12:14:32.454510 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:32.454491 2565 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 12:14:32.471781 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:32.471751 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:32.572683 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:32.572646 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:32.673067 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:32.673035 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:32.774119 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:32.774086 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:33.386940 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:33.386901 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f74df9c9d-vqhvm" event={"ID":"01ed4d08-30c4-4367-bdf4-29778f61225b","Type":"ContainerStarted","Data":"db9d139a9cfe1815ec0dd93de21278a474bb7a770586a5dc7802cc06f0e178b4"} Jun 08 12:14:33.388784 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:33.388763 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-l2pq7" event={"ID":"4b9681e8-a3af-4356-b6fc-f87994ccf29b","Type":"ContainerStarted","Data":"1a9743a365c773a714b0b50cb1e3383d64e452aced87e71f03882570b7a392d4"} Jun 08 12:14:33.405335 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:33.405293 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f74df9c9d-vqhvm" podStartSLOduration=2.023052798 podStartE2EDuration="5.405280486s" totalImagesPullingTime="3.382227688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:14:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:14:33.404520695 +0000 UTC m=+301.520338834" watchObservedRunningTime="2026-06-08 12:14:33.405280486 +0000 UTC m=+301.521098624" Jun 08 12:14:36.402690 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.402658 2565 generic.go:356] "Generic (PLEG): container finished" podID="cf16c9e4-8b0b-45af-a63d-bb5497a6908d" containerID="b1c290e009cd78410cba50b00d1bbdd9e7c4bbdbd2e78c4e116bef2438921fd3" exitCode=0 Jun 08 12:14:36.403165 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.402735 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vzg7c" event={"ID":"cf16c9e4-8b0b-45af-a63d-bb5497a6908d","Type":"ContainerDied","Data":"b1c290e009cd78410cba50b00d1bbdd9e7c4bbdbd2e78c4e116bef2438921fd3"} Jun 08 12:14:36.403165 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.403126 2565 scope.go:117] "RemoveContainer" containerID="b1c290e009cd78410cba50b00d1bbdd9e7c4bbdbd2e78c4e116bef2438921fd3" Jun 08 12:14:36.541115 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.541048 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:36.660464 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.660376 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:36.730356 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.730325 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5496f9649-8ft4z"] Jun 08 12:14:36.735289 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.735260 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:36.743327 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.743304 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 08 12:14:36.743793 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.743765 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5496f9649-8ft4z"] Jun 08 12:14:36.772868 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.772838 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:36.875825 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.875785 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-console-config\") pod \"console-5496f9649-8ft4z\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:36.875825 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.875826 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-trusted-ca-bundle\") pod \"console-5496f9649-8ft4z\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:36.875967 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.875845 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/05de301a-04cc-42ec-88f9-d039cc4bb09c-console-serving-cert\") pod \"console-5496f9649-8ft4z\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:36.875967 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.875913 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljd7w\" (UniqueName: \"kubernetes.io/projected/05de301a-04cc-42ec-88f9-d039cc4bb09c-kube-api-access-ljd7w\") pod \"console-5496f9649-8ft4z\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:36.875967 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.875950 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/05de301a-04cc-42ec-88f9-d039cc4bb09c-console-oauth-config\") pod \"console-5496f9649-8ft4z\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:36.876072 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.875991 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-oauth-serving-cert\") pod \"console-5496f9649-8ft4z\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:36.876072 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.876047 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-service-ca\") pod \"console-5496f9649-8ft4z\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:36.937698 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.937632 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:36.977128 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.977108 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-console-config\") pod \"console-5496f9649-8ft4z\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:36.977232 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.977134 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-trusted-ca-bundle\") pod \"console-5496f9649-8ft4z\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:36.977232 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.977154 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/05de301a-04cc-42ec-88f9-d039cc4bb09c-console-serving-cert\") pod \"console-5496f9649-8ft4z\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:36.977232 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.977189 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljd7w\" (UniqueName: \"kubernetes.io/projected/05de301a-04cc-42ec-88f9-d039cc4bb09c-kube-api-access-ljd7w\") pod \"console-5496f9649-8ft4z\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:36.977232 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.977217 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/05de301a-04cc-42ec-88f9-d039cc4bb09c-console-oauth-config\") pod \"console-5496f9649-8ft4z\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:36.977439 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.977256 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-oauth-serving-cert\") pod \"console-5496f9649-8ft4z\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:36.977439 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.977293 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-service-ca\") pod \"console-5496f9649-8ft4z\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:36.977930 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.977906 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-console-config\") pod \"console-5496f9649-8ft4z\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:36.978061 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.978040 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-oauth-serving-cert\") pod \"console-5496f9649-8ft4z\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:36.978276 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.978260 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-service-ca\") pod \"console-5496f9649-8ft4z\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:36.978353 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.978260 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-trusted-ca-bundle\") pod \"console-5496f9649-8ft4z\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:36.979911 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.979891 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/05de301a-04cc-42ec-88f9-d039cc4bb09c-console-serving-cert\") pod \"console-5496f9649-8ft4z\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:36.980003 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.979983 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/05de301a-04cc-42ec-88f9-d039cc4bb09c-console-oauth-config\") pod \"console-5496f9649-8ft4z\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:36.985587 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:36.985568 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljd7w\" (UniqueName: \"kubernetes.io/projected/05de301a-04cc-42ec-88f9-d039cc4bb09c-kube-api-access-ljd7w\") pod \"console-5496f9649-8ft4z\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:37.046644 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:37.046617 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:37.189328 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:37.189131 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5496f9649-8ft4z"] Jun 08 12:14:37.192157 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:14:37.192124 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05de301a_04cc_42ec_88f9_d039cc4bb09c.slice/crio-e015d1dc66e900fbc254a04836353feaa843a36c6c90b53f662167d3741bd220 WatchSource:0}: Error finding container e015d1dc66e900fbc254a04836353feaa843a36c6c90b53f662167d3741bd220: Status 404 returned error can't find the container with id e015d1dc66e900fbc254a04836353feaa843a36c6c90b53f662167d3741bd220 Jun 08 12:14:37.409506 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:37.409468 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5496f9649-8ft4z" event={"ID":"05de301a-04cc-42ec-88f9-d039cc4bb09c","Type":"ContainerStarted","Data":"b7e79fc2c792bd43d0adde73a1fff696b921e3ff05c91a0feabd9a5a0cf5888c"} Jun 08 12:14:37.409942 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:37.409521 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5496f9649-8ft4z" event={"ID":"05de301a-04cc-42ec-88f9-d039cc4bb09c","Type":"ContainerStarted","Data":"e015d1dc66e900fbc254a04836353feaa843a36c6c90b53f662167d3741bd220"} Jun 08 12:14:37.411292 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:37.411270 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-vzg7c" event={"ID":"cf16c9e4-8b0b-45af-a63d-bb5497a6908d","Type":"ContainerStarted","Data":"7cc910c69fc2726b8ffa07d12b8679bea39414aabba722273141530fe0b1580b"} Jun 08 12:14:37.428125 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:37.428082 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5496f9649-8ft4z" podStartSLOduration=1.428069019 podStartE2EDuration="1.428069019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:14:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:14:37.427157376 +0000 UTC m=+305.542975513" watchObservedRunningTime="2026-06-08 12:14:37.428069019 +0000 UTC m=+305.543887157" Jun 08 12:14:38.910433 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:38.910403 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:38.910801 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:38.910474 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:38.915117 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:38.915090 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:39.234045 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:39.233964 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:39.295667 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:39.295636 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:39.377463 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:39.377436 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:39.424576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:39.424552 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:14:39.444766 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:39.444740 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:39.946980 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:39.946922 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:40.017007 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:40.013964 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:41.396250 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:41.396217 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:41.496654 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:41.496616 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:41.597666 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:41.597633 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:41.957154 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:41.957100 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:42.028095 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:42.028063 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:43.884230 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:43.884191 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:43.985870 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:43.985805 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:44.049978 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:44.049949 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:45.564462 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:45.564420 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:45.695072 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:45.695037 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:47.047648 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:47.047611 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:47.048124 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:47.047671 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:47.052532 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:47.052509 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:47.459019 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:47.458989 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:14:47.510269 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:47.510223 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f74df9c9d-vqhvm"] Jun 08 12:14:48.250613 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:48.250568 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:48.351351 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:48.351312 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:51.019767 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:51.019728 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:51.081020 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:51.080989 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:51.779619 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:51.779581 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:51.881655 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:51.881627 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:55.496100 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:55.496065 2565 generic.go:356] "Generic (PLEG): container finished" podID="3c6f655c-0584-4430-87ec-ead19aa53dd0" containerID="3cca16001d7d015c791b55409d536fb05e627f6ee45034d94dce7ec6660fdd91" exitCode=0 Jun 08 12:14:55.496423 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:55.496140 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-86bvt" event={"ID":"3c6f655c-0584-4430-87ec-ead19aa53dd0","Type":"ContainerDied","Data":"3cca16001d7d015c791b55409d536fb05e627f6ee45034d94dce7ec6660fdd91"} Jun 08 12:14:55.496470 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:55.496434 2565 scope.go:117] "RemoveContainer" containerID="3cca16001d7d015c791b55409d536fb05e627f6ee45034d94dce7ec6660fdd91" Jun 08 12:14:56.111749 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:56.111711 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:56.169511 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:56.169480 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:14:56.342981 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:56.342950 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6rnhx_5bcb07d4-39cc-41fa-bf34-e7d119414144/node-ca/0.log" Jun 08 12:14:56.502000 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:14:56.501963 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-86bvt" event={"ID":"3c6f655c-0584-4430-87ec-ead19aa53dd0","Type":"ContainerStarted","Data":"a4b7862fb181821ee175d57dcb8be282bc9a49be7652acb06de6a86dff041382"} Jun 08 12:15:06.781577 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:06.781547 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:06.862561 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:06.862528 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:12.531937 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:12.531896 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f74df9c9d-vqhvm" podUID="01ed4d08-30c4-4367-bdf4-29778f61225b" containerName="console" containerID="cri-o://db9d139a9cfe1815ec0dd93de21278a474bb7a770586a5dc7802cc06f0e178b4" gracePeriod=15 Jun 08 12:15:12.784735 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:12.784685 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:15:12.884657 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:12.884627 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01ed4d08-30c4-4367-bdf4-29778f61225b-console-config\") pod \"01ed4d08-30c4-4367-bdf4-29778f61225b\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " Jun 08 12:15:12.884789 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:12.884694 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01ed4d08-30c4-4367-bdf4-29778f61225b-service-ca\") pod \"01ed4d08-30c4-4367-bdf4-29778f61225b\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " Jun 08 12:15:12.884789 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:12.884720 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01ed4d08-30c4-4367-bdf4-29778f61225b-oauth-serving-cert\") pod \"01ed4d08-30c4-4367-bdf4-29778f61225b\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " Jun 08 12:15:12.884789 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:12.884744 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01ed4d08-30c4-4367-bdf4-29778f61225b-console-oauth-config\") pod \"01ed4d08-30c4-4367-bdf4-29778f61225b\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " Jun 08 12:15:12.884789 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:12.884785 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vt7qz\" (UniqueName: \"kubernetes.io/projected/01ed4d08-30c4-4367-bdf4-29778f61225b-kube-api-access-vt7qz\") pod \"01ed4d08-30c4-4367-bdf4-29778f61225b\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " Jun 08 12:15:12.885021 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:12.884834 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01ed4d08-30c4-4367-bdf4-29778f61225b-console-serving-cert\") pod \"01ed4d08-30c4-4367-bdf4-29778f61225b\" (UID: \"01ed4d08-30c4-4367-bdf4-29778f61225b\") " Jun 08 12:15:12.885178 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:12.885153 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01ed4d08-30c4-4367-bdf4-29778f61225b-console-config" (OuterVolumeSpecName: "console-config") pod "01ed4d08-30c4-4367-bdf4-29778f61225b" (UID: "01ed4d08-30c4-4367-bdf4-29778f61225b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:15:12.885264 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:12.885150 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01ed4d08-30c4-4367-bdf4-29778f61225b-service-ca" (OuterVolumeSpecName: "service-ca") pod "01ed4d08-30c4-4367-bdf4-29778f61225b" (UID: "01ed4d08-30c4-4367-bdf4-29778f61225b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:15:12.885264 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:12.885181 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01ed4d08-30c4-4367-bdf4-29778f61225b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "01ed4d08-30c4-4367-bdf4-29778f61225b" (UID: "01ed4d08-30c4-4367-bdf4-29778f61225b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:15:12.887118 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:12.887097 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01ed4d08-30c4-4367-bdf4-29778f61225b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "01ed4d08-30c4-4367-bdf4-29778f61225b" (UID: "01ed4d08-30c4-4367-bdf4-29778f61225b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:15:12.887118 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:12.887096 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01ed4d08-30c4-4367-bdf4-29778f61225b-kube-api-access-vt7qz" (OuterVolumeSpecName: "kube-api-access-vt7qz") pod "01ed4d08-30c4-4367-bdf4-29778f61225b" (UID: "01ed4d08-30c4-4367-bdf4-29778f61225b"). InnerVolumeSpecName "kube-api-access-vt7qz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:15:12.887322 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:12.887121 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01ed4d08-30c4-4367-bdf4-29778f61225b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "01ed4d08-30c4-4367-bdf4-29778f61225b" (UID: "01ed4d08-30c4-4367-bdf4-29778f61225b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:15:12.986323 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:12.986287 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01ed4d08-30c4-4367-bdf4-29778f61225b-console-config\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:15:12.986323 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:12.986322 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01ed4d08-30c4-4367-bdf4-29778f61225b-service-ca\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:15:12.986323 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:12.986331 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01ed4d08-30c4-4367-bdf4-29778f61225b-oauth-serving-cert\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:15:12.986499 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:12.986339 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01ed4d08-30c4-4367-bdf4-29778f61225b-console-oauth-config\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:15:12.986499 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:12.986347 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vt7qz\" (UniqueName: \"kubernetes.io/projected/01ed4d08-30c4-4367-bdf4-29778f61225b-kube-api-access-vt7qz\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:15:12.986499 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:12.986356 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01ed4d08-30c4-4367-bdf4-29778f61225b-console-serving-cert\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:15:13.588878 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:13.588846 2565 generic.go:356] "Generic (PLEG): container finished" podID="01ed4d08-30c4-4367-bdf4-29778f61225b" containerID="db9d139a9cfe1815ec0dd93de21278a474bb7a770586a5dc7802cc06f0e178b4" exitCode=0 Jun 08 12:15:13.589330 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:13.588933 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f74df9c9d-vqhvm" Jun 08 12:15:13.589330 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:13.588977 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f74df9c9d-vqhvm" event={"ID":"01ed4d08-30c4-4367-bdf4-29778f61225b","Type":"ContainerDied","Data":"db9d139a9cfe1815ec0dd93de21278a474bb7a770586a5dc7802cc06f0e178b4"} Jun 08 12:15:13.589330 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:13.589026 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f74df9c9d-vqhvm" event={"ID":"01ed4d08-30c4-4367-bdf4-29778f61225b","Type":"ContainerDied","Data":"f694c7cbd6476018167f123892dcf2dab6ce3018862fefe115a04f3c1b234e1f"} Jun 08 12:15:13.589330 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:13.589048 2565 scope.go:117] "RemoveContainer" containerID="db9d139a9cfe1815ec0dd93de21278a474bb7a770586a5dc7802cc06f0e178b4" Jun 08 12:15:13.598720 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:13.598705 2565 scope.go:117] "RemoveContainer" containerID="db9d139a9cfe1815ec0dd93de21278a474bb7a770586a5dc7802cc06f0e178b4" Jun 08 12:15:13.599010 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:15:13.598986 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db9d139a9cfe1815ec0dd93de21278a474bb7a770586a5dc7802cc06f0e178b4\": container with ID starting with db9d139a9cfe1815ec0dd93de21278a474bb7a770586a5dc7802cc06f0e178b4 not found: ID does not exist" containerID="db9d139a9cfe1815ec0dd93de21278a474bb7a770586a5dc7802cc06f0e178b4" Jun 08 12:15:13.599101 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:13.599014 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db9d139a9cfe1815ec0dd93de21278a474bb7a770586a5dc7802cc06f0e178b4"} err="failed to get container status \"db9d139a9cfe1815ec0dd93de21278a474bb7a770586a5dc7802cc06f0e178b4\": rpc error: code = NotFound desc = could not find container \"db9d139a9cfe1815ec0dd93de21278a474bb7a770586a5dc7802cc06f0e178b4\": container with ID starting with db9d139a9cfe1815ec0dd93de21278a474bb7a770586a5dc7802cc06f0e178b4 not found: ID does not exist" Jun 08 12:15:13.612218 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:13.612191 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f74df9c9d-vqhvm"] Jun 08 12:15:13.616903 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:13.616884 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f74df9c9d-vqhvm"] Jun 08 12:15:14.347377 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:14.347340 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01ed4d08-30c4-4367-bdf4-29778f61225b" path="/var/lib/kubelet/pods/01ed4d08-30c4-4367-bdf4-29778f61225b/volumes" Jun 08 12:15:17.144579 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:17.144542 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:17.244287 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:17.244244 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:20.180343 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:20.180299 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:20.248303 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:20.248264 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:24.417889 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:24.417859 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:15:24.418358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:24.418149 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="alertmanager" containerID="cri-o://1084b10ecc69bedf898928282e1e32f98a76091f9cfb45703f77f8f14406fa19" gracePeriod=120 Jun 08 12:15:24.418358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:24.418193 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="config-reloader" containerID="cri-o://8069705aa5ab32842d7fb8cf49e7f4df7f81bb05e62064037dfadf06ec49386c" gracePeriod=120 Jun 08 12:15:24.418358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:24.418195 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="prom-label-proxy" containerID="cri-o://98aec2c3fc803ff6eac37ce66d49551735bfd2939519247a0f41f82b1dd78bb4" gracePeriod=120 Jun 08 12:15:24.418358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:24.418213 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="kube-rbac-proxy-web" containerID="cri-o://66ac42abc9e96288b1590ea41683e6e7f44ddb0f24a527aff5611a65eea53eee" gracePeriod=120 Jun 08 12:15:24.418358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:24.418237 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="kube-rbac-proxy" containerID="cri-o://d1a9d43b1a17aec75e144ec6ba072baa43475fdf20b4c6f4d7ef278962ccd090" gracePeriod=120 Jun 08 12:15:24.418358 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:24.418155 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="kube-rbac-proxy-metric" containerID="cri-o://e9b95cf92cd76ee2927a2abf328f7500a0ec8f1da2fea1dc5d29cefad40d8010" gracePeriod=120 Jun 08 12:15:24.644758 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:24.644724 2565 generic.go:356] "Generic (PLEG): container finished" podID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerID="98aec2c3fc803ff6eac37ce66d49551735bfd2939519247a0f41f82b1dd78bb4" exitCode=0 Jun 08 12:15:24.644758 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:24.644751 2565 generic.go:356] "Generic (PLEG): container finished" podID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerID="d1a9d43b1a17aec75e144ec6ba072baa43475fdf20b4c6f4d7ef278962ccd090" exitCode=0 Jun 08 12:15:24.644758 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:24.644758 2565 generic.go:356] "Generic (PLEG): container finished" podID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerID="8069705aa5ab32842d7fb8cf49e7f4df7f81bb05e62064037dfadf06ec49386c" exitCode=0 Jun 08 12:15:24.644758 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:24.644764 2565 generic.go:356] "Generic (PLEG): container finished" podID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerID="1084b10ecc69bedf898928282e1e32f98a76091f9cfb45703f77f8f14406fa19" exitCode=0 Jun 08 12:15:24.645011 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:24.644779 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f3297f5f-682a-4e43-a607-f4bcf92fff95","Type":"ContainerDied","Data":"98aec2c3fc803ff6eac37ce66d49551735bfd2939519247a0f41f82b1dd78bb4"} Jun 08 12:15:24.645011 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:24.644860 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f3297f5f-682a-4e43-a607-f4bcf92fff95","Type":"ContainerDied","Data":"d1a9d43b1a17aec75e144ec6ba072baa43475fdf20b4c6f4d7ef278962ccd090"} Jun 08 12:15:24.645011 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:24.644888 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f3297f5f-682a-4e43-a607-f4bcf92fff95","Type":"ContainerDied","Data":"8069705aa5ab32842d7fb8cf49e7f4df7f81bb05e62064037dfadf06ec49386c"} Jun 08 12:15:24.645011 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:24.644919 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f3297f5f-682a-4e43-a607-f4bcf92fff95","Type":"ContainerDied","Data":"1084b10ecc69bedf898928282e1e32f98a76091f9cfb45703f77f8f14406fa19"} Jun 08 12:15:25.657392 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.657361 2565 generic.go:356] "Generic (PLEG): container finished" podID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerID="e9b95cf92cd76ee2927a2abf328f7500a0ec8f1da2fea1dc5d29cefad40d8010" exitCode=0 Jun 08 12:15:25.657392 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.657385 2565 generic.go:356] "Generic (PLEG): container finished" podID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerID="66ac42abc9e96288b1590ea41683e6e7f44ddb0f24a527aff5611a65eea53eee" exitCode=0 Jun 08 12:15:25.657839 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.657444 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f3297f5f-682a-4e43-a607-f4bcf92fff95","Type":"ContainerDied","Data":"e9b95cf92cd76ee2927a2abf328f7500a0ec8f1da2fea1dc5d29cefad40d8010"} Jun 08 12:15:25.657839 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.657505 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f3297f5f-682a-4e43-a607-f4bcf92fff95","Type":"ContainerDied","Data":"66ac42abc9e96288b1590ea41683e6e7f44ddb0f24a527aff5611a65eea53eee"} Jun 08 12:15:25.683189 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.683168 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:25.795690 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.795619 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-kube-rbac-proxy\") pod \"f3297f5f-682a-4e43-a607-f4bcf92fff95\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " Jun 08 12:15:25.795690 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.795661 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-cluster-tls-config\") pod \"f3297f5f-682a-4e43-a607-f4bcf92fff95\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " Jun 08 12:15:25.795690 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.795681 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfxmq\" (UniqueName: \"kubernetes.io/projected/f3297f5f-682a-4e43-a607-f4bcf92fff95-kube-api-access-dfxmq\") pod \"f3297f5f-682a-4e43-a607-f4bcf92fff95\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " Jun 08 12:15:25.796000 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.795704 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3297f5f-682a-4e43-a607-f4bcf92fff95-tls-assets\") pod \"f3297f5f-682a-4e43-a607-f4bcf92fff95\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " Jun 08 12:15:25.796000 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.795721 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-web-config\") pod \"f3297f5f-682a-4e43-a607-f4bcf92fff95\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " Jun 08 12:15:25.796000 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.795743 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-config-volume\") pod \"f3297f5f-682a-4e43-a607-f4bcf92fff95\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " Jun 08 12:15:25.796000 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.795768 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-kube-rbac-proxy-web\") pod \"f3297f5f-682a-4e43-a607-f4bcf92fff95\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " Jun 08 12:15:25.796000 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.795793 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3297f5f-682a-4e43-a607-f4bcf92fff95-config-out\") pod \"f3297f5f-682a-4e43-a607-f4bcf92fff95\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " Jun 08 12:15:25.796000 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.795893 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-kube-rbac-proxy-metric\") pod \"f3297f5f-682a-4e43-a607-f4bcf92fff95\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " Jun 08 12:15:25.796000 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.795922 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3297f5f-682a-4e43-a607-f4bcf92fff95-alertmanager-trusted-ca-bundle\") pod \"f3297f5f-682a-4e43-a607-f4bcf92fff95\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " Jun 08 12:15:25.796000 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.795983 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f3297f5f-682a-4e43-a607-f4bcf92fff95-alertmanager-main-db\") pod \"f3297f5f-682a-4e43-a607-f4bcf92fff95\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " Jun 08 12:15:25.796388 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.796014 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3297f5f-682a-4e43-a607-f4bcf92fff95-metrics-client-ca\") pod \"f3297f5f-682a-4e43-a607-f4bcf92fff95\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " Jun 08 12:15:25.796388 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.796044 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-main-tls\") pod \"f3297f5f-682a-4e43-a607-f4bcf92fff95\" (UID: \"f3297f5f-682a-4e43-a607-f4bcf92fff95\") " Jun 08 12:15:25.799324 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.798753 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "f3297f5f-682a-4e43-a607-f4bcf92fff95" (UID: "f3297f5f-682a-4e43-a607-f4bcf92fff95"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:15:25.799324 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.798778 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3297f5f-682a-4e43-a607-f4bcf92fff95-kube-api-access-dfxmq" (OuterVolumeSpecName: "kube-api-access-dfxmq") pod "f3297f5f-682a-4e43-a607-f4bcf92fff95" (UID: "f3297f5f-682a-4e43-a607-f4bcf92fff95"). InnerVolumeSpecName "kube-api-access-dfxmq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:15:25.799324 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.799115 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-config-volume" (OuterVolumeSpecName: "config-volume") pod "f3297f5f-682a-4e43-a607-f4bcf92fff95" (UID: "f3297f5f-682a-4e43-a607-f4bcf92fff95"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:15:25.799324 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.799132 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3297f5f-682a-4e43-a607-f4bcf92fff95-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "f3297f5f-682a-4e43-a607-f4bcf92fff95" (UID: "f3297f5f-682a-4e43-a607-f4bcf92fff95"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:15:25.799610 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.799463 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3297f5f-682a-4e43-a607-f4bcf92fff95-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "f3297f5f-682a-4e43-a607-f4bcf92fff95" (UID: "f3297f5f-682a-4e43-a607-f4bcf92fff95"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:15:25.799610 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.799493 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3297f5f-682a-4e43-a607-f4bcf92fff95-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "f3297f5f-682a-4e43-a607-f4bcf92fff95" (UID: "f3297f5f-682a-4e43-a607-f4bcf92fff95"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:15:25.799717 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.799628 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "f3297f5f-682a-4e43-a607-f4bcf92fff95" (UID: "f3297f5f-682a-4e43-a607-f4bcf92fff95"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:15:25.799934 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.799893 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "f3297f5f-682a-4e43-a607-f4bcf92fff95" (UID: "f3297f5f-682a-4e43-a607-f4bcf92fff95"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:15:25.799934 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.799905 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3297f5f-682a-4e43-a607-f4bcf92fff95-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f3297f5f-682a-4e43-a607-f4bcf92fff95" (UID: "f3297f5f-682a-4e43-a607-f4bcf92fff95"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:15:25.800775 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.800747 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "f3297f5f-682a-4e43-a607-f4bcf92fff95" (UID: "f3297f5f-682a-4e43-a607-f4bcf92fff95"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:15:25.801228 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.801205 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3297f5f-682a-4e43-a607-f4bcf92fff95-config-out" (OuterVolumeSpecName: "config-out") pod "f3297f5f-682a-4e43-a607-f4bcf92fff95" (UID: "f3297f5f-682a-4e43-a607-f4bcf92fff95"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:15:25.803187 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.803164 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "f3297f5f-682a-4e43-a607-f4bcf92fff95" (UID: "f3297f5f-682a-4e43-a607-f4bcf92fff95"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:15:25.811269 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.811247 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-web-config" (OuterVolumeSpecName: "web-config") pod "f3297f5f-682a-4e43-a607-f4bcf92fff95" (UID: "f3297f5f-682a-4e43-a607-f4bcf92fff95"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:15:25.897415 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.897376 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:15:25.897415 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.897410 2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-cluster-tls-config\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:15:25.897415 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.897421 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfxmq\" (UniqueName: \"kubernetes.io/projected/f3297f5f-682a-4e43-a607-f4bcf92fff95-kube-api-access-dfxmq\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:15:25.897593 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.897430 2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f3297f5f-682a-4e43-a607-f4bcf92fff95-tls-assets\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:15:25.897593 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.897440 2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-web-config\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:15:25.897593 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.897448 2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-config-volume\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:15:25.897593 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.897455 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:15:25.897593 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.897463 2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f3297f5f-682a-4e43-a607-f4bcf92fff95-config-out\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:15:25.897593 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.897471 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:15:25.897593 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.897480 2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3297f5f-682a-4e43-a607-f4bcf92fff95-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:15:25.897593 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.897489 2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f3297f5f-682a-4e43-a607-f4bcf92fff95-alertmanager-main-db\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:15:25.897593 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.897497 2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3297f5f-682a-4e43-a607-f4bcf92fff95-metrics-client-ca\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:15:25.897593 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:25.897506 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f3297f5f-682a-4e43-a607-f4bcf92fff95-secret-alertmanager-main-tls\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:15:26.665484 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.665437 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f3297f5f-682a-4e43-a607-f4bcf92fff95","Type":"ContainerDied","Data":"01db2e20a7810bb7ae6d05d80e59ce4f50e4513ddd002177404d7b81a26a1d8c"} Jun 08 12:15:26.665925 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.665455 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.665925 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.665566 2565 scope.go:117] "RemoveContainer" containerID="98aec2c3fc803ff6eac37ce66d49551735bfd2939519247a0f41f82b1dd78bb4" Jun 08 12:15:26.674158 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.674143 2565 scope.go:117] "RemoveContainer" containerID="e9b95cf92cd76ee2927a2abf328f7500a0ec8f1da2fea1dc5d29cefad40d8010" Jun 08 12:15:26.681108 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.681089 2565 scope.go:117] "RemoveContainer" containerID="d1a9d43b1a17aec75e144ec6ba072baa43475fdf20b4c6f4d7ef278962ccd090" Jun 08 12:15:26.688194 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.688173 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:15:26.688467 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.688448 2565 scope.go:117] "RemoveContainer" containerID="66ac42abc9e96288b1590ea41683e6e7f44ddb0f24a527aff5611a65eea53eee" Jun 08 12:15:26.692404 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.692384 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:15:26.695643 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.695623 2565 scope.go:117] "RemoveContainer" containerID="8069705aa5ab32842d7fb8cf49e7f4df7f81bb05e62064037dfadf06ec49386c" Jun 08 12:15:26.702633 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.702616 2565 scope.go:117] "RemoveContainer" containerID="1084b10ecc69bedf898928282e1e32f98a76091f9cfb45703f77f8f14406fa19" Jun 08 12:15:26.709879 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.709862 2565 scope.go:117] "RemoveContainer" containerID="0130669bcdb2409cab8392d3086267401920134db5957b0b4a1e15deb01e9353" Jun 08 12:15:26.718101 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718084 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:15:26.718389 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718378 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="init-config-reloader" Jun 08 12:15:26.718431 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718392 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="init-config-reloader" Jun 08 12:15:26.718431 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718411 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01ed4d08-30c4-4367-bdf4-29778f61225b" containerName="console" Jun 08 12:15:26.718431 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718416 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="01ed4d08-30c4-4367-bdf4-29778f61225b" containerName="console" Jun 08 12:15:26.718431 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718425 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="prom-label-proxy" Jun 08 12:15:26.718431 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718430 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="prom-label-proxy" Jun 08 12:15:26.718576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718438 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="alertmanager" Jun 08 12:15:26.718576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718444 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="alertmanager" Jun 08 12:15:26.718576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718449 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="kube-rbac-proxy" Jun 08 12:15:26.718576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718454 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="kube-rbac-proxy" Jun 08 12:15:26.718576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718464 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="config-reloader" Jun 08 12:15:26.718576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718468 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="config-reloader" Jun 08 12:15:26.718576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718474 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="kube-rbac-proxy-web" Jun 08 12:15:26.718576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718480 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="kube-rbac-proxy-web" Jun 08 12:15:26.718576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718487 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="kube-rbac-proxy-metric" Jun 08 12:15:26.718576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718492 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="kube-rbac-proxy-metric" Jun 08 12:15:26.718576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718539 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="kube-rbac-proxy" Jun 08 12:15:26.718576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718547 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="prom-label-proxy" Jun 08 12:15:26.718576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718553 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="kube-rbac-proxy-web" Jun 08 12:15:26.718576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718559 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="kube-rbac-proxy-metric" Jun 08 12:15:26.718576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718565 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="config-reloader" Jun 08 12:15:26.718576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718572 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="01ed4d08-30c4-4367-bdf4-29778f61225b" containerName="console" Jun 08 12:15:26.718576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.718579 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" containerName="alertmanager" Jun 08 12:15:26.724975 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.724958 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.727750 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.727723 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 12:15:26.727916 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.727755 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 12:15:26.727916 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.727786 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 12:15:26.727916 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.727806 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 12:15:26.727916 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.727842 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hnsng\"" Jun 08 12:15:26.727916 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.727907 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 12:15:26.728171 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.727909 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 12:15:26.728224 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.728171 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 12:15:26.728224 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.728213 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 12:15:26.733028 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.733008 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 12:15:26.740001 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.739981 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:15:26.807082 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.807058 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bc670b01-93b4-4f83-8451-4726403eaa46-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.807188 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.807107 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc670b01-93b4-4f83-8451-4726403eaa46-config-out\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.807188 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.807123 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc670b01-93b4-4f83-8451-4726403eaa46-web-config\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.807273 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.807197 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc670b01-93b4-4f83-8451-4726403eaa46-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.807273 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.807237 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bc670b01-93b4-4f83-8451-4726403eaa46-config-volume\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.807273 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.807253 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bc670b01-93b4-4f83-8451-4726403eaa46-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.807373 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.807274 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bc670b01-93b4-4f83-8451-4726403eaa46-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.807373 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.807318 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72z4p\" (UniqueName: \"kubernetes.io/projected/bc670b01-93b4-4f83-8451-4726403eaa46-kube-api-access-72z4p\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.807373 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.807336 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bc670b01-93b4-4f83-8451-4726403eaa46-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.807373 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.807360 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc670b01-93b4-4f83-8451-4726403eaa46-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.807490 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.807391 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc670b01-93b4-4f83-8451-4726403eaa46-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.807490 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.807407 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc670b01-93b4-4f83-8451-4726403eaa46-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.807490 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.807431 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc670b01-93b4-4f83-8451-4726403eaa46-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.907990 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.907964 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bc670b01-93b4-4f83-8451-4726403eaa46-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.908137 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.908003 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72z4p\" (UniqueName: \"kubernetes.io/projected/bc670b01-93b4-4f83-8451-4726403eaa46-kube-api-access-72z4p\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.908137 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.908032 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bc670b01-93b4-4f83-8451-4726403eaa46-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.908137 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.908059 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc670b01-93b4-4f83-8451-4726403eaa46-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.908324 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.908295 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc670b01-93b4-4f83-8451-4726403eaa46-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.908451 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.908342 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc670b01-93b4-4f83-8451-4726403eaa46-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.908451 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.908387 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc670b01-93b4-4f83-8451-4726403eaa46-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.908451 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.908419 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bc670b01-93b4-4f83-8451-4726403eaa46-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.908615 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.908480 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc670b01-93b4-4f83-8451-4726403eaa46-config-out\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.908615 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.908503 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc670b01-93b4-4f83-8451-4726403eaa46-web-config\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.908615 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.908536 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc670b01-93b4-4f83-8451-4726403eaa46-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.908615 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.908574 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bc670b01-93b4-4f83-8451-4726403eaa46-config-volume\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.908615 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.908597 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bc670b01-93b4-4f83-8451-4726403eaa46-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.909252 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.909227 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc670b01-93b4-4f83-8451-4726403eaa46-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.909705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.909678 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc670b01-93b4-4f83-8451-4726403eaa46-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.910021 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.909999 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bc670b01-93b4-4f83-8451-4726403eaa46-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.911323 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.911300 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bc670b01-93b4-4f83-8451-4726403eaa46-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.911424 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.911300 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bc670b01-93b4-4f83-8451-4726403eaa46-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.911850 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.911552 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bc670b01-93b4-4f83-8451-4726403eaa46-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.912268 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.912247 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bc670b01-93b4-4f83-8451-4726403eaa46-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.912343 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.912276 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc670b01-93b4-4f83-8451-4726403eaa46-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.912343 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.912280 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc670b01-93b4-4f83-8451-4726403eaa46-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.912696 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.912677 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bc670b01-93b4-4f83-8451-4726403eaa46-config-volume\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.913843 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.913806 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bc670b01-93b4-4f83-8451-4726403eaa46-config-out\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.914012 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.913993 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bc670b01-93b4-4f83-8451-4726403eaa46-web-config\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:26.916686 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:26.916635 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72z4p\" (UniqueName: \"kubernetes.io/projected/bc670b01-93b4-4f83-8451-4726403eaa46-kube-api-access-72z4p\") pod \"alertmanager-main-0\" (UID: \"bc670b01-93b4-4f83-8451-4726403eaa46\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:27.034880 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:27.034852 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 12:15:27.174086 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:15:27.174048 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc670b01_93b4_4f83_8451_4726403eaa46.slice/crio-1e7b986cb4484dc61ac5614c44b084311983b9ec78bbd023fe1622ecb60c726f WatchSource:0}: Error finding container 1e7b986cb4484dc61ac5614c44b084311983b9ec78bbd023fe1622ecb60c726f: Status 404 returned error can't find the container with id 1e7b986cb4484dc61ac5614c44b084311983b9ec78bbd023fe1622ecb60c726f Jun 08 12:15:27.177521 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:27.177497 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 12:15:27.675755 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:27.675721 2565 generic.go:356] "Generic (PLEG): container finished" podID="bc670b01-93b4-4f83-8451-4726403eaa46" containerID="e7f4d16068208f52457ba7d05286dc1bb9dc7a883c34e85599e4176170a6e115" exitCode=0 Jun 08 12:15:27.676237 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:27.675777 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc670b01-93b4-4f83-8451-4726403eaa46","Type":"ContainerDied","Data":"e7f4d16068208f52457ba7d05286dc1bb9dc7a883c34e85599e4176170a6e115"} Jun 08 12:15:27.676237 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:27.675864 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc670b01-93b4-4f83-8451-4726403eaa46","Type":"ContainerStarted","Data":"1e7b986cb4484dc61ac5614c44b084311983b9ec78bbd023fe1622ecb60c726f"} Jun 08 12:15:28.346951 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:28.346870 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3297f5f-682a-4e43-a607-f4bcf92fff95" path="/var/lib/kubelet/pods/f3297f5f-682a-4e43-a607-f4bcf92fff95/volumes" Jun 08 12:15:28.692396 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:28.692361 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc670b01-93b4-4f83-8451-4726403eaa46","Type":"ContainerStarted","Data":"67d1baa0544e2910aa9044ead9a12b1862b4f92dec147bf49901bafcdad8e688"} Jun 08 12:15:28.692759 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:28.692455 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc670b01-93b4-4f83-8451-4726403eaa46","Type":"ContainerStarted","Data":"c47ccb6a0728ed705925338033c29ac274e1ec881620d983af736b9839616a14"} Jun 08 12:15:28.692759 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:28.692481 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc670b01-93b4-4f83-8451-4726403eaa46","Type":"ContainerStarted","Data":"045fd2eea1ca86a01e84e8e4bedbbc78619d6a1cf63cb1a0b9affa38b15c4b76"} Jun 08 12:15:28.692759 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:28.692504 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc670b01-93b4-4f83-8451-4726403eaa46","Type":"ContainerStarted","Data":"691a23d2bc4ea7323c261bd7b70d7c96f9c06811d97261092c04c64c6144994e"} Jun 08 12:15:28.692759 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:28.692527 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc670b01-93b4-4f83-8451-4726403eaa46","Type":"ContainerStarted","Data":"0b1cdd790f43b08838cb0a19dd335e3f1ad2fe1a7d1bcbd7cc2b03991d42a14a"} Jun 08 12:15:28.692759 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:28.692550 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bc670b01-93b4-4f83-8451-4726403eaa46","Type":"ContainerStarted","Data":"733037d7709868bee824e983e0e34cd85b6c2da7a286bcb01ad35aedc351c30a"} Jun 08 12:15:28.727901 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:28.727777 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.712478351 podStartE2EDuration="2.727762291s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.28394ms" isStatefulPod=false podCreationTimestamp="2026-06-08 12:15:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:15:28.727396613 +0000 UTC m=+356.843214754" watchObservedRunningTime="2026-06-08 12:15:28.727762291 +0000 UTC m=+356.843580428" Jun 08 12:15:36.048045 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:36.047989 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:36.164968 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:36.164934 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:36.775201 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:36.775164 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:36.874880 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:36.874845 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:36.913169 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:36.913139 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c7bd6498f-vsxnt"] Jun 08 12:15:36.918706 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:36.918684 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:36.928394 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:36.928368 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c7bd6498f-vsxnt"] Jun 08 12:15:36.967338 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:36.967308 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:36.998411 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:36.998384 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-oauth-serving-cert\") pod \"console-5c7bd6498f-vsxnt\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:36.998506 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:36.998413 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ad56932-969e-4fef-b1ef-c87af6276e89-console-serving-cert\") pod \"console-5c7bd6498f-vsxnt\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:36.998506 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:36.998439 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-service-ca\") pod \"console-5c7bd6498f-vsxnt\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:36.998506 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:36.998459 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ad56932-969e-4fef-b1ef-c87af6276e89-console-oauth-config\") pod \"console-5c7bd6498f-vsxnt\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:36.998605 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:36.998525 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-console-config\") pod \"console-5c7bd6498f-vsxnt\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:36.998605 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:36.998549 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-trusted-ca-bundle\") pod \"console-5c7bd6498f-vsxnt\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:36.998605 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:36.998579 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x25f\" (UniqueName: \"kubernetes.io/projected/9ad56932-969e-4fef-b1ef-c87af6276e89-kube-api-access-4x25f\") pod \"console-5c7bd6498f-vsxnt\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:37.052862 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:37.052770 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:37.099995 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:37.099968 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ad56932-969e-4fef-b1ef-c87af6276e89-console-serving-cert\") pod \"console-5c7bd6498f-vsxnt\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:37.100092 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:37.100010 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-service-ca\") pod \"console-5c7bd6498f-vsxnt\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:37.100092 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:37.100060 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ad56932-969e-4fef-b1ef-c87af6276e89-console-oauth-config\") pod \"console-5c7bd6498f-vsxnt\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:37.100212 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:37.100123 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-console-config\") pod \"console-5c7bd6498f-vsxnt\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:37.100212 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:37.100142 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-trusted-ca-bundle\") pod \"console-5c7bd6498f-vsxnt\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:37.100212 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:37.100174 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x25f\" (UniqueName: \"kubernetes.io/projected/9ad56932-969e-4fef-b1ef-c87af6276e89-kube-api-access-4x25f\") pod \"console-5c7bd6498f-vsxnt\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:37.100368 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:37.100221 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-oauth-serving-cert\") pod \"console-5c7bd6498f-vsxnt\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:37.100963 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:37.100792 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-service-ca\") pod \"console-5c7bd6498f-vsxnt\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:37.100963 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:37.100950 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-trusted-ca-bundle\") pod \"console-5c7bd6498f-vsxnt\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:37.101085 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:37.100915 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-console-config\") pod \"console-5c7bd6498f-vsxnt\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:37.101158 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:37.101133 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-oauth-serving-cert\") pod \"console-5c7bd6498f-vsxnt\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:37.102567 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:37.102542 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ad56932-969e-4fef-b1ef-c87af6276e89-console-serving-cert\") pod \"console-5c7bd6498f-vsxnt\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:37.102640 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:37.102600 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ad56932-969e-4fef-b1ef-c87af6276e89-console-oauth-config\") pod \"console-5c7bd6498f-vsxnt\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:37.110184 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:37.110165 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x25f\" (UniqueName: \"kubernetes.io/projected/9ad56932-969e-4fef-b1ef-c87af6276e89-kube-api-access-4x25f\") pod \"console-5c7bd6498f-vsxnt\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:37.228657 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:37.228612 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:37.368113 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:37.368082 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c7bd6498f-vsxnt"] Jun 08 12:15:37.369475 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:15:37.369442 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ad56932_969e_4fef_b1ef_c87af6276e89.slice/crio-5554aad2b6f633ad52c0c4781bb2ede049dd8bd118c727129f726a7588012483 WatchSource:0}: Error finding container 5554aad2b6f633ad52c0c4781bb2ede049dd8bd118c727129f726a7588012483: Status 404 returned error can't find the container with id 5554aad2b6f633ad52c0c4781bb2ede049dd8bd118c727129f726a7588012483 Jun 08 12:15:37.732730 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:37.732693 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7bd6498f-vsxnt" event={"ID":"9ad56932-969e-4fef-b1ef-c87af6276e89","Type":"ContainerStarted","Data":"8076f7e72d459824722b941e6502f8ad7638f9d65f46a4c8ee6cd359afea7ae2"} Jun 08 12:15:37.732951 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:37.732752 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7bd6498f-vsxnt" event={"ID":"9ad56932-969e-4fef-b1ef-c87af6276e89","Type":"ContainerStarted","Data":"5554aad2b6f633ad52c0c4781bb2ede049dd8bd118c727129f726a7588012483"} Jun 08 12:15:37.752404 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:37.752361 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c7bd6498f-vsxnt" podStartSLOduration=1.752348459 podStartE2EDuration="1.752348459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:15:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:15:37.752032819 +0000 UTC m=+365.867850959" watchObservedRunningTime="2026-06-08 12:15:37.752348459 +0000 UTC m=+365.868166597" Jun 08 12:15:40.775306 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:40.775268 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:40.836984 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:40.836953 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:47.229427 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:47.229381 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:47.229942 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:47.229485 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:47.234104 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:47.234078 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:47.782351 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:47.782322 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:15:47.833022 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:47.832989 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5496f9649-8ft4z"] Jun 08 12:15:47.939348 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:47.939305 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:48.043504 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:48.043423 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:51.786250 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:51.786204 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:15:51.889053 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:15:51.889018 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:12.857203 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:12.857146 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5496f9649-8ft4z" podUID="05de301a-04cc-42ec-88f9-d039cc4bb09c" containerName="console" containerID="cri-o://b7e79fc2c792bd43d0adde73a1fff696b921e3ff05c91a0feabd9a5a0cf5888c" gracePeriod=15 Jun 08 12:16:13.112570 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.112517 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:16:13.213002 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.212971 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/05de301a-04cc-42ec-88f9-d039cc4bb09c-console-serving-cert\") pod \"05de301a-04cc-42ec-88f9-d039cc4bb09c\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " Jun 08 12:16:13.213162 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.213052 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-console-config\") pod \"05de301a-04cc-42ec-88f9-d039cc4bb09c\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " Jun 08 12:16:13.213162 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.213078 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/05de301a-04cc-42ec-88f9-d039cc4bb09c-console-oauth-config\") pod \"05de301a-04cc-42ec-88f9-d039cc4bb09c\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " Jun 08 12:16:13.213162 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.213099 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-service-ca\") pod \"05de301a-04cc-42ec-88f9-d039cc4bb09c\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " Jun 08 12:16:13.213322 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.213251 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-trusted-ca-bundle\") pod \"05de301a-04cc-42ec-88f9-d039cc4bb09c\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " Jun 08 12:16:13.213322 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.213289 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-oauth-serving-cert\") pod \"05de301a-04cc-42ec-88f9-d039cc4bb09c\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " Jun 08 12:16:13.213424 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.213349 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljd7w\" (UniqueName: \"kubernetes.io/projected/05de301a-04cc-42ec-88f9-d039cc4bb09c-kube-api-access-ljd7w\") pod \"05de301a-04cc-42ec-88f9-d039cc4bb09c\" (UID: \"05de301a-04cc-42ec-88f9-d039cc4bb09c\") " Jun 08 12:16:13.213683 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.213604 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-service-ca" (OuterVolumeSpecName: "service-ca") pod "05de301a-04cc-42ec-88f9-d039cc4bb09c" (UID: "05de301a-04cc-42ec-88f9-d039cc4bb09c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:16:13.213683 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.213633 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-console-config" (OuterVolumeSpecName: "console-config") pod "05de301a-04cc-42ec-88f9-d039cc4bb09c" (UID: "05de301a-04cc-42ec-88f9-d039cc4bb09c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:16:13.214065 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.213731 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "05de301a-04cc-42ec-88f9-d039cc4bb09c" (UID: "05de301a-04cc-42ec-88f9-d039cc4bb09c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:16:13.214065 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.213870 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "05de301a-04cc-42ec-88f9-d039cc4bb09c" (UID: "05de301a-04cc-42ec-88f9-d039cc4bb09c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:16:13.215292 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.215264 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05de301a-04cc-42ec-88f9-d039cc4bb09c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "05de301a-04cc-42ec-88f9-d039cc4bb09c" (UID: "05de301a-04cc-42ec-88f9-d039cc4bb09c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:16:13.215472 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.215438 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05de301a-04cc-42ec-88f9-d039cc4bb09c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "05de301a-04cc-42ec-88f9-d039cc4bb09c" (UID: "05de301a-04cc-42ec-88f9-d039cc4bb09c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:16:13.215553 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.215530 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05de301a-04cc-42ec-88f9-d039cc4bb09c-kube-api-access-ljd7w" (OuterVolumeSpecName: "kube-api-access-ljd7w") pod "05de301a-04cc-42ec-88f9-d039cc4bb09c" (UID: "05de301a-04cc-42ec-88f9-d039cc4bb09c"). InnerVolumeSpecName "kube-api-access-ljd7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:16:13.314569 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.314542 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/05de301a-04cc-42ec-88f9-d039cc4bb09c-console-serving-cert\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:16:13.314569 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.314566 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-console-config\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:16:13.314732 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.314579 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/05de301a-04cc-42ec-88f9-d039cc4bb09c-console-oauth-config\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:16:13.314732 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.314593 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-service-ca\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:16:13.314732 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.314605 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-trusted-ca-bundle\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:16:13.314732 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.314618 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/05de301a-04cc-42ec-88f9-d039cc4bb09c-oauth-serving-cert\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:16:13.314732 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.314644 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljd7w\" (UniqueName: \"kubernetes.io/projected/05de301a-04cc-42ec-88f9-d039cc4bb09c-kube-api-access-ljd7w\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:16:13.892539 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.892508 2565 generic.go:356] "Generic (PLEG): container finished" podID="05de301a-04cc-42ec-88f9-d039cc4bb09c" containerID="b7e79fc2c792bd43d0adde73a1fff696b921e3ff05c91a0feabd9a5a0cf5888c" exitCode=0 Jun 08 12:16:13.893033 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.892560 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5496f9649-8ft4z" Jun 08 12:16:13.893033 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.892600 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5496f9649-8ft4z" event={"ID":"05de301a-04cc-42ec-88f9-d039cc4bb09c","Type":"ContainerDied","Data":"b7e79fc2c792bd43d0adde73a1fff696b921e3ff05c91a0feabd9a5a0cf5888c"} Jun 08 12:16:13.893033 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.892690 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5496f9649-8ft4z" event={"ID":"05de301a-04cc-42ec-88f9-d039cc4bb09c","Type":"ContainerDied","Data":"e015d1dc66e900fbc254a04836353feaa843a36c6c90b53f662167d3741bd220"} Jun 08 12:16:13.893033 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.892719 2565 scope.go:117] "RemoveContainer" containerID="b7e79fc2c792bd43d0adde73a1fff696b921e3ff05c91a0feabd9a5a0cf5888c" Jun 08 12:16:13.901750 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.901731 2565 scope.go:117] "RemoveContainer" containerID="b7e79fc2c792bd43d0adde73a1fff696b921e3ff05c91a0feabd9a5a0cf5888c" Jun 08 12:16:13.902010 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:16:13.901992 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7e79fc2c792bd43d0adde73a1fff696b921e3ff05c91a0feabd9a5a0cf5888c\": container with ID starting with b7e79fc2c792bd43d0adde73a1fff696b921e3ff05c91a0feabd9a5a0cf5888c not found: ID does not exist" containerID="b7e79fc2c792bd43d0adde73a1fff696b921e3ff05c91a0feabd9a5a0cf5888c" Jun 08 12:16:13.902076 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.902022 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7e79fc2c792bd43d0adde73a1fff696b921e3ff05c91a0feabd9a5a0cf5888c"} err="failed to get container status \"b7e79fc2c792bd43d0adde73a1fff696b921e3ff05c91a0feabd9a5a0cf5888c\": rpc error: code = NotFound desc = could not find container \"b7e79fc2c792bd43d0adde73a1fff696b921e3ff05c91a0feabd9a5a0cf5888c\": container with ID starting with b7e79fc2c792bd43d0adde73a1fff696b921e3ff05c91a0feabd9a5a0cf5888c not found: ID does not exist" Jun 08 12:16:13.912719 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.912695 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5496f9649-8ft4z"] Jun 08 12:16:13.916448 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:13.916428 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5496f9649-8ft4z"] Jun 08 12:16:14.347121 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:14.347032 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05de301a-04cc-42ec-88f9-d039cc4bb09c" path="/var/lib/kubelet/pods/05de301a-04cc-42ec-88f9-d039cc4bb09c/volumes" Jun 08 12:16:18.945970 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:18.945937 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:19.027943 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:19.027915 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:19.400901 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:19.400869 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4"] Jun 08 12:16:19.401216 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:19.401205 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05de301a-04cc-42ec-88f9-d039cc4bb09c" containerName="console" Jun 08 12:16:19.401260 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:19.401218 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="05de301a-04cc-42ec-88f9-d039cc4bb09c" containerName="console" Jun 08 12:16:19.401299 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:19.401295 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="05de301a-04cc-42ec-88f9-d039cc4bb09c" containerName="console" Jun 08 12:16:19.406023 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:19.406003 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4" Jun 08 12:16:19.408967 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:19.408944 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 12:16:19.409070 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:19.409009 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 12:16:19.409997 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:19.409977 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2wp8n\"" Jun 08 12:16:19.413853 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:19.413830 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4"] Jun 08 12:16:19.464274 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:19.464253 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8dbg\" (UniqueName: \"kubernetes.io/projected/17bcdc11-7402-4228-9412-7888b4122065-kube-api-access-z8dbg\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4\" (UID: \"17bcdc11-7402-4228-9412-7888b4122065\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4" Jun 08 12:16:19.464385 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:19.464291 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17bcdc11-7402-4228-9412-7888b4122065-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4\" (UID: \"17bcdc11-7402-4228-9412-7888b4122065\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4" Jun 08 12:16:19.464427 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:19.464393 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17bcdc11-7402-4228-9412-7888b4122065-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4\" (UID: \"17bcdc11-7402-4228-9412-7888b4122065\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4" Jun 08 12:16:19.565345 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:19.565317 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17bcdc11-7402-4228-9412-7888b4122065-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4\" (UID: \"17bcdc11-7402-4228-9412-7888b4122065\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4" Jun 08 12:16:19.565466 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:19.565357 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8dbg\" (UniqueName: \"kubernetes.io/projected/17bcdc11-7402-4228-9412-7888b4122065-kube-api-access-z8dbg\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4\" (UID: \"17bcdc11-7402-4228-9412-7888b4122065\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4" Jun 08 12:16:19.565466 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:19.565395 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17bcdc11-7402-4228-9412-7888b4122065-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4\" (UID: \"17bcdc11-7402-4228-9412-7888b4122065\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4" Jun 08 12:16:19.565758 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:19.565738 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17bcdc11-7402-4228-9412-7888b4122065-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4\" (UID: \"17bcdc11-7402-4228-9412-7888b4122065\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4" Jun 08 12:16:19.565795 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:19.565748 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17bcdc11-7402-4228-9412-7888b4122065-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4\" (UID: \"17bcdc11-7402-4228-9412-7888b4122065\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4" Jun 08 12:16:19.575278 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:19.575248 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8dbg\" (UniqueName: \"kubernetes.io/projected/17bcdc11-7402-4228-9412-7888b4122065-kube-api-access-z8dbg\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4\" (UID: \"17bcdc11-7402-4228-9412-7888b4122065\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4" Jun 08 12:16:19.715593 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:19.715536 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4" Jun 08 12:16:19.843421 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:19.843189 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4"] Jun 08 12:16:19.845946 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:16:19.845919 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17bcdc11_7402_4228_9412_7888b4122065.slice/crio-f7f69fc569d97af9350d87e7eb8542bff653733dd6f2e500bce045e26e288540 WatchSource:0}: Error finding container f7f69fc569d97af9350d87e7eb8542bff653733dd6f2e500bce045e26e288540: Status 404 returned error can't find the container with id f7f69fc569d97af9350d87e7eb8542bff653733dd6f2e500bce045e26e288540 Jun 08 12:16:19.848349 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:19.848332 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 12:16:19.930007 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:19.929977 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4" event={"ID":"17bcdc11-7402-4228-9412-7888b4122065","Type":"ContainerStarted","Data":"f7f69fc569d97af9350d87e7eb8542bff653733dd6f2e500bce045e26e288540"} Jun 08 12:16:26.532639 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:26.532597 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:29.980441 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:29.980356 2565 generic.go:356] "Generic (PLEG): container finished" podID="17bcdc11-7402-4228-9412-7888b4122065" containerID="794e0631ecb79b09ef4be8fe46a0f371b6b5fe81f32becfd9c2a75c9dc9ed1c0" exitCode=0 Jun 08 12:16:29.980770 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:29.980453 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4" event={"ID":"17bcdc11-7402-4228-9412-7888b4122065","Type":"ContainerDied","Data":"794e0631ecb79b09ef4be8fe46a0f371b6b5fe81f32becfd9c2a75c9dc9ed1c0"} Jun 08 12:16:32.996787 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:32.996706 2565 generic.go:356] "Generic (PLEG): container finished" podID="17bcdc11-7402-4228-9412-7888b4122065" containerID="189f2faa766069e48ca4264af29f8c449e3278e8a6245e1337fd00db28c2e824" exitCode=0 Jun 08 12:16:32.997146 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:32.996790 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4" event={"ID":"17bcdc11-7402-4228-9412-7888b4122065","Type":"ContainerDied","Data":"189f2faa766069e48ca4264af29f8c449e3278e8a6245e1337fd00db28c2e824"} Jun 08 12:16:41.040082 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:41.040046 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4" event={"ID":"17bcdc11-7402-4228-9412-7888b4122065","Type":"ContainerStarted","Data":"172bdef18d388fc2baa804b80469caef877c82fb0a7c2a1d34a218b4cfcc22e6"} Jun 08 12:16:42.046972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:42.046931 2565 generic.go:356] "Generic (PLEG): container finished" podID="17bcdc11-7402-4228-9412-7888b4122065" containerID="172bdef18d388fc2baa804b80469caef877c82fb0a7c2a1d34a218b4cfcc22e6" exitCode=0 Jun 08 12:16:42.047414 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:42.047019 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4" event={"ID":"17bcdc11-7402-4228-9412-7888b4122065","Type":"ContainerDied","Data":"172bdef18d388fc2baa804b80469caef877c82fb0a7c2a1d34a218b4cfcc22e6"} Jun 08 12:16:42.224265 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:42.224232 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4" Jun 08 12:16:42.266926 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:42.266898 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17bcdc11-7402-4228-9412-7888b4122065-util\") pod \"17bcdc11-7402-4228-9412-7888b4122065\" (UID: \"17bcdc11-7402-4228-9412-7888b4122065\") " Jun 08 12:16:42.267117 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:42.266942 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17bcdc11-7402-4228-9412-7888b4122065-bundle\") pod \"17bcdc11-7402-4228-9412-7888b4122065\" (UID: \"17bcdc11-7402-4228-9412-7888b4122065\") " Jun 08 12:16:42.267117 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:42.267092 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8dbg\" (UniqueName: \"kubernetes.io/projected/17bcdc11-7402-4228-9412-7888b4122065-kube-api-access-z8dbg\") pod \"17bcdc11-7402-4228-9412-7888b4122065\" (UID: \"17bcdc11-7402-4228-9412-7888b4122065\") " Jun 08 12:16:42.267577 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:42.267553 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17bcdc11-7402-4228-9412-7888b4122065-bundle" (OuterVolumeSpecName: "bundle") pod "17bcdc11-7402-4228-9412-7888b4122065" (UID: "17bcdc11-7402-4228-9412-7888b4122065"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:16:42.269292 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:42.269266 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17bcdc11-7402-4228-9412-7888b4122065-kube-api-access-z8dbg" (OuterVolumeSpecName: "kube-api-access-z8dbg") pod "17bcdc11-7402-4228-9412-7888b4122065" (UID: "17bcdc11-7402-4228-9412-7888b4122065"). InnerVolumeSpecName "kube-api-access-z8dbg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:16:42.271038 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:42.271014 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17bcdc11-7402-4228-9412-7888b4122065-util" (OuterVolumeSpecName: "util") pod "17bcdc11-7402-4228-9412-7888b4122065" (UID: "17bcdc11-7402-4228-9412-7888b4122065"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:16:42.368081 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:42.368052 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17bcdc11-7402-4228-9412-7888b4122065-util\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:16:42.368081 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:42.368079 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17bcdc11-7402-4228-9412-7888b4122065-bundle\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:16:42.368230 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:42.368089 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8dbg\" (UniqueName: \"kubernetes.io/projected/17bcdc11-7402-4228-9412-7888b4122065-kube-api-access-z8dbg\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:16:43.053801 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:43.053773 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4" Jun 08 12:16:43.053801 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:43.053783 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dwvjw4" event={"ID":"17bcdc11-7402-4228-9412-7888b4122065","Type":"ContainerDied","Data":"f7f69fc569d97af9350d87e7eb8542bff653733dd6f2e500bce045e26e288540"} Jun 08 12:16:43.054248 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:43.053843 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7f69fc569d97af9350d87e7eb8542bff653733dd6f2e500bce045e26e288540" Jun 08 12:16:45.227628 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:45.227535 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:46.564878 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:46.564841 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:47.207982 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:47.207946 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-b62bf"] Jun 08 12:16:47.208323 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:47.208310 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17bcdc11-7402-4228-9412-7888b4122065" containerName="extract" Jun 08 12:16:47.208366 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:47.208325 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="17bcdc11-7402-4228-9412-7888b4122065" containerName="extract" Jun 08 12:16:47.208366 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:47.208341 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17bcdc11-7402-4228-9412-7888b4122065" containerName="util" Jun 08 12:16:47.208366 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:47.208347 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="17bcdc11-7402-4228-9412-7888b4122065" containerName="util" Jun 08 12:16:47.208366 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:47.208359 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17bcdc11-7402-4228-9412-7888b4122065" containerName="pull" Jun 08 12:16:47.208366 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:47.208364 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="17bcdc11-7402-4228-9412-7888b4122065" containerName="pull" Jun 08 12:16:47.208516 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:47.208432 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="17bcdc11-7402-4228-9412-7888b4122065" containerName="extract" Jun 08 12:16:47.211488 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:47.211472 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-b62bf" Jun 08 12:16:47.216269 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:47.216247 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-b797d\"" Jun 08 12:16:47.216605 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:47.216581 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 08 12:16:47.216711 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:47.216692 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:16:47.240595 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:47.240564 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-b62bf"] Jun 08 12:16:47.312740 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:47.312710 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6afe62cf-deb1-4c23-86e4-b3114cb7a836-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-b62bf\" (UID: \"6afe62cf-deb1-4c23-86e4-b3114cb7a836\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-b62bf" Jun 08 12:16:47.312884 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:47.312797 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czf2s\" (UniqueName: \"kubernetes.io/projected/6afe62cf-deb1-4c23-86e4-b3114cb7a836-kube-api-access-czf2s\") pod \"cert-manager-operator-controller-manager-57757f7cfc-b62bf\" (UID: \"6afe62cf-deb1-4c23-86e4-b3114cb7a836\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-b62bf" Jun 08 12:16:47.414240 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:47.414195 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czf2s\" (UniqueName: \"kubernetes.io/projected/6afe62cf-deb1-4c23-86e4-b3114cb7a836-kube-api-access-czf2s\") pod \"cert-manager-operator-controller-manager-57757f7cfc-b62bf\" (UID: \"6afe62cf-deb1-4c23-86e4-b3114cb7a836\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-b62bf" Jun 08 12:16:47.414426 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:47.414389 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6afe62cf-deb1-4c23-86e4-b3114cb7a836-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-b62bf\" (UID: \"6afe62cf-deb1-4c23-86e4-b3114cb7a836\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-b62bf" Jun 08 12:16:47.414766 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:47.414749 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6afe62cf-deb1-4c23-86e4-b3114cb7a836-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-b62bf\" (UID: \"6afe62cf-deb1-4c23-86e4-b3114cb7a836\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-b62bf" Jun 08 12:16:47.425881 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:47.425854 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czf2s\" (UniqueName: \"kubernetes.io/projected/6afe62cf-deb1-4c23-86e4-b3114cb7a836-kube-api-access-czf2s\") pod \"cert-manager-operator-controller-manager-57757f7cfc-b62bf\" (UID: \"6afe62cf-deb1-4c23-86e4-b3114cb7a836\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-b62bf" Jun 08 12:16:47.521045 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:47.520971 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-b62bf" Jun 08 12:16:47.668654 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:47.668630 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-b62bf"] Jun 08 12:16:47.671128 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:16:47.671102 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6afe62cf_deb1_4c23_86e4_b3114cb7a836.slice/crio-5bba4c2660d07ba68cb159bd7eec35f96f7f98f09440b10bcf09c8447d68c212 WatchSource:0}: Error finding container 5bba4c2660d07ba68cb159bd7eec35f96f7f98f09440b10bcf09c8447d68c212: Status 404 returned error can't find the container with id 5bba4c2660d07ba68cb159bd7eec35f96f7f98f09440b10bcf09c8447d68c212 Jun 08 12:16:48.076052 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:48.075990 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-b62bf" event={"ID":"6afe62cf-deb1-4c23-86e4-b3114cb7a836","Type":"ContainerStarted","Data":"5bba4c2660d07ba68cb159bd7eec35f96f7f98f09440b10bcf09c8447d68c212"} Jun 08 12:16:48.826122 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:48.826032 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:48.928105 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:48.928069 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:50.089183 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:50.089137 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-b62bf" event={"ID":"6afe62cf-deb1-4c23-86e4-b3114cb7a836","Type":"ContainerStarted","Data":"1f7d1327526376e24fbfc529a6055a649b059062a0ae6034a68db6a74de3a3b5"} Jun 08 12:16:50.110719 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:50.110661 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-b62bf" podStartSLOduration=1.294580103 podStartE2EDuration="3.110643798s" totalImagesPullingTime="1.816063695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:16:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:16:50.10874241 +0000 UTC m=+438.224560559" watchObservedRunningTime="2026-06-08 12:16:50.110643798 +0000 UTC m=+438.226461935" Jun 08 12:16:50.174739 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:50.174696 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:50.287159 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:50.287103 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:50.472146 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:50.472101 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:50.570880 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:50.570849 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:51.862191 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:51.862157 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs"] Jun 08 12:16:51.865764 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:51.865747 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs" Jun 08 12:16:51.868361 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:51.868339 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 12:16:51.868528 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:51.868382 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 12:16:51.868528 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:51.868419 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2wp8n\"" Jun 08 12:16:51.876722 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:51.876331 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs"] Jun 08 12:16:51.936312 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:51.936279 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-qmh7w"] Jun 08 12:16:51.939512 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:51.939494 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-qmh7w" Jun 08 12:16:51.942530 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:51.942501 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-2vn56\"" Jun 08 12:16:51.942729 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:51.942709 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 08 12:16:51.942807 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:51.942793 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 08 12:16:51.952295 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:51.952272 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs\" (UID: \"ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs" Jun 08 12:16:51.952397 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:51.952306 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj2mn\" (UniqueName: \"kubernetes.io/projected/ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6-kube-api-access-sj2mn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs\" (UID: \"ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs" Jun 08 12:16:51.952458 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:51.952425 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs\" (UID: \"ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs" Jun 08 12:16:51.955471 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:51.955452 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-qmh7w"] Jun 08 12:16:52.053093 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:52.053062 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6f981ff-787b-43b2-8565-19d2a1969a37-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-qmh7w\" (UID: \"b6f981ff-787b-43b2-8565-19d2a1969a37\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-qmh7w" Jun 08 12:16:52.053238 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:52.053102 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs\" (UID: \"ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs" Jun 08 12:16:52.053238 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:52.053173 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs\" (UID: \"ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs" Jun 08 12:16:52.053238 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:52.053208 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj2mn\" (UniqueName: \"kubernetes.io/projected/ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6-kube-api-access-sj2mn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs\" (UID: \"ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs" Jun 08 12:16:52.053347 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:52.053267 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84nwj\" (UniqueName: \"kubernetes.io/projected/b6f981ff-787b-43b2-8565-19d2a1969a37-kube-api-access-84nwj\") pod \"cert-manager-webhook-7dc76cbb94-qmh7w\" (UID: \"b6f981ff-787b-43b2-8565-19d2a1969a37\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-qmh7w" Jun 08 12:16:52.053482 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:52.053467 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs\" (UID: \"ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs" Jun 08 12:16:52.053520 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:52.053509 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs\" (UID: \"ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs" Jun 08 12:16:52.062842 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:52.062806 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj2mn\" (UniqueName: \"kubernetes.io/projected/ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6-kube-api-access-sj2mn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs\" (UID: \"ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs" Jun 08 12:16:52.154131 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:52.154098 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84nwj\" (UniqueName: \"kubernetes.io/projected/b6f981ff-787b-43b2-8565-19d2a1969a37-kube-api-access-84nwj\") pod \"cert-manager-webhook-7dc76cbb94-qmh7w\" (UID: \"b6f981ff-787b-43b2-8565-19d2a1969a37\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-qmh7w" Jun 08 12:16:52.154294 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:52.154161 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6f981ff-787b-43b2-8565-19d2a1969a37-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-qmh7w\" (UID: \"b6f981ff-787b-43b2-8565-19d2a1969a37\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-qmh7w" Jun 08 12:16:52.167240 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:52.167211 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6f981ff-787b-43b2-8565-19d2a1969a37-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-qmh7w\" (UID: \"b6f981ff-787b-43b2-8565-19d2a1969a37\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-qmh7w" Jun 08 12:16:52.167390 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:52.167336 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84nwj\" (UniqueName: \"kubernetes.io/projected/b6f981ff-787b-43b2-8565-19d2a1969a37-kube-api-access-84nwj\") pod \"cert-manager-webhook-7dc76cbb94-qmh7w\" (UID: \"b6f981ff-787b-43b2-8565-19d2a1969a37\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-qmh7w" Jun 08 12:16:52.176094 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:52.176073 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs" Jun 08 12:16:52.262138 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:52.262110 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-qmh7w" Jun 08 12:16:52.307875 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:52.307850 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs"] Jun 08 12:16:52.309836 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:16:52.309792 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef6f0a6f_2c39_4c15_8e93_3cd298ff54f6.slice/crio-2c5315384cb6d324701bcff56f1c68f6c4f6f9b671bcbae238babad5a6f5b299 WatchSource:0}: Error finding container 2c5315384cb6d324701bcff56f1c68f6c4f6f9b671bcbae238babad5a6f5b299: Status 404 returned error can't find the container with id 2c5315384cb6d324701bcff56f1c68f6c4f6f9b671bcbae238babad5a6f5b299 Jun 08 12:16:52.401723 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:52.401700 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-qmh7w"] Jun 08 12:16:52.404005 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:16:52.403978 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6f981ff_787b_43b2_8565_19d2a1969a37.slice/crio-468c8e732914f9f53d8fcf3829ee948011139cbe8d98de1b67f6a99130fff7ff WatchSource:0}: Error finding container 468c8e732914f9f53d8fcf3829ee948011139cbe8d98de1b67f6a99130fff7ff: Status 404 returned error can't find the container with id 468c8e732914f9f53d8fcf3829ee948011139cbe8d98de1b67f6a99130fff7ff Jun 08 12:16:53.106404 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:53.106371 2565 generic.go:356] "Generic (PLEG): container finished" podID="ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6" containerID="4270d0d3a7a7af8b4f68f69ff8f0bde455323e60a632b9ca3e171bd91a0e35f8" exitCode=0 Jun 08 12:16:53.106828 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:53.106447 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs" event={"ID":"ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6","Type":"ContainerDied","Data":"4270d0d3a7a7af8b4f68f69ff8f0bde455323e60a632b9ca3e171bd91a0e35f8"} Jun 08 12:16:53.106828 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:53.106482 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs" event={"ID":"ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6","Type":"ContainerStarted","Data":"2c5315384cb6d324701bcff56f1c68f6c4f6f9b671bcbae238babad5a6f5b299"} Jun 08 12:16:53.107647 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:53.107622 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-qmh7w" event={"ID":"b6f981ff-787b-43b2-8565-19d2a1969a37","Type":"ContainerStarted","Data":"468c8e732914f9f53d8fcf3829ee948011139cbe8d98de1b67f6a99130fff7ff"} Jun 08 12:16:53.508881 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:53.508849 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:54.090616 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:54.090581 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:55.425302 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:55.425234 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:55.528363 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:55.528323 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:57.129232 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:57.129200 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-qmh7w" event={"ID":"b6f981ff-787b-43b2-8565-19d2a1969a37","Type":"ContainerStarted","Data":"30d1bf018911ca90a19325ed9fae747961da6383bbae40c6a6b7f4e5e4d54d42"} Jun 08 12:16:57.129603 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:57.129320 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-qmh7w" Jun 08 12:16:57.148804 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:57.148749 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-qmh7w" podStartSLOduration=2.011922099 podStartE2EDuration="6.148733298s" totalImagesPullingTime="4.136811199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:16:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:16:57.147043766 +0000 UTC m=+445.262861898" watchObservedRunningTime="2026-06-08 12:16:57.148733298 +0000 UTC m=+445.264551436" Jun 08 12:16:58.136215 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:58.136183 2565 generic.go:356] "Generic (PLEG): container finished" podID="ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6" containerID="622d2cd72fd8a5fb527e9fb213fa778608f741548c6a48f66f9be97f473ad4a8" exitCode=0 Jun 08 12:16:58.136592 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:58.136279 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs" event={"ID":"ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6","Type":"ContainerDied","Data":"622d2cd72fd8a5fb527e9fb213fa778608f741548c6a48f66f9be97f473ad4a8"} Jun 08 12:16:58.751413 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:58.751381 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:58.816265 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:58.816236 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:16:59.142551 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:59.142517 2565 generic.go:356] "Generic (PLEG): container finished" podID="ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6" containerID="f6ea3bcb87765f9997feb38e2f65fd6b4db203e6875ec0e33d48b8b5acef522c" exitCode=0 Jun 08 12:16:59.142948 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:16:59.142597 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs" event={"ID":"ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6","Type":"ContainerDied","Data":"f6ea3bcb87765f9997feb38e2f65fd6b4db203e6875ec0e33d48b8b5acef522c"} Jun 08 12:17:00.277052 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:00.277030 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs" Jun 08 12:17:00.332623 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:00.332590 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sj2mn\" (UniqueName: \"kubernetes.io/projected/ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6-kube-api-access-sj2mn\") pod \"ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6\" (UID: \"ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6\") " Jun 08 12:17:00.332768 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:00.332655 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6-util\") pod \"ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6\" (UID: \"ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6\") " Jun 08 12:17:00.332768 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:00.332719 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6-bundle\") pod \"ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6\" (UID: \"ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6\") " Jun 08 12:17:00.333157 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:00.333134 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6-bundle" (OuterVolumeSpecName: "bundle") pod "ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6" (UID: "ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:17:00.334854 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:00.334829 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6-kube-api-access-sj2mn" (OuterVolumeSpecName: "kube-api-access-sj2mn") pod "ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6" (UID: "ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6"). InnerVolumeSpecName "kube-api-access-sj2mn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:17:00.337259 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:00.337234 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6-util" (OuterVolumeSpecName: "util") pod "ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6" (UID: "ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:17:00.434469 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:00.434393 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6-util\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:17:00.434469 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:00.434427 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6-bundle\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:17:00.434469 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:00.434442 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sj2mn\" (UniqueName: \"kubernetes.io/projected/ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6-kube-api-access-sj2mn\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:17:01.153752 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:01.153720 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs" event={"ID":"ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6","Type":"ContainerDied","Data":"2c5315384cb6d324701bcff56f1c68f6c4f6f9b671bcbae238babad5a6f5b299"} Jun 08 12:17:01.153934 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:01.153794 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c5315384cb6d324701bcff56f1c68f6c4f6f9b671bcbae238babad5a6f5b299" Jun 08 12:17:01.153934 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:01.153729 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f767vs" Jun 08 12:17:01.915304 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:01.915271 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:03.138297 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:03.138265 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-qmh7w" Jun 08 12:17:06.867776 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:06.867726 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:06.960744 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:06.960715 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:13.037425 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:13.037392 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:13.135519 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:13.135482 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:15.024631 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:15.024587 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:16.727958 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:16.727924 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm"] Jun 08 12:17:16.728318 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:16.728283 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6" containerName="pull" Jun 08 12:17:16.728318 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:16.728297 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6" containerName="pull" Jun 08 12:17:16.728318 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:16.728307 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6" containerName="extract" Jun 08 12:17:16.728318 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:16.728312 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6" containerName="extract" Jun 08 12:17:16.728450 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:16.728322 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6" containerName="util" Jun 08 12:17:16.728450 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:16.728328 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6" containerName="util" Jun 08 12:17:16.728450 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:16.728403 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef6f0a6f-2c39-4c15-8e93-3cd298ff54f6" containerName="extract" Jun 08 12:17:16.730399 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:16.730383 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm" Jun 08 12:17:16.732935 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:16.732916 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 12:17:16.732935 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:16.732925 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 12:17:16.733145 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:16.732921 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2wp8n\"" Jun 08 12:17:16.743650 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:16.743620 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm"] Jun 08 12:17:16.877015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:16.876979 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57e6b37e-cf01-4ac8-b627-85168e987e02-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm\" (UID: \"57e6b37e-cf01-4ac8-b627-85168e987e02\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm" Jun 08 12:17:16.877178 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:16.877042 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57e6b37e-cf01-4ac8-b627-85168e987e02-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm\" (UID: \"57e6b37e-cf01-4ac8-b627-85168e987e02\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm" Jun 08 12:17:16.877178 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:16.877082 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddbzr\" (UniqueName: \"kubernetes.io/projected/57e6b37e-cf01-4ac8-b627-85168e987e02-kube-api-access-ddbzr\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm\" (UID: \"57e6b37e-cf01-4ac8-b627-85168e987e02\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm" Jun 08 12:17:16.978266 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:16.978190 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57e6b37e-cf01-4ac8-b627-85168e987e02-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm\" (UID: \"57e6b37e-cf01-4ac8-b627-85168e987e02\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm" Jun 08 12:17:16.978266 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:16.978243 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57e6b37e-cf01-4ac8-b627-85168e987e02-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm\" (UID: \"57e6b37e-cf01-4ac8-b627-85168e987e02\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm" Jun 08 12:17:16.978451 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:16.978271 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddbzr\" (UniqueName: \"kubernetes.io/projected/57e6b37e-cf01-4ac8-b627-85168e987e02-kube-api-access-ddbzr\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm\" (UID: \"57e6b37e-cf01-4ac8-b627-85168e987e02\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm" Jun 08 12:17:16.978577 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:16.978550 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57e6b37e-cf01-4ac8-b627-85168e987e02-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm\" (UID: \"57e6b37e-cf01-4ac8-b627-85168e987e02\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm" Jun 08 12:17:16.978642 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:16.978628 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57e6b37e-cf01-4ac8-b627-85168e987e02-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm\" (UID: \"57e6b37e-cf01-4ac8-b627-85168e987e02\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm" Jun 08 12:17:16.987466 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:16.987444 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddbzr\" (UniqueName: \"kubernetes.io/projected/57e6b37e-cf01-4ac8-b627-85168e987e02-kube-api-access-ddbzr\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm\" (UID: \"57e6b37e-cf01-4ac8-b627-85168e987e02\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm" Jun 08 12:17:17.039282 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:17.039259 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm" Jun 08 12:17:17.195393 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:17.195370 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm"] Jun 08 12:17:17.197958 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:17:17.197924 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57e6b37e_cf01_4ac8_b627_85168e987e02.slice/crio-63481bc006c77f0eab4de3f96316cb2963bd2473ef7af27ceb493a97c8f87fcc WatchSource:0}: Error finding container 63481bc006c77f0eab4de3f96316cb2963bd2473ef7af27ceb493a97c8f87fcc: Status 404 returned error can't find the container with id 63481bc006c77f0eab4de3f96316cb2963bd2473ef7af27ceb493a97c8f87fcc Jun 08 12:17:17.229889 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:17.229799 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm" event={"ID":"57e6b37e-cf01-4ac8-b627-85168e987e02","Type":"ContainerStarted","Data":"63481bc006c77f0eab4de3f96316cb2963bd2473ef7af27ceb493a97c8f87fcc"} Jun 08 12:17:18.236907 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:18.236875 2565 generic.go:356] "Generic (PLEG): container finished" podID="57e6b37e-cf01-4ac8-b627-85168e987e02" containerID="5fcec5e12243b56f5ac51f5c88645c7a1048b4d0bfb0ef806c4f79d788e240a2" exitCode=0 Jun 08 12:17:18.237265 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:18.236974 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm" event={"ID":"57e6b37e-cf01-4ac8-b627-85168e987e02","Type":"ContainerDied","Data":"5fcec5e12243b56f5ac51f5c88645c7a1048b4d0bfb0ef806c4f79d788e240a2"} Jun 08 12:17:20.248200 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:20.248165 2565 generic.go:356] "Generic (PLEG): container finished" podID="57e6b37e-cf01-4ac8-b627-85168e987e02" containerID="3233c19a13ac6c4f9fe783d0bc4f961b02def3381a300317aaa9d6a47b7ecc99" exitCode=0 Jun 08 12:17:20.248596 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:20.248220 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm" event={"ID":"57e6b37e-cf01-4ac8-b627-85168e987e02","Type":"ContainerDied","Data":"3233c19a13ac6c4f9fe783d0bc4f961b02def3381a300317aaa9d6a47b7ecc99"} Jun 08 12:17:21.255443 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:21.255407 2565 generic.go:356] "Generic (PLEG): container finished" podID="57e6b37e-cf01-4ac8-b627-85168e987e02" containerID="61fee7ec3328398a3e6dd1561d401a9b6ce5eb929d4315ab2b495f2f746c3167" exitCode=0 Jun 08 12:17:21.255850 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:21.255492 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm" event={"ID":"57e6b37e-cf01-4ac8-b627-85168e987e02","Type":"ContainerDied","Data":"61fee7ec3328398a3e6dd1561d401a9b6ce5eb929d4315ab2b495f2f746c3167"} Jun 08 12:17:22.385314 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:22.385292 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm" Jun 08 12:17:22.422645 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:22.422618 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddbzr\" (UniqueName: \"kubernetes.io/projected/57e6b37e-cf01-4ac8-b627-85168e987e02-kube-api-access-ddbzr\") pod \"57e6b37e-cf01-4ac8-b627-85168e987e02\" (UID: \"57e6b37e-cf01-4ac8-b627-85168e987e02\") " Jun 08 12:17:22.422804 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:22.422716 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57e6b37e-cf01-4ac8-b627-85168e987e02-util\") pod \"57e6b37e-cf01-4ac8-b627-85168e987e02\" (UID: \"57e6b37e-cf01-4ac8-b627-85168e987e02\") " Jun 08 12:17:22.422804 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:22.422805 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57e6b37e-cf01-4ac8-b627-85168e987e02-bundle\") pod \"57e6b37e-cf01-4ac8-b627-85168e987e02\" (UID: \"57e6b37e-cf01-4ac8-b627-85168e987e02\") " Jun 08 12:17:22.423916 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:22.423881 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57e6b37e-cf01-4ac8-b627-85168e987e02-bundle" (OuterVolumeSpecName: "bundle") pod "57e6b37e-cf01-4ac8-b627-85168e987e02" (UID: "57e6b37e-cf01-4ac8-b627-85168e987e02"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:17:22.425299 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:22.425275 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57e6b37e-cf01-4ac8-b627-85168e987e02-kube-api-access-ddbzr" (OuterVolumeSpecName: "kube-api-access-ddbzr") pod "57e6b37e-cf01-4ac8-b627-85168e987e02" (UID: "57e6b37e-cf01-4ac8-b627-85168e987e02"). InnerVolumeSpecName "kube-api-access-ddbzr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:17:22.429355 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:22.429333 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57e6b37e-cf01-4ac8-b627-85168e987e02-util" (OuterVolumeSpecName: "util") pod "57e6b37e-cf01-4ac8-b627-85168e987e02" (UID: "57e6b37e-cf01-4ac8-b627-85168e987e02"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:17:22.524110 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:22.524029 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57e6b37e-cf01-4ac8-b627-85168e987e02-util\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:17:22.524110 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:22.524057 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57e6b37e-cf01-4ac8-b627-85168e987e02-bundle\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:17:22.524110 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:22.524070 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddbzr\" (UniqueName: \"kubernetes.io/projected/57e6b37e-cf01-4ac8-b627-85168e987e02-kube-api-access-ddbzr\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:17:23.266002 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:23.265972 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm" Jun 08 12:17:23.266237 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:23.266000 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6rfhm" event={"ID":"57e6b37e-cf01-4ac8-b627-85168e987e02","Type":"ContainerDied","Data":"63481bc006c77f0eab4de3f96316cb2963bd2473ef7af27ceb493a97c8f87fcc"} Jun 08 12:17:23.266237 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:23.266044 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63481bc006c77f0eab4de3f96316cb2963bd2473ef7af27ceb493a97c8f87fcc" Jun 08 12:17:29.163946 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:29.163910 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:32.771945 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:32.771902 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:32.867072 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:32.867030 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:33.503581 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:33.503547 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:33.977481 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:33.977429 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:34.088895 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.088865 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:34.151482 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.151449 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n"] Jun 08 12:17:34.151836 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.151822 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57e6b37e-cf01-4ac8-b627-85168e987e02" containerName="extract" Jun 08 12:17:34.151836 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.151837 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="57e6b37e-cf01-4ac8-b627-85168e987e02" containerName="extract" Jun 08 12:17:34.151921 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.151849 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57e6b37e-cf01-4ac8-b627-85168e987e02" containerName="util" Jun 08 12:17:34.151921 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.151854 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="57e6b37e-cf01-4ac8-b627-85168e987e02" containerName="util" Jun 08 12:17:34.151921 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.151878 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57e6b37e-cf01-4ac8-b627-85168e987e02" containerName="pull" Jun 08 12:17:34.151921 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.151883 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="57e6b37e-cf01-4ac8-b627-85168e987e02" containerName="pull" Jun 08 12:17:34.152040 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.151942 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="57e6b37e-cf01-4ac8-b627-85168e987e02" containerName="extract" Jun 08 12:17:34.156313 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.156291 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" Jun 08 12:17:34.160320 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.160297 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 12:17:34.160320 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.160323 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-g9df2\"" Jun 08 12:17:34.160492 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.160322 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 12:17:34.160933 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.160917 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 12:17:34.165163 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.165143 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 12:17:34.183558 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.183540 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n"] Jun 08 12:17:34.222893 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.222864 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x68q4\" (UniqueName: \"kubernetes.io/projected/c456c4dc-1b2d-40a2-962e-45e1a8fb6a01-kube-api-access-x68q4\") pod \"opendatahub-operator-controller-manager-6858dfdb94-5pr6n\" (UID: \"c456c4dc-1b2d-40a2-962e-45e1a8fb6a01\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" Jun 08 12:17:34.223005 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.222915 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c456c4dc-1b2d-40a2-962e-45e1a8fb6a01-manifests\") pod \"opendatahub-operator-controller-manager-6858dfdb94-5pr6n\" (UID: \"c456c4dc-1b2d-40a2-962e-45e1a8fb6a01\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" Jun 08 12:17:34.223005 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.222947 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c456c4dc-1b2d-40a2-962e-45e1a8fb6a01-tmp\") pod \"opendatahub-operator-controller-manager-6858dfdb94-5pr6n\" (UID: \"c456c4dc-1b2d-40a2-962e-45e1a8fb6a01\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" Jun 08 12:17:34.223005 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.222970 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c456c4dc-1b2d-40a2-962e-45e1a8fb6a01-webhook-cert\") pod \"opendatahub-operator-controller-manager-6858dfdb94-5pr6n\" (UID: \"c456c4dc-1b2d-40a2-962e-45e1a8fb6a01\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" Jun 08 12:17:34.223129 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.223034 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c456c4dc-1b2d-40a2-962e-45e1a8fb6a01-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6858dfdb94-5pr6n\" (UID: \"c456c4dc-1b2d-40a2-962e-45e1a8fb6a01\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" Jun 08 12:17:34.324794 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.324705 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x68q4\" (UniqueName: \"kubernetes.io/projected/c456c4dc-1b2d-40a2-962e-45e1a8fb6a01-kube-api-access-x68q4\") pod \"opendatahub-operator-controller-manager-6858dfdb94-5pr6n\" (UID: \"c456c4dc-1b2d-40a2-962e-45e1a8fb6a01\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" Jun 08 12:17:34.324964 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.324873 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c456c4dc-1b2d-40a2-962e-45e1a8fb6a01-manifests\") pod \"opendatahub-operator-controller-manager-6858dfdb94-5pr6n\" (UID: \"c456c4dc-1b2d-40a2-962e-45e1a8fb6a01\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" Jun 08 12:17:34.324964 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.324945 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c456c4dc-1b2d-40a2-962e-45e1a8fb6a01-tmp\") pod \"opendatahub-operator-controller-manager-6858dfdb94-5pr6n\" (UID: \"c456c4dc-1b2d-40a2-962e-45e1a8fb6a01\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" Jun 08 12:17:34.325073 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.324978 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c456c4dc-1b2d-40a2-962e-45e1a8fb6a01-webhook-cert\") pod \"opendatahub-operator-controller-manager-6858dfdb94-5pr6n\" (UID: \"c456c4dc-1b2d-40a2-962e-45e1a8fb6a01\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" Jun 08 12:17:34.325073 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.325029 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c456c4dc-1b2d-40a2-962e-45e1a8fb6a01-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6858dfdb94-5pr6n\" (UID: \"c456c4dc-1b2d-40a2-962e-45e1a8fb6a01\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" Jun 08 12:17:34.326845 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.326527 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c456c4dc-1b2d-40a2-962e-45e1a8fb6a01-manifests\") pod \"opendatahub-operator-controller-manager-6858dfdb94-5pr6n\" (UID: \"c456c4dc-1b2d-40a2-962e-45e1a8fb6a01\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" Jun 08 12:17:34.329578 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.329550 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c456c4dc-1b2d-40a2-962e-45e1a8fb6a01-tmp\") pod \"opendatahub-operator-controller-manager-6858dfdb94-5pr6n\" (UID: \"c456c4dc-1b2d-40a2-962e-45e1a8fb6a01\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" Jun 08 12:17:34.330554 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.330530 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c456c4dc-1b2d-40a2-962e-45e1a8fb6a01-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6858dfdb94-5pr6n\" (UID: \"c456c4dc-1b2d-40a2-962e-45e1a8fb6a01\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" Jun 08 12:17:34.333429 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.333405 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c456c4dc-1b2d-40a2-962e-45e1a8fb6a01-webhook-cert\") pod \"opendatahub-operator-controller-manager-6858dfdb94-5pr6n\" (UID: \"c456c4dc-1b2d-40a2-962e-45e1a8fb6a01\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" Jun 08 12:17:34.345571 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.345547 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x68q4\" (UniqueName: \"kubernetes.io/projected/c456c4dc-1b2d-40a2-962e-45e1a8fb6a01-kube-api-access-x68q4\") pod \"opendatahub-operator-controller-manager-6858dfdb94-5pr6n\" (UID: \"c456c4dc-1b2d-40a2-962e-45e1a8fb6a01\") " pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" Jun 08 12:17:34.371302 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.371276 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:34.467202 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.467176 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" Jun 08 12:17:34.624778 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:17:34.624756 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc456c4dc_1b2d_40a2_962e_45e1a8fb6a01.slice/crio-f43bae502cc08718f9ec8ba12afbd18d343d5d0b90a4f6e0919c929c42b0f995 WatchSource:0}: Error finding container f43bae502cc08718f9ec8ba12afbd18d343d5d0b90a4f6e0919c929c42b0f995: Status 404 returned error can't find the container with id f43bae502cc08718f9ec8ba12afbd18d343d5d0b90a4f6e0919c929c42b0f995 Jun 08 12:17:34.631677 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:34.631651 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n"] Jun 08 12:17:35.291198 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:35.291163 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:35.326015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:35.325976 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" event={"ID":"c456c4dc-1b2d-40a2-962e-45e1a8fb6a01","Type":"ContainerStarted","Data":"f43bae502cc08718f9ec8ba12afbd18d343d5d0b90a4f6e0919c929c42b0f995"} Jun 08 12:17:35.391535 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:35.391445 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:38.348240 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:38.348207 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" event={"ID":"c456c4dc-1b2d-40a2-962e-45e1a8fb6a01","Type":"ContainerStarted","Data":"772baaaaf8b56f7a80198c4eab10c0bbec6d67739fd177bc51f11ea2d3ec1d3a"} Jun 08 12:17:39.352987 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:39.352955 2565 generic.go:356] "Generic (PLEG): container finished" podID="c456c4dc-1b2d-40a2-962e-45e1a8fb6a01" containerID="772baaaaf8b56f7a80198c4eab10c0bbec6d67739fd177bc51f11ea2d3ec1d3a" exitCode=0 Jun 08 12:17:39.353370 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:39.353041 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" event={"ID":"c456c4dc-1b2d-40a2-962e-45e1a8fb6a01","Type":"ContainerDied","Data":"772baaaaf8b56f7a80198c4eab10c0bbec6d67739fd177bc51f11ea2d3ec1d3a"} Jun 08 12:17:40.125050 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:40.124962 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:40.252477 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:40.252446 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:40.359716 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:40.359684 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" event={"ID":"c456c4dc-1b2d-40a2-962e-45e1a8fb6a01","Type":"ContainerStarted","Data":"e827bf4afc558e205d01caee614f35757e07d614ab7e06227d4ab3b81cf13add"} Jun 08 12:17:40.360147 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:40.359783 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" Jun 08 12:17:40.394203 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:40.394121 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" podStartSLOduration=1.821363856 podStartE2EDuration="6.394108353s" totalImagesPullingTime="3.588170658s" totalInitContainerRuntime="984.573839ms" isStatefulPod=false podCreationTimestamp="2026-06-08 12:17:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:17:40.392038895 +0000 UTC m=+488.507857032" watchObservedRunningTime="2026-06-08 12:17:40.394108353 +0000 UTC m=+488.509926490" Jun 08 12:17:51.368364 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:51.368331 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6858dfdb94-5pr6n" Jun 08 12:17:53.222633 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:53.222593 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:53.351907 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:53.351875 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:53.516647 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:53.516557 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:53.731603 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:53.731572 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:53.872249 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:53.872165 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:53.987120 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:53.987085 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm"] Jun 08 12:17:54.067014 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.066982 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm"] Jun 08 12:17:54.067186 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.067110 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm" Jun 08 12:17:54.070056 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.070012 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 12:17:54.070796 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.070775 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 12:17:54.072879 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.072852 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2wp8n\"" Jun 08 12:17:54.076406 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.076384 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-9b8fm"] Jun 08 12:17:54.083029 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.083005 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:54.098004 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.097987 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-9b8fm" Jun 08 12:17:54.103491 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.103470 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 08 12:17:54.103842 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.103711 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-cz66x\"" Jun 08 12:17:54.114975 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.114950 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-9b8fm"] Jun 08 12:17:54.192346 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.192308 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmm2l\" (UniqueName: \"kubernetes.io/projected/39f7399a-b977-4b9e-b0c5-b0e67fe1f6fa-kube-api-access-hmm2l\") pod \"odh-model-controller-6dc94f689f-9b8fm\" (UID: \"39f7399a-b977-4b9e-b0c5-b0e67fe1f6fa\") " pod="opendatahub/odh-model-controller-6dc94f689f-9b8fm" Jun 08 12:17:54.192522 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.192355 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39f7399a-b977-4b9e-b0c5-b0e67fe1f6fa-cert\") pod \"odh-model-controller-6dc94f689f-9b8fm\" (UID: \"39f7399a-b977-4b9e-b0c5-b0e67fe1f6fa\") " pod="opendatahub/odh-model-controller-6dc94f689f-9b8fm" Jun 08 12:17:54.192585 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.192510 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c197bf1-2351-42a9-9df7-3fc07db51aaa-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm\" (UID: \"3c197bf1-2351-42a9-9df7-3fc07db51aaa\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm" Jun 08 12:17:54.192585 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.192546 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c197bf1-2351-42a9-9df7-3fc07db51aaa-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm\" (UID: \"3c197bf1-2351-42a9-9df7-3fc07db51aaa\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm" Jun 08 12:17:54.192670 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.192625 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66ztw\" (UniqueName: \"kubernetes.io/projected/3c197bf1-2351-42a9-9df7-3fc07db51aaa-kube-api-access-66ztw\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm\" (UID: \"3c197bf1-2351-42a9-9df7-3fc07db51aaa\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm" Jun 08 12:17:54.234058 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.234012 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:54.293699 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.293673 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c197bf1-2351-42a9-9df7-3fc07db51aaa-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm\" (UID: \"3c197bf1-2351-42a9-9df7-3fc07db51aaa\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm" Jun 08 12:17:54.293876 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.293709 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c197bf1-2351-42a9-9df7-3fc07db51aaa-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm\" (UID: \"3c197bf1-2351-42a9-9df7-3fc07db51aaa\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm" Jun 08 12:17:54.293876 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.293748 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66ztw\" (UniqueName: \"kubernetes.io/projected/3c197bf1-2351-42a9-9df7-3fc07db51aaa-kube-api-access-66ztw\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm\" (UID: \"3c197bf1-2351-42a9-9df7-3fc07db51aaa\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm" Jun 08 12:17:54.293876 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.293835 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmm2l\" (UniqueName: \"kubernetes.io/projected/39f7399a-b977-4b9e-b0c5-b0e67fe1f6fa-kube-api-access-hmm2l\") pod \"odh-model-controller-6dc94f689f-9b8fm\" (UID: \"39f7399a-b977-4b9e-b0c5-b0e67fe1f6fa\") " pod="opendatahub/odh-model-controller-6dc94f689f-9b8fm" Jun 08 12:17:54.293876 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.293869 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39f7399a-b977-4b9e-b0c5-b0e67fe1f6fa-cert\") pod \"odh-model-controller-6dc94f689f-9b8fm\" (UID: \"39f7399a-b977-4b9e-b0c5-b0e67fe1f6fa\") " pod="opendatahub/odh-model-controller-6dc94f689f-9b8fm" Jun 08 12:17:54.294090 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:17:54.294012 2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 08 12:17:54.294090 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:17:54.294078 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39f7399a-b977-4b9e-b0c5-b0e67fe1f6fa-cert podName:39f7399a-b977-4b9e-b0c5-b0e67fe1f6fa nodeName:}" failed. No retries permitted until 2026-06-08 12:17:54.794058649 +0000 UTC m=+502.909876788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/39f7399a-b977-4b9e-b0c5-b0e67fe1f6fa-cert") pod "odh-model-controller-6dc94f689f-9b8fm" (UID: "39f7399a-b977-4b9e-b0c5-b0e67fe1f6fa") : secret "odh-model-controller-webhook-cert" not found Jun 08 12:17:54.294195 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.294147 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c197bf1-2351-42a9-9df7-3fc07db51aaa-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm\" (UID: \"3c197bf1-2351-42a9-9df7-3fc07db51aaa\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm" Jun 08 12:17:54.294195 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.294182 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c197bf1-2351-42a9-9df7-3fc07db51aaa-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm\" (UID: \"3c197bf1-2351-42a9-9df7-3fc07db51aaa\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm" Jun 08 12:17:54.336678 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.336648 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmm2l\" (UniqueName: \"kubernetes.io/projected/39f7399a-b977-4b9e-b0c5-b0e67fe1f6fa-kube-api-access-hmm2l\") pod \"odh-model-controller-6dc94f689f-9b8fm\" (UID: \"39f7399a-b977-4b9e-b0c5-b0e67fe1f6fa\") " pod="opendatahub/odh-model-controller-6dc94f689f-9b8fm" Jun 08 12:17:54.336802 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.336715 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66ztw\" (UniqueName: \"kubernetes.io/projected/3c197bf1-2351-42a9-9df7-3fc07db51aaa-kube-api-access-66ztw\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm\" (UID: \"3c197bf1-2351-42a9-9df7-3fc07db51aaa\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm" Jun 08 12:17:54.364223 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.364195 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:54.376729 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.376710 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm" Jun 08 12:17:54.528081 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.528047 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:54.528302 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:17:54.528277 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c197bf1_2351_42a9_9df7_3fc07db51aaa.slice/crio-147f4814d1085cee9a02a38d2ce0b61019fbe79a5fa7b76c05392fb4633a3d09 WatchSource:0}: Error finding container 147f4814d1085cee9a02a38d2ce0b61019fbe79a5fa7b76c05392fb4633a3d09: Status 404 returned error can't find the container with id 147f4814d1085cee9a02a38d2ce0b61019fbe79a5fa7b76c05392fb4633a3d09 Jun 08 12:17:54.528649 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.528630 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm"] Jun 08 12:17:54.749312 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.749233 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:54.799021 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.798999 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39f7399a-b977-4b9e-b0c5-b0e67fe1f6fa-cert\") pod \"odh-model-controller-6dc94f689f-9b8fm\" (UID: \"39f7399a-b977-4b9e-b0c5-b0e67fe1f6fa\") " pod="opendatahub/odh-model-controller-6dc94f689f-9b8fm" Jun 08 12:17:54.801408 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:54.801391 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39f7399a-b977-4b9e-b0c5-b0e67fe1f6fa-cert\") pod \"odh-model-controller-6dc94f689f-9b8fm\" (UID: \"39f7399a-b977-4b9e-b0c5-b0e67fe1f6fa\") " pod="opendatahub/odh-model-controller-6dc94f689f-9b8fm" Jun 08 12:17:55.007769 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:55.007686 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-9b8fm" Jun 08 12:17:55.031667 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:55.031637 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:55.047117 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:55.046560 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-4mx5f"] Jun 08 12:17:55.049339 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:55.049323 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-4mx5f" Jun 08 12:17:55.053281 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:55.053260 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 08 12:17:55.066448 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:55.066156 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-4mx5f"] Jun 08 12:17:55.152598 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:55.152551 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:17:55.159167 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:55.159145 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-9b8fm"] Jun 08 12:17:55.159967 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:17:55.159944 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f7399a_b977_4b9e_b0c5_b0e67fe1f6fa.slice/crio-dd3aefd012e254c4871098f39e0c9c6a5dd24a98eb364ba2c6361d551815dc79 WatchSource:0}: Error finding container dd3aefd012e254c4871098f39e0c9c6a5dd24a98eb364ba2c6361d551815dc79: Status 404 returned error can't find the container with id dd3aefd012e254c4871098f39e0c9c6a5dd24a98eb364ba2c6361d551815dc79 Jun 08 12:17:55.202342 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:55.202315 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qtr7\" (UniqueName: \"kubernetes.io/projected/d3fbe2d0-11a7-4f4b-9e9c-6d5e6b58e0f6-kube-api-access-6qtr7\") pod \"model-serving-api-5dd488fc48-4mx5f\" (UID: \"d3fbe2d0-11a7-4f4b-9e9c-6d5e6b58e0f6\") " pod="opendatahub/model-serving-api-5dd488fc48-4mx5f" Jun 08 12:17:55.202459 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:55.202373 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3fbe2d0-11a7-4f4b-9e9c-6d5e6b58e0f6-tls-certs\") pod \"model-serving-api-5dd488fc48-4mx5f\" (UID: \"d3fbe2d0-11a7-4f4b-9e9c-6d5e6b58e0f6\") " pod="opendatahub/model-serving-api-5dd488fc48-4mx5f" Jun 08 12:17:55.303624 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:55.303555 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qtr7\" (UniqueName: \"kubernetes.io/projected/d3fbe2d0-11a7-4f4b-9e9c-6d5e6b58e0f6-kube-api-access-6qtr7\") pod \"model-serving-api-5dd488fc48-4mx5f\" (UID: \"d3fbe2d0-11a7-4f4b-9e9c-6d5e6b58e0f6\") " pod="opendatahub/model-serving-api-5dd488fc48-4mx5f" Jun 08 12:17:55.303990 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:55.303644 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3fbe2d0-11a7-4f4b-9e9c-6d5e6b58e0f6-tls-certs\") pod \"model-serving-api-5dd488fc48-4mx5f\" (UID: \"d3fbe2d0-11a7-4f4b-9e9c-6d5e6b58e0f6\") " pod="opendatahub/model-serving-api-5dd488fc48-4mx5f" Jun 08 12:17:55.306240 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:55.306221 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3fbe2d0-11a7-4f4b-9e9c-6d5e6b58e0f6-tls-certs\") pod \"model-serving-api-5dd488fc48-4mx5f\" (UID: \"d3fbe2d0-11a7-4f4b-9e9c-6d5e6b58e0f6\") " pod="opendatahub/model-serving-api-5dd488fc48-4mx5f" Jun 08 12:17:55.312934 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:55.312915 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qtr7\" (UniqueName: \"kubernetes.io/projected/d3fbe2d0-11a7-4f4b-9e9c-6d5e6b58e0f6-kube-api-access-6qtr7\") pod \"model-serving-api-5dd488fc48-4mx5f\" (UID: \"d3fbe2d0-11a7-4f4b-9e9c-6d5e6b58e0f6\") " pod="opendatahub/model-serving-api-5dd488fc48-4mx5f" Jun 08 12:17:55.364058 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:55.364028 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-4mx5f" Jun 08 12:17:55.432082 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:55.432049 2565 generic.go:356] "Generic (PLEG): container finished" podID="3c197bf1-2351-42a9-9df7-3fc07db51aaa" containerID="fa3e0b3194de20c35be7b704ac243f0269f256d5fb1a848e884764962c93209a" exitCode=0 Jun 08 12:17:55.432220 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:55.432135 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm" event={"ID":"3c197bf1-2351-42a9-9df7-3fc07db51aaa","Type":"ContainerDied","Data":"fa3e0b3194de20c35be7b704ac243f0269f256d5fb1a848e884764962c93209a"} Jun 08 12:17:55.432220 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:55.432191 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm" event={"ID":"3c197bf1-2351-42a9-9df7-3fc07db51aaa","Type":"ContainerStarted","Data":"147f4814d1085cee9a02a38d2ce0b61019fbe79a5fa7b76c05392fb4633a3d09"} Jun 08 12:17:55.433620 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:55.433599 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-9b8fm" event={"ID":"39f7399a-b977-4b9e-b0c5-b0e67fe1f6fa","Type":"ContainerStarted","Data":"dd3aefd012e254c4871098f39e0c9c6a5dd24a98eb364ba2c6361d551815dc79"} Jun 08 12:17:55.502464 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:55.502436 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-4mx5f"] Jun 08 12:17:55.503652 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:17:55.503623 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3fbe2d0_11a7_4f4b_9e9c_6d5e6b58e0f6.slice/crio-8dcf9ae6ff0ebee58f09b83337362e93735c2dac92984550af11e8d7cc888cf8 WatchSource:0}: Error finding container 8dcf9ae6ff0ebee58f09b83337362e93735c2dac92984550af11e8d7cc888cf8: Status 404 returned error can't find the container with id 8dcf9ae6ff0ebee58f09b83337362e93735c2dac92984550af11e8d7cc888cf8 Jun 08 12:17:56.441979 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:56.441943 2565 generic.go:356] "Generic (PLEG): container finished" podID="3c197bf1-2351-42a9-9df7-3fc07db51aaa" containerID="1305c7a842a74ba857dee37f0d6fe7a79ffa41803d45295f7bca88fba2d72127" exitCode=0 Jun 08 12:17:56.442437 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:56.442027 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm" event={"ID":"3c197bf1-2351-42a9-9df7-3fc07db51aaa","Type":"ContainerDied","Data":"1305c7a842a74ba857dee37f0d6fe7a79ffa41803d45295f7bca88fba2d72127"} Jun 08 12:17:56.444199 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:56.444174 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-4mx5f" event={"ID":"d3fbe2d0-11a7-4f4b-9e9c-6d5e6b58e0f6","Type":"ContainerStarted","Data":"8dcf9ae6ff0ebee58f09b83337362e93735c2dac92984550af11e8d7cc888cf8"} Jun 08 12:17:57.451592 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:57.451555 2565 generic.go:356] "Generic (PLEG): container finished" podID="3c197bf1-2351-42a9-9df7-3fc07db51aaa" containerID="f517f3af26325af7b88abcdf0de38ab960fd5090d333fee8b8a870e83c579e8e" exitCode=0 Jun 08 12:17:57.452004 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:57.451636 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm" event={"ID":"3c197bf1-2351-42a9-9df7-3fc07db51aaa","Type":"ContainerDied","Data":"f517f3af26325af7b88abcdf0de38ab960fd5090d333fee8b8a870e83c579e8e"} Jun 08 12:17:58.669786 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:58.669761 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm" Jun 08 12:17:58.841364 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:58.841274 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66ztw\" (UniqueName: \"kubernetes.io/projected/3c197bf1-2351-42a9-9df7-3fc07db51aaa-kube-api-access-66ztw\") pod \"3c197bf1-2351-42a9-9df7-3fc07db51aaa\" (UID: \"3c197bf1-2351-42a9-9df7-3fc07db51aaa\") " Jun 08 12:17:58.841364 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:58.841335 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c197bf1-2351-42a9-9df7-3fc07db51aaa-util\") pod \"3c197bf1-2351-42a9-9df7-3fc07db51aaa\" (UID: \"3c197bf1-2351-42a9-9df7-3fc07db51aaa\") " Jun 08 12:17:58.841597 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:58.841387 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c197bf1-2351-42a9-9df7-3fc07db51aaa-bundle\") pod \"3c197bf1-2351-42a9-9df7-3fc07db51aaa\" (UID: \"3c197bf1-2351-42a9-9df7-3fc07db51aaa\") " Jun 08 12:17:58.842361 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:58.842336 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c197bf1-2351-42a9-9df7-3fc07db51aaa-bundle" (OuterVolumeSpecName: "bundle") pod "3c197bf1-2351-42a9-9df7-3fc07db51aaa" (UID: "3c197bf1-2351-42a9-9df7-3fc07db51aaa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:17:58.843800 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:58.843769 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c197bf1-2351-42a9-9df7-3fc07db51aaa-kube-api-access-66ztw" (OuterVolumeSpecName: "kube-api-access-66ztw") pod "3c197bf1-2351-42a9-9df7-3fc07db51aaa" (UID: "3c197bf1-2351-42a9-9df7-3fc07db51aaa"). InnerVolumeSpecName "kube-api-access-66ztw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:17:58.849079 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:58.849053 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c197bf1-2351-42a9-9df7-3fc07db51aaa-util" (OuterVolumeSpecName: "util") pod "3c197bf1-2351-42a9-9df7-3fc07db51aaa" (UID: "3c197bf1-2351-42a9-9df7-3fc07db51aaa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:17:58.942600 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:58.942564 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66ztw\" (UniqueName: \"kubernetes.io/projected/3c197bf1-2351-42a9-9df7-3fc07db51aaa-kube-api-access-66ztw\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:17:58.942600 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:58.942600 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c197bf1-2351-42a9-9df7-3fc07db51aaa-util\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:17:58.942859 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:58.942617 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c197bf1-2351-42a9-9df7-3fc07db51aaa-bundle\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:17:59.464828 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:59.464770 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-4mx5f" event={"ID":"d3fbe2d0-11a7-4f4b-9e9c-6d5e6b58e0f6","Type":"ContainerStarted","Data":"7d104c9553ba37c4c021fc2e22ae39d625ac0f46190ad2199b457ccf2ccd6806"} Jun 08 12:17:59.465009 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:59.464876 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-4mx5f" Jun 08 12:17:59.467268 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:59.467244 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm" Jun 08 12:17:59.467268 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:59.467259 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064k2nm" event={"ID":"3c197bf1-2351-42a9-9df7-3fc07db51aaa","Type":"ContainerDied","Data":"147f4814d1085cee9a02a38d2ce0b61019fbe79a5fa7b76c05392fb4633a3d09"} Jun 08 12:17:59.467456 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:59.467300 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="147f4814d1085cee9a02a38d2ce0b61019fbe79a5fa7b76c05392fb4633a3d09" Jun 08 12:17:59.468961 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:59.468933 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-9b8fm" event={"ID":"39f7399a-b977-4b9e-b0c5-b0e67fe1f6fa","Type":"ContainerStarted","Data":"5afa136d4974f33ee09f5adb167da2eb98baa3caf5867b1f8cf9babf8f03f5dd"} Jun 08 12:17:59.469093 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:59.468987 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-9b8fm" Jun 08 12:17:59.493611 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:59.493567 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-4mx5f" podStartSLOduration=0.955573584 podStartE2EDuration="4.493553733s" totalImagesPullingTime="3.537980149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:17:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:17:59.492751952 +0000 UTC m=+507.608570092" watchObservedRunningTime="2026-06-08 12:17:59.493553733 +0000 UTC m=+507.609371871" Jun 08 12:17:59.515590 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:17:59.515545 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-9b8fm" podStartSLOduration=1.673273961 podStartE2EDuration="5.515533017s" totalImagesPullingTime="3.842259056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:17:59.514677534 +0000 UTC m=+507.630495684" watchObservedRunningTime="2026-06-08 12:17:59.515533017 +0000 UTC m=+507.631351154" Jun 08 12:18:02.770620 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.770577 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d9b9957d4-8zkp8"] Jun 08 12:18:02.771059 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.771045 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c197bf1-2351-42a9-9df7-3fc07db51aaa" containerName="pull" Jun 08 12:18:02.771105 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.771061 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c197bf1-2351-42a9-9df7-3fc07db51aaa" containerName="pull" Jun 08 12:18:02.771105 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.771074 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c197bf1-2351-42a9-9df7-3fc07db51aaa" containerName="util" Jun 08 12:18:02.771105 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.771080 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c197bf1-2351-42a9-9df7-3fc07db51aaa" containerName="util" Jun 08 12:18:02.771201 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.771112 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c197bf1-2351-42a9-9df7-3fc07db51aaa" containerName="extract" Jun 08 12:18:02.771201 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.771118 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c197bf1-2351-42a9-9df7-3fc07db51aaa" containerName="extract" Jun 08 12:18:02.771201 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.771191 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c197bf1-2351-42a9-9df7-3fc07db51aaa" containerName="extract" Jun 08 12:18:02.774688 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.774669 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-8zkp8" Jun 08 12:18:02.778474 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.778457 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 08 12:18:02.779678 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.779656 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 08 12:18:02.779766 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.779656 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 08 12:18:02.779766 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.779705 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 08 12:18:02.779766 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.779679 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 08 12:18:02.779766 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.779748 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-chdj7\"" Jun 08 12:18:02.788043 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.788020 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d9b9957d4-8zkp8"] Jun 08 12:18:02.879725 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.879692 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0291ce16-5730-47d2-be39-78e95036928e-metrics-cert\") pod \"lws-controller-manager-6d9b9957d4-8zkp8\" (UID: \"0291ce16-5730-47d2-be39-78e95036928e\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-8zkp8" Jun 08 12:18:02.879964 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.879743 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0291ce16-5730-47d2-be39-78e95036928e-manager-config\") pod \"lws-controller-manager-6d9b9957d4-8zkp8\" (UID: \"0291ce16-5730-47d2-be39-78e95036928e\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-8zkp8" Jun 08 12:18:02.879964 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.879777 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0291ce16-5730-47d2-be39-78e95036928e-cert\") pod \"lws-controller-manager-6d9b9957d4-8zkp8\" (UID: \"0291ce16-5730-47d2-be39-78e95036928e\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-8zkp8" Jun 08 12:18:02.879964 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.879844 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57vqv\" (UniqueName: \"kubernetes.io/projected/0291ce16-5730-47d2-be39-78e95036928e-kube-api-access-57vqv\") pod \"lws-controller-manager-6d9b9957d4-8zkp8\" (UID: \"0291ce16-5730-47d2-be39-78e95036928e\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-8zkp8" Jun 08 12:18:02.981189 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.981155 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0291ce16-5730-47d2-be39-78e95036928e-cert\") pod \"lws-controller-manager-6d9b9957d4-8zkp8\" (UID: \"0291ce16-5730-47d2-be39-78e95036928e\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-8zkp8" Jun 08 12:18:02.981386 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.981201 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57vqv\" (UniqueName: \"kubernetes.io/projected/0291ce16-5730-47d2-be39-78e95036928e-kube-api-access-57vqv\") pod \"lws-controller-manager-6d9b9957d4-8zkp8\" (UID: \"0291ce16-5730-47d2-be39-78e95036928e\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-8zkp8" Jun 08 12:18:02.981386 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.981269 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0291ce16-5730-47d2-be39-78e95036928e-metrics-cert\") pod \"lws-controller-manager-6d9b9957d4-8zkp8\" (UID: \"0291ce16-5730-47d2-be39-78e95036928e\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-8zkp8" Jun 08 12:18:02.981386 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.981291 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0291ce16-5730-47d2-be39-78e95036928e-manager-config\") pod \"lws-controller-manager-6d9b9957d4-8zkp8\" (UID: \"0291ce16-5730-47d2-be39-78e95036928e\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-8zkp8" Jun 08 12:18:02.982059 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.982028 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0291ce16-5730-47d2-be39-78e95036928e-manager-config\") pod \"lws-controller-manager-6d9b9957d4-8zkp8\" (UID: \"0291ce16-5730-47d2-be39-78e95036928e\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-8zkp8" Jun 08 12:18:02.983924 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.983902 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0291ce16-5730-47d2-be39-78e95036928e-cert\") pod \"lws-controller-manager-6d9b9957d4-8zkp8\" (UID: \"0291ce16-5730-47d2-be39-78e95036928e\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-8zkp8" Jun 08 12:18:02.984110 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.984087 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0291ce16-5730-47d2-be39-78e95036928e-metrics-cert\") pod \"lws-controller-manager-6d9b9957d4-8zkp8\" (UID: \"0291ce16-5730-47d2-be39-78e95036928e\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-8zkp8" Jun 08 12:18:02.999953 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:02.999922 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57vqv\" (UniqueName: \"kubernetes.io/projected/0291ce16-5730-47d2-be39-78e95036928e-kube-api-access-57vqv\") pod \"lws-controller-manager-6d9b9957d4-8zkp8\" (UID: \"0291ce16-5730-47d2-be39-78e95036928e\") " pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-8zkp8" Jun 08 12:18:03.084571 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:03.084470 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-8zkp8" Jun 08 12:18:03.248649 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:03.248621 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d9b9957d4-8zkp8"] Jun 08 12:18:03.251269 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:18:03.251241 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0291ce16_5730_47d2_be39_78e95036928e.slice/crio-47dbb5feec5850f774b5e8219fcb992a595a5ffe3ef1c660fef92d412bd192ee WatchSource:0}: Error finding container 47dbb5feec5850f774b5e8219fcb992a595a5ffe3ef1c660fef92d412bd192ee: Status 404 returned error can't find the container with id 47dbb5feec5850f774b5e8219fcb992a595a5ffe3ef1c660fef92d412bd192ee Jun 08 12:18:03.490500 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:03.490465 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-8zkp8" event={"ID":"0291ce16-5730-47d2-be39-78e95036928e","Type":"ContainerStarted","Data":"47dbb5feec5850f774b5e8219fcb992a595a5ffe3ef1c660fef92d412bd192ee"} Jun 08 12:18:05.504074 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:05.504041 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-8zkp8" event={"ID":"0291ce16-5730-47d2-be39-78e95036928e","Type":"ContainerStarted","Data":"35dc93dd5050416cee6b733eece8fbe4bb5f85b9d39148d326570548b3f4b475"} Jun 08 12:18:05.504552 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:05.504099 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-8zkp8" Jun 08 12:18:05.552273 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:05.552220 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-8zkp8" podStartSLOduration=1.705193655 podStartE2EDuration="3.552203897s" totalImagesPullingTime="1.847010242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:18:05.551597432 +0000 UTC m=+513.667415594" watchObservedRunningTime="2026-06-08 12:18:05.552203897 +0000 UTC m=+513.668022036" Jun 08 12:18:06.124318 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:06.124285 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:06.229086 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:06.229051 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:06.371231 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:06.371201 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:06.539428 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:06.539319 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:06.666351 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:06.666314 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:07.576066 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:07.576010 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:07.723147 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:07.723106 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:07.838019 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:07.837921 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:08.806373 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:08.806338 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:08.969126 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:08.969095 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc"] Jun 08 12:18:08.972715 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:08.972699 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc" Jun 08 12:18:08.987909 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:08.987890 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 12:18:08.988217 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:08.988203 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2wp8n\"" Jun 08 12:18:08.989751 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:08.989738 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 12:18:09.043158 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:09.043122 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb28d5f9-8947-4c70-b67f-ab60bbb521a6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc\" (UID: \"fb28d5f9-8947-4c70-b67f-ab60bbb521a6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc" Jun 08 12:18:09.043158 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:09.043167 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb28d5f9-8947-4c70-b67f-ab60bbb521a6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc\" (UID: \"fb28d5f9-8947-4c70-b67f-ab60bbb521a6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc" Jun 08 12:18:09.043309 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:09.043191 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl968\" (UniqueName: \"kubernetes.io/projected/fb28d5f9-8947-4c70-b67f-ab60bbb521a6-kube-api-access-hl968\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc\" (UID: \"fb28d5f9-8947-4c70-b67f-ab60bbb521a6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc" Jun 08 12:18:09.069006 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:09.068946 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc"] Jun 08 12:18:09.143745 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:09.143711 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb28d5f9-8947-4c70-b67f-ab60bbb521a6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc\" (UID: \"fb28d5f9-8947-4c70-b67f-ab60bbb521a6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc" Jun 08 12:18:09.143903 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:09.143755 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb28d5f9-8947-4c70-b67f-ab60bbb521a6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc\" (UID: \"fb28d5f9-8947-4c70-b67f-ab60bbb521a6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc" Jun 08 12:18:09.143903 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:09.143882 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl968\" (UniqueName: \"kubernetes.io/projected/fb28d5f9-8947-4c70-b67f-ab60bbb521a6-kube-api-access-hl968\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc\" (UID: \"fb28d5f9-8947-4c70-b67f-ab60bbb521a6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc" Jun 08 12:18:09.144125 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:09.144109 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb28d5f9-8947-4c70-b67f-ab60bbb521a6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc\" (UID: \"fb28d5f9-8947-4c70-b67f-ab60bbb521a6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc" Jun 08 12:18:09.144189 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:09.144171 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb28d5f9-8947-4c70-b67f-ab60bbb521a6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc\" (UID: \"fb28d5f9-8947-4c70-b67f-ab60bbb521a6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc" Jun 08 12:18:09.162617 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:09.162589 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl968\" (UniqueName: \"kubernetes.io/projected/fb28d5f9-8947-4c70-b67f-ab60bbb521a6-kube-api-access-hl968\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc\" (UID: \"fb28d5f9-8947-4c70-b67f-ab60bbb521a6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc" Jun 08 12:18:09.281722 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:09.281688 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc" Jun 08 12:18:09.440597 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:09.440570 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc"] Jun 08 12:18:09.442478 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:18:09.442440 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb28d5f9_8947_4c70_b67f_ab60bbb521a6.slice/crio-40d06416e5cfc8dfee74f26dfe0e5cffcfe3baf796c8c15695289e04042ebcec WatchSource:0}: Error finding container 40d06416e5cfc8dfee74f26dfe0e5cffcfe3baf796c8c15695289e04042ebcec: Status 404 returned error can't find the container with id 40d06416e5cfc8dfee74f26dfe0e5cffcfe3baf796c8c15695289e04042ebcec Jun 08 12:18:09.532889 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:09.532854 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc" event={"ID":"fb28d5f9-8947-4c70-b67f-ab60bbb521a6","Type":"ContainerStarted","Data":"a7667d7b4ed01ee9cc4bafd6565c5a39e39e55702667667480d756430a699fa8"} Jun 08 12:18:09.533071 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:09.532916 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc" event={"ID":"fb28d5f9-8947-4c70-b67f-ab60bbb521a6","Type":"ContainerStarted","Data":"40d06416e5cfc8dfee74f26dfe0e5cffcfe3baf796c8c15695289e04042ebcec"} Jun 08 12:18:10.476242 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:10.476165 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-9b8fm" Jun 08 12:18:10.478063 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:10.478043 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-4mx5f" Jun 08 12:18:10.538715 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:10.538689 2565 generic.go:356] "Generic (PLEG): container finished" podID="fb28d5f9-8947-4c70-b67f-ab60bbb521a6" containerID="a7667d7b4ed01ee9cc4bafd6565c5a39e39e55702667667480d756430a699fa8" exitCode=0 Jun 08 12:18:10.538880 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:10.538774 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc" event={"ID":"fb28d5f9-8947-4c70-b67f-ab60bbb521a6","Type":"ContainerDied","Data":"a7667d7b4ed01ee9cc4bafd6565c5a39e39e55702667667480d756430a699fa8"} Jun 08 12:18:11.528184 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:11.528147 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:11.545269 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:11.545242 2565 generic.go:356] "Generic (PLEG): container finished" podID="fb28d5f9-8947-4c70-b67f-ab60bbb521a6" containerID="719d15accfd6bc9b48156c6f37eae4162e40c8b249d976226a356a40abbe14a7" exitCode=0 Jun 08 12:18:11.545405 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:11.545300 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc" event={"ID":"fb28d5f9-8947-4c70-b67f-ab60bbb521a6","Type":"ContainerDied","Data":"719d15accfd6bc9b48156c6f37eae4162e40c8b249d976226a356a40abbe14a7"} Jun 08 12:18:12.386141 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:12.386107 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:12.553069 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:12.553031 2565 generic.go:356] "Generic (PLEG): container finished" podID="fb28d5f9-8947-4c70-b67f-ab60bbb521a6" containerID="159383204a0e28c29100d9bc18ea1d00a1de2f2a7c83fc5829d09791fea7dc9f" exitCode=0 Jun 08 12:18:12.553549 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:12.553095 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc" event={"ID":"fb28d5f9-8947-4c70-b67f-ab60bbb521a6","Type":"ContainerDied","Data":"159383204a0e28c29100d9bc18ea1d00a1de2f2a7c83fc5829d09791fea7dc9f"} Jun 08 12:18:12.828703 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:12.828616 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:13.436359 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:13.436330 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:13.695650 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:13.695595 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc" Jun 08 12:18:13.784472 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:13.784446 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb28d5f9-8947-4c70-b67f-ab60bbb521a6-bundle\") pod \"fb28d5f9-8947-4c70-b67f-ab60bbb521a6\" (UID: \"fb28d5f9-8947-4c70-b67f-ab60bbb521a6\") " Jun 08 12:18:13.784623 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:13.784488 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hl968\" (UniqueName: \"kubernetes.io/projected/fb28d5f9-8947-4c70-b67f-ab60bbb521a6-kube-api-access-hl968\") pod \"fb28d5f9-8947-4c70-b67f-ab60bbb521a6\" (UID: \"fb28d5f9-8947-4c70-b67f-ab60bbb521a6\") " Jun 08 12:18:13.784623 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:13.784541 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb28d5f9-8947-4c70-b67f-ab60bbb521a6-util\") pod \"fb28d5f9-8947-4c70-b67f-ab60bbb521a6\" (UID: \"fb28d5f9-8947-4c70-b67f-ab60bbb521a6\") " Jun 08 12:18:13.785802 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:13.785772 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb28d5f9-8947-4c70-b67f-ab60bbb521a6-bundle" (OuterVolumeSpecName: "bundle") pod "fb28d5f9-8947-4c70-b67f-ab60bbb521a6" (UID: "fb28d5f9-8947-4c70-b67f-ab60bbb521a6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:18:13.786870 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:13.786842 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb28d5f9-8947-4c70-b67f-ab60bbb521a6-kube-api-access-hl968" (OuterVolumeSpecName: "kube-api-access-hl968") pod "fb28d5f9-8947-4c70-b67f-ab60bbb521a6" (UID: "fb28d5f9-8947-4c70-b67f-ab60bbb521a6"). InnerVolumeSpecName "kube-api-access-hl968". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:18:13.790590 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:13.790568 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb28d5f9-8947-4c70-b67f-ab60bbb521a6-util" (OuterVolumeSpecName: "util") pod "fb28d5f9-8947-4c70-b67f-ab60bbb521a6" (UID: "fb28d5f9-8947-4c70-b67f-ab60bbb521a6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:18:13.885689 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:13.885665 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb28d5f9-8947-4c70-b67f-ab60bbb521a6-bundle\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:18:13.885689 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:13.885686 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hl968\" (UniqueName: \"kubernetes.io/projected/fb28d5f9-8947-4c70-b67f-ab60bbb521a6-kube-api-access-hl968\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:18:13.885871 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:13.885697 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb28d5f9-8947-4c70-b67f-ab60bbb521a6-util\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:18:14.565278 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:14.565251 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc" Jun 08 12:18:14.565460 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:14.565281 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762awdgjc" event={"ID":"fb28d5f9-8947-4c70-b67f-ab60bbb521a6","Type":"ContainerDied","Data":"40d06416e5cfc8dfee74f26dfe0e5cffcfe3baf796c8c15695289e04042ebcec"} Jun 08 12:18:14.565460 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:14.565332 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40d06416e5cfc8dfee74f26dfe0e5cffcfe3baf796c8c15695289e04042ebcec" Jun 08 12:18:16.511440 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:16.511405 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6d9b9957d4-8zkp8" Jun 08 12:18:24.819632 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:24.819590 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:24.950729 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:24.950698 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:30.027286 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:30.027254 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-556d9fc7f6-7jqvn"] Jun 08 12:18:30.027652 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:30.027639 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb28d5f9-8947-4c70-b67f-ab60bbb521a6" containerName="util" Jun 08 12:18:30.027697 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:30.027653 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb28d5f9-8947-4c70-b67f-ab60bbb521a6" containerName="util" Jun 08 12:18:30.027697 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:30.027662 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb28d5f9-8947-4c70-b67f-ab60bbb521a6" containerName="pull" Jun 08 12:18:30.027697 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:30.027668 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb28d5f9-8947-4c70-b67f-ab60bbb521a6" containerName="pull" Jun 08 12:18:30.027697 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:30.027683 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb28d5f9-8947-4c70-b67f-ab60bbb521a6" containerName="extract" Jun 08 12:18:30.027697 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:30.027688 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb28d5f9-8947-4c70-b67f-ab60bbb521a6" containerName="extract" Jun 08 12:18:30.027867 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:30.027748 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb28d5f9-8947-4c70-b67f-ab60bbb521a6" containerName="extract" Jun 08 12:18:30.030428 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:30.030412 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-556d9fc7f6-7jqvn" Jun 08 12:18:30.033314 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:30.033296 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 08 12:18:30.033646 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:30.033623 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hpf27\"" Jun 08 12:18:30.047843 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:30.047802 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-556d9fc7f6-7jqvn"] Jun 08 12:18:30.055434 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:30.055411 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:30.117506 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:30.117478 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/86e21543-6908-4d69-8e77-231dc46b875e-redirect-config\") pod \"dashboard-redirect-556d9fc7f6-7jqvn\" (UID: \"86e21543-6908-4d69-8e77-231dc46b875e\") " pod="opendatahub/dashboard-redirect-556d9fc7f6-7jqvn" Jun 08 12:18:30.117631 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:30.117520 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbnvq\" (UniqueName: \"kubernetes.io/projected/86e21543-6908-4d69-8e77-231dc46b875e-kube-api-access-rbnvq\") pod \"dashboard-redirect-556d9fc7f6-7jqvn\" (UID: \"86e21543-6908-4d69-8e77-231dc46b875e\") " pod="opendatahub/dashboard-redirect-556d9fc7f6-7jqvn" Jun 08 12:18:30.218700 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:30.218664 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/86e21543-6908-4d69-8e77-231dc46b875e-redirect-config\") pod \"dashboard-redirect-556d9fc7f6-7jqvn\" (UID: \"86e21543-6908-4d69-8e77-231dc46b875e\") " pod="opendatahub/dashboard-redirect-556d9fc7f6-7jqvn" Jun 08 12:18:30.218873 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:30.218712 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbnvq\" (UniqueName: \"kubernetes.io/projected/86e21543-6908-4d69-8e77-231dc46b875e-kube-api-access-rbnvq\") pod \"dashboard-redirect-556d9fc7f6-7jqvn\" (UID: \"86e21543-6908-4d69-8e77-231dc46b875e\") " pod="opendatahub/dashboard-redirect-556d9fc7f6-7jqvn" Jun 08 12:18:30.219367 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:30.219340 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/86e21543-6908-4d69-8e77-231dc46b875e-redirect-config\") pod \"dashboard-redirect-556d9fc7f6-7jqvn\" (UID: \"86e21543-6908-4d69-8e77-231dc46b875e\") " pod="opendatahub/dashboard-redirect-556d9fc7f6-7jqvn" Jun 08 12:18:30.230950 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:30.230923 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbnvq\" (UniqueName: \"kubernetes.io/projected/86e21543-6908-4d69-8e77-231dc46b875e-kube-api-access-rbnvq\") pod \"dashboard-redirect-556d9fc7f6-7jqvn\" (UID: \"86e21543-6908-4d69-8e77-231dc46b875e\") " pod="opendatahub/dashboard-redirect-556d9fc7f6-7jqvn" Jun 08 12:18:30.341110 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:30.341046 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-556d9fc7f6-7jqvn" Jun 08 12:18:30.486515 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:30.486491 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-556d9fc7f6-7jqvn"] Jun 08 12:18:30.488553 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:18:30.488531 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e21543_6908_4d69_8e77_231dc46b875e.slice/crio-98483abdb56a9176c983dd2202aefb5c800e99ed269bb3cc29184c4f17e8d66a WatchSource:0}: Error finding container 98483abdb56a9176c983dd2202aefb5c800e99ed269bb3cc29184c4f17e8d66a: Status 404 returned error can't find the container with id 98483abdb56a9176c983dd2202aefb5c800e99ed269bb3cc29184c4f17e8d66a Jun 08 12:18:30.658438 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:30.658389 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-556d9fc7f6-7jqvn" event={"ID":"86e21543-6908-4d69-8e77-231dc46b875e","Type":"ContainerStarted","Data":"98483abdb56a9176c983dd2202aefb5c800e99ed269bb3cc29184c4f17e8d66a"} Jun 08 12:18:31.318726 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:31.318689 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:33.676532 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:33.676494 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-556d9fc7f6-7jqvn" event={"ID":"86e21543-6908-4d69-8e77-231dc46b875e","Type":"ContainerStarted","Data":"bf4bc5fccaf89746138d94235dd18c6e0143ed539b7447700a2a73a263aa043f"} Jun 08 12:18:33.715889 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:33.715842 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-556d9fc7f6-7jqvn" podStartSLOduration=2.2949849860000002 podStartE2EDuration="4.715806901s" totalImagesPullingTime="2.420821915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:18:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:18:33.71340817 +0000 UTC m=+541.829226308" watchObservedRunningTime="2026-06-08 12:18:33.715806901 +0000 UTC m=+541.831625039" Jun 08 12:18:43.589597 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:43.589558 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:43.689794 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:43.689762 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:44.195277 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:44.195241 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:48.273125 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:48.273083 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:48.479274 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:48.479236 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:48.904941 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:48.904905 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg"] Jun 08 12:18:48.913946 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:48.913920 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:48.917676 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:48.917647 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-tdpxw\"" Jun 08 12:18:48.918367 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:48.918346 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 08 12:18:48.941917 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:48.941887 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg"] Jun 08 12:18:48.976244 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:48.976204 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:48.994031 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:48.994003 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efa6ca32-a146-4cc3-880f-7e11afa17bf1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:48.994123 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:48.994038 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efa6ca32-a146-4cc3-880f-7e11afa17bf1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:48.994123 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:48.994056 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgp7g\" (UniqueName: \"kubernetes.io/projected/efa6ca32-a146-4cc3-880f-7e11afa17bf1-kube-api-access-wgp7g\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:48.994200 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:48.994134 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efa6ca32-a146-4cc3-880f-7e11afa17bf1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:48.994200 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:48.994182 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efa6ca32-a146-4cc3-880f-7e11afa17bf1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:48.994270 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:48.994208 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efa6ca32-a146-4cc3-880f-7e11afa17bf1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:48.994270 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:48.994242 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efa6ca32-a146-4cc3-880f-7e11afa17bf1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:48.994344 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:48.994273 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efa6ca32-a146-4cc3-880f-7e11afa17bf1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:48.994344 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:48.994321 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efa6ca32-a146-4cc3-880f-7e11afa17bf1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:49.094947 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:49.094919 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efa6ca32-a146-4cc3-880f-7e11afa17bf1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:49.095097 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:49.094964 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efa6ca32-a146-4cc3-880f-7e11afa17bf1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:49.095097 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:49.094992 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efa6ca32-a146-4cc3-880f-7e11afa17bf1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:49.095097 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:49.095009 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efa6ca32-a146-4cc3-880f-7e11afa17bf1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:49.095097 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:49.095023 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgp7g\" (UniqueName: \"kubernetes.io/projected/efa6ca32-a146-4cc3-880f-7e11afa17bf1-kube-api-access-wgp7g\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:49.095097 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:49.095054 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efa6ca32-a146-4cc3-880f-7e11afa17bf1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:49.095409 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:49.095181 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efa6ca32-a146-4cc3-880f-7e11afa17bf1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:49.095409 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:49.095225 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efa6ca32-a146-4cc3-880f-7e11afa17bf1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:49.095409 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:49.095283 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efa6ca32-a146-4cc3-880f-7e11afa17bf1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:49.095550 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:49.095448 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efa6ca32-a146-4cc3-880f-7e11afa17bf1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:49.095550 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:49.095494 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efa6ca32-a146-4cc3-880f-7e11afa17bf1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:49.095626 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:49.095541 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efa6ca32-a146-4cc3-880f-7e11afa17bf1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:49.095662 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:49.095648 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efa6ca32-a146-4cc3-880f-7e11afa17bf1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:49.095881 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:49.095863 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efa6ca32-a146-4cc3-880f-7e11afa17bf1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:49.097654 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:49.097627 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efa6ca32-a146-4cc3-880f-7e11afa17bf1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:49.097775 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:49.097755 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efa6ca32-a146-4cc3-880f-7e11afa17bf1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:49.110655 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:49.110630 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgp7g\" (UniqueName: \"kubernetes.io/projected/efa6ca32-a146-4cc3-880f-7e11afa17bf1-kube-api-access-wgp7g\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:49.111178 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:49.111161 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efa6ca32-a146-4cc3-880f-7e11afa17bf1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bckv4bg\" (UID: \"efa6ca32-a146-4cc3-880f-7e11afa17bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:49.184232 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:49.184152 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:49.224562 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:49.224524 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:49.477524 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:18:49.477493 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefa6ca32_a146_4cc3_880f_7e11afa17bf1.slice/crio-9abac5d8e93eff12e31489902b35f2e79a236c743465ce03c172e56e7a887ea1 WatchSource:0}: Error finding container 9abac5d8e93eff12e31489902b35f2e79a236c743465ce03c172e56e7a887ea1: Status 404 returned error can't find the container with id 9abac5d8e93eff12e31489902b35f2e79a236c743465ce03c172e56e7a887ea1 Jun 08 12:18:49.484743 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:49.484720 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg"] Jun 08 12:18:49.575651 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:49.575622 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:49.766301 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:49.766218 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" event={"ID":"efa6ca32-a146-4cc3-880f-7e11afa17bf1","Type":"ContainerStarted","Data":"9abac5d8e93eff12e31489902b35f2e79a236c743465ce03c172e56e7a887ea1"} Jun 08 12:18:50.146967 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:50.146935 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:52.927758 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:52.927715 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 08 12:18:52.928073 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:52.927792 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 08 12:18:52.928073 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:52.927837 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 08 12:18:53.792241 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:53.792199 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" event={"ID":"efa6ca32-a146-4cc3-880f-7e11afa17bf1","Type":"ContainerStarted","Data":"5224ce0f1cf519b87c108d10c5b74392444c80806e63a7daa9a977cfb62f3aba"} Jun 08 12:18:53.833156 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:53.833103 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" podStartSLOduration=2.385164451 podStartE2EDuration="5.833088477s" totalImagesPullingTime="3.447924026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:18:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:18:53.832366865 +0000 UTC m=+561.948185002" watchObservedRunningTime="2026-06-08 12:18:53.833088477 +0000 UTC m=+561.948906615" Jun 08 12:18:54.225153 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:54.225117 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:54.229272 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:54.229250 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:54.797402 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:54.797368 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:54.798174 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:54.798153 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bckv4bg" Jun 08 12:18:55.114676 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:55.114600 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qvdwx"] Jun 08 12:18:55.117290 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:55.117274 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qvdwx" Jun 08 12:18:55.121530 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:18:55.121504 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-catalog-qvdwx\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="64546651-63a0-4871-9b19-f1ceb4faddfa" pod="kuadrant-system/kuadrant-operator-catalog-qvdwx" Jun 08 12:18:55.121778 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:18:55.121761 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kuadrant-operator-catalog-dockercfg-628ds\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-628ds\"" type="*v1.Secret" Jun 08 12:18:55.122096 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:18:55.122073 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jun 08 12:18:55.122292 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:18:55.122269 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 08 12:18:55.152705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:55.152677 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7rvg\" (UniqueName: \"kubernetes.io/projected/64546651-63a0-4871-9b19-f1ceb4faddfa-kube-api-access-b7rvg\") pod \"kuadrant-operator-catalog-qvdwx\" (UID: \"64546651-63a0-4871-9b19-f1ceb4faddfa\") " pod="kuadrant-system/kuadrant-operator-catalog-qvdwx" Jun 08 12:18:55.164790 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:55.164763 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qvdwx"] Jun 08 12:18:55.254114 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:55.254078 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7rvg\" (UniqueName: \"kubernetes.io/projected/64546651-63a0-4871-9b19-f1ceb4faddfa-kube-api-access-b7rvg\") pod \"kuadrant-operator-catalog-qvdwx\" (UID: \"64546651-63a0-4871-9b19-f1ceb4faddfa\") " pod="kuadrant-system/kuadrant-operator-catalog-qvdwx" Jun 08 12:18:55.439174 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:55.439143 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qvdwx"] Jun 08 12:18:55.439401 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:18:55.439381 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-b7rvg], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-catalog-qvdwx" podUID="64546651-63a0-4871-9b19-f1ceb4faddfa" Jun 08 12:18:55.562206 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:55.562172 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:55.661230 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:55.661201 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lwbj7"] Jun 08 12:18:55.663530 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:55.663514 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lwbj7" Jun 08 12:18:55.687143 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:55.687119 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lwbj7"] Jun 08 12:18:55.704585 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:55.704531 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:55.759011 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:55.758983 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmkpg\" (UniqueName: \"kubernetes.io/projected/57d27191-f6ea-4e98-b267-7d7525e6f0c2-kube-api-access-lmkpg\") pod \"kuadrant-operator-catalog-lwbj7\" (UID: \"57d27191-f6ea-4e98-b267-7d7525e6f0c2\") " pod="kuadrant-system/kuadrant-operator-catalog-lwbj7" Jun 08 12:18:55.801952 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:55.801918 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qvdwx" Jun 08 12:18:55.807741 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:55.807721 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qvdwx" Jun 08 12:18:55.860463 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:55.860435 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmkpg\" (UniqueName: \"kubernetes.io/projected/57d27191-f6ea-4e98-b267-7d7525e6f0c2-kube-api-access-lmkpg\") pod \"kuadrant-operator-catalog-lwbj7\" (UID: \"57d27191-f6ea-4e98-b267-7d7525e6f0c2\") " pod="kuadrant-system/kuadrant-operator-catalog-lwbj7" Jun 08 12:18:56.264013 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:18:56.263968 2565 projected.go:291] Couldn't get configMap kuadrant-system/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jun 08 12:18:56.404823 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:56.404783 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 12:18:56.414771 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:18:56.414746 2565 projected.go:196] Error preparing data for projected volume kube-api-access-b7rvg for pod kuadrant-system/kuadrant-operator-catalog-qvdwx: failed to sync configmap cache: timed out waiting for the condition Jun 08 12:18:56.414915 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:18:56.414851 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64546651-63a0-4871-9b19-f1ceb4faddfa-kube-api-access-b7rvg podName:64546651-63a0-4871-9b19-f1ceb4faddfa nodeName:}" failed. No retries permitted until 2026-06-08 12:18:56.914835546 +0000 UTC m=+565.030653665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b7rvg" (UniqueName: "kubernetes.io/projected/64546651-63a0-4871-9b19-f1ceb4faddfa-kube-api-access-b7rvg") pod "kuadrant-operator-catalog-qvdwx" (UID: "64546651-63a0-4871-9b19-f1ceb4faddfa") : failed to sync configmap cache: timed out waiting for the condition Jun 08 12:18:56.425058 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:56.425036 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-628ds\"" Jun 08 12:18:56.456657 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:56.456631 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 12:18:56.465776 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:56.465750 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmkpg\" (UniqueName: \"kubernetes.io/projected/57d27191-f6ea-4e98-b267-7d7525e6f0c2-kube-api-access-lmkpg\") pod \"kuadrant-operator-catalog-lwbj7\" (UID: \"57d27191-f6ea-4e98-b267-7d7525e6f0c2\") " pod="kuadrant-system/kuadrant-operator-catalog-lwbj7" Jun 08 12:18:56.573411 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:56.573331 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lwbj7" Jun 08 12:18:56.717006 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:56.716975 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lwbj7"] Jun 08 12:18:56.717282 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:18:56.717263 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57d27191_f6ea_4e98_b267_7d7525e6f0c2.slice/crio-535f4c5c56fbcd6ef08768ff96924981530172a223b563ec6b711649baaa86b0 WatchSource:0}: Error finding container 535f4c5c56fbcd6ef08768ff96924981530172a223b563ec6b711649baaa86b0: Status 404 returned error can't find the container with id 535f4c5c56fbcd6ef08768ff96924981530172a223b563ec6b711649baaa86b0 Jun 08 12:18:56.807917 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:56.807880 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lwbj7" event={"ID":"57d27191-f6ea-4e98-b267-7d7525e6f0c2","Type":"ContainerStarted","Data":"535f4c5c56fbcd6ef08768ff96924981530172a223b563ec6b711649baaa86b0"} Jun 08 12:18:56.807917 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:56.807905 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qvdwx" Jun 08 12:18:56.855362 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:56.855293 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qvdwx"] Jun 08 12:18:56.865641 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:56.865612 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qvdwx"] Jun 08 12:18:56.970124 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:56.970092 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7rvg\" (UniqueName: \"kubernetes.io/projected/64546651-63a0-4871-9b19-f1ceb4faddfa-kube-api-access-b7rvg\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:18:58.348313 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:58.348282 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64546651-63a0-4871-9b19-f1ceb4faddfa" path="/var/lib/kubelet/pods/64546651-63a0-4871-9b19-f1ceb4faddfa/volumes" Jun 08 12:18:58.624453 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:58.624419 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:58.741230 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:58.741191 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:18:59.827890 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:59.827849 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lwbj7" event={"ID":"57d27191-f6ea-4e98-b267-7d7525e6f0c2","Type":"ContainerStarted","Data":"1ccd69b8a6eabd2004ff88fa6743499642a09b0609ec38543d0c2cceb25fc113"} Jun 08 12:18:59.865077 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:18:59.865031 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lwbj7" podStartSLOduration=2.32861439 podStartE2EDuration="4.865015376s" totalImagesPullingTime="2.536400986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:18:59.863403374 +0000 UTC m=+567.979221514" watchObservedRunningTime="2026-06-08 12:18:59.865015376 +0000 UTC m=+567.980833547" Jun 08 12:19:06.574520 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:06.574486 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-lwbj7" Jun 08 12:19:06.575032 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:06.574538 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-lwbj7" Jun 08 12:19:06.597203 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:06.597176 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-lwbj7" Jun 08 12:19:06.885955 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:06.885931 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-lwbj7" Jun 08 12:19:11.202473 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.202437 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58"] Jun 08 12:19:11.213216 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.213193 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58" Jun 08 12:19:11.220434 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.220273 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4pvhh\"" Jun 08 12:19:11.222421 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.222396 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58"] Jun 08 12:19:11.310390 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.310358 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/097248d3-81fb-4af3-8868-3e4d416cff72-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58\" (UID: \"097248d3-81fb-4af3-8868-3e4d416cff72\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58" Jun 08 12:19:11.310544 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.310436 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/097248d3-81fb-4af3-8868-3e4d416cff72-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58\" (UID: \"097248d3-81fb-4af3-8868-3e4d416cff72\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58" Jun 08 12:19:11.310544 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.310464 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcg85\" (UniqueName: \"kubernetes.io/projected/097248d3-81fb-4af3-8868-3e4d416cff72-kube-api-access-hcg85\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58\" (UID: \"097248d3-81fb-4af3-8868-3e4d416cff72\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58" Jun 08 12:19:11.410934 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.410899 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/097248d3-81fb-4af3-8868-3e4d416cff72-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58\" (UID: \"097248d3-81fb-4af3-8868-3e4d416cff72\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58" Jun 08 12:19:11.411086 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.410955 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcg85\" (UniqueName: \"kubernetes.io/projected/097248d3-81fb-4af3-8868-3e4d416cff72-kube-api-access-hcg85\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58\" (UID: \"097248d3-81fb-4af3-8868-3e4d416cff72\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58" Jun 08 12:19:11.411086 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.410993 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/097248d3-81fb-4af3-8868-3e4d416cff72-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58\" (UID: \"097248d3-81fb-4af3-8868-3e4d416cff72\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58" Jun 08 12:19:11.411300 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.411279 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/097248d3-81fb-4af3-8868-3e4d416cff72-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58\" (UID: \"097248d3-81fb-4af3-8868-3e4d416cff72\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58" Jun 08 12:19:11.411375 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.411321 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/097248d3-81fb-4af3-8868-3e4d416cff72-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58\" (UID: \"097248d3-81fb-4af3-8868-3e4d416cff72\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58" Jun 08 12:19:11.422960 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.422933 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcg85\" (UniqueName: \"kubernetes.io/projected/097248d3-81fb-4af3-8868-3e4d416cff72-kube-api-access-hcg85\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58\" (UID: \"097248d3-81fb-4af3-8868-3e4d416cff72\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58" Jun 08 12:19:11.523249 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.523183 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58" Jun 08 12:19:11.664335 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.664307 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58"] Jun 08 12:19:11.665118 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:19:11.665089 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod097248d3_81fb_4af3_8868_3e4d416cff72.slice/crio-15db4b0ee1b4894cc1bd4b50898d5799aa79aa0da683c7fc6c1cab1e7bd05699 WatchSource:0}: Error finding container 15db4b0ee1b4894cc1bd4b50898d5799aa79aa0da683c7fc6c1cab1e7bd05699: Status 404 returned error can't find the container with id 15db4b0ee1b4894cc1bd4b50898d5799aa79aa0da683c7fc6c1cab1e7bd05699 Jun 08 12:19:11.804015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.803984 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8"] Jun 08 12:19:11.807641 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.807625 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8" Jun 08 12:19:11.822755 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.822733 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8"] Jun 08 12:19:11.898732 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.898697 2565 generic.go:356] "Generic (PLEG): container finished" podID="097248d3-81fb-4af3-8868-3e4d416cff72" containerID="50eb8732ebdcea532c969674c9bc6c2c949af0ef04eae603b2273f08a7e772a8" exitCode=0 Jun 08 12:19:11.898900 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.898792 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58" event={"ID":"097248d3-81fb-4af3-8868-3e4d416cff72","Type":"ContainerDied","Data":"50eb8732ebdcea532c969674c9bc6c2c949af0ef04eae603b2273f08a7e772a8"} Jun 08 12:19:11.898900 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.898885 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58" event={"ID":"097248d3-81fb-4af3-8868-3e4d416cff72","Type":"ContainerStarted","Data":"15db4b0ee1b4894cc1bd4b50898d5799aa79aa0da683c7fc6c1cab1e7bd05699"} Jun 08 12:19:11.914697 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.914676 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzzrw\" (UniqueName: \"kubernetes.io/projected/f167c13a-2d11-49aa-8a89-1610f8861c32-kube-api-access-nzzrw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8\" (UID: \"f167c13a-2d11-49aa-8a89-1610f8861c32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8" Jun 08 12:19:11.914790 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.914718 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f167c13a-2d11-49aa-8a89-1610f8861c32-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8\" (UID: \"f167c13a-2d11-49aa-8a89-1610f8861c32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8" Jun 08 12:19:11.914790 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:11.914787 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f167c13a-2d11-49aa-8a89-1610f8861c32-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8\" (UID: \"f167c13a-2d11-49aa-8a89-1610f8861c32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8" Jun 08 12:19:12.015771 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.015744 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzzrw\" (UniqueName: \"kubernetes.io/projected/f167c13a-2d11-49aa-8a89-1610f8861c32-kube-api-access-nzzrw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8\" (UID: \"f167c13a-2d11-49aa-8a89-1610f8861c32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8" Jun 08 12:19:12.015921 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.015785 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f167c13a-2d11-49aa-8a89-1610f8861c32-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8\" (UID: \"f167c13a-2d11-49aa-8a89-1610f8861c32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8" Jun 08 12:19:12.015921 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.015873 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f167c13a-2d11-49aa-8a89-1610f8861c32-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8\" (UID: \"f167c13a-2d11-49aa-8a89-1610f8861c32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8" Jun 08 12:19:12.016206 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.016184 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f167c13a-2d11-49aa-8a89-1610f8861c32-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8\" (UID: \"f167c13a-2d11-49aa-8a89-1610f8861c32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8" Jun 08 12:19:12.016260 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.016217 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f167c13a-2d11-49aa-8a89-1610f8861c32-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8\" (UID: \"f167c13a-2d11-49aa-8a89-1610f8861c32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8" Jun 08 12:19:12.030731 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.030685 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzzrw\" (UniqueName: \"kubernetes.io/projected/f167c13a-2d11-49aa-8a89-1610f8861c32-kube-api-access-nzzrw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8\" (UID: \"f167c13a-2d11-49aa-8a89-1610f8861c32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8" Jun 08 12:19:12.150002 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.149974 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8" Jun 08 12:19:12.212751 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.212721 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx"] Jun 08 12:19:12.217849 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.217826 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx" Jun 08 12:19:12.221456 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:19:12.221431 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="fca9372a-9af8-46f6-8ff1-e08baf379bf5" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx" Jun 08 12:19:12.253279 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.253249 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx"] Jun 08 12:19:12.304317 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.304291 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8"] Jun 08 12:19:12.306142 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:19:12.306113 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf167c13a_2d11_49aa_8a89_1610f8861c32.slice/crio-06cb7aa172197fe3d34f817434de0e4f8e36ed432f34d8e7c67057744ce09b58 WatchSource:0}: Error finding container 06cb7aa172197fe3d34f817434de0e4f8e36ed432f34d8e7c67057744ce09b58: Status 404 returned error can't find the container with id 06cb7aa172197fe3d34f817434de0e4f8e36ed432f34d8e7c67057744ce09b58 Jun 08 12:19:12.318549 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.318516 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fca9372a-9af8-46f6-8ff1-e08baf379bf5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx\" (UID: \"fca9372a-9af8-46f6-8ff1-e08baf379bf5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx" Jun 08 12:19:12.318646 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.318557 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fca9372a-9af8-46f6-8ff1-e08baf379bf5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx\" (UID: \"fca9372a-9af8-46f6-8ff1-e08baf379bf5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx" Jun 08 12:19:12.318710 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.318677 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn9hz\" (UniqueName: \"kubernetes.io/projected/fca9372a-9af8-46f6-8ff1-e08baf379bf5-kube-api-access-cn9hz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx\" (UID: \"fca9372a-9af8-46f6-8ff1-e08baf379bf5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx" Jun 08 12:19:12.419949 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.419921 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fca9372a-9af8-46f6-8ff1-e08baf379bf5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx\" (UID: \"fca9372a-9af8-46f6-8ff1-e08baf379bf5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx" Jun 08 12:19:12.420093 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.419957 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fca9372a-9af8-46f6-8ff1-e08baf379bf5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx\" (UID: \"fca9372a-9af8-46f6-8ff1-e08baf379bf5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx" Jun 08 12:19:12.420093 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.420005 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn9hz\" (UniqueName: \"kubernetes.io/projected/fca9372a-9af8-46f6-8ff1-e08baf379bf5-kube-api-access-cn9hz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx\" (UID: \"fca9372a-9af8-46f6-8ff1-e08baf379bf5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx" Jun 08 12:19:12.420333 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.420307 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fca9372a-9af8-46f6-8ff1-e08baf379bf5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx\" (UID: \"fca9372a-9af8-46f6-8ff1-e08baf379bf5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx" Jun 08 12:19:12.420384 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.420333 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fca9372a-9af8-46f6-8ff1-e08baf379bf5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx\" (UID: \"fca9372a-9af8-46f6-8ff1-e08baf379bf5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx" Jun 08 12:19:12.434526 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.434504 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn9hz\" (UniqueName: \"kubernetes.io/projected/fca9372a-9af8-46f6-8ff1-e08baf379bf5-kube-api-access-cn9hz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx\" (UID: \"fca9372a-9af8-46f6-8ff1-e08baf379bf5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx" Jun 08 12:19:12.527315 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.527290 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx" Jun 08 12:19:12.588313 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.588284 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr"] Jun 08 12:19:12.593726 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.593704 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr" Jun 08 12:19:12.611490 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.611465 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr"] Jun 08 12:19:12.676805 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.676778 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx"] Jun 08 12:19:12.678178 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:19:12.678156 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfca9372a_9af8_46f6_8ff1_e08baf379bf5.slice/crio-1c47591bc84e2d8b1a7749399c0af8264fe84bf268ae6d914cb58061c3c85b24 WatchSource:0}: Error finding container 1c47591bc84e2d8b1a7749399c0af8264fe84bf268ae6d914cb58061c3c85b24: Status 404 returned error can't find the container with id 1c47591bc84e2d8b1a7749399c0af8264fe84bf268ae6d914cb58061c3c85b24 Jun 08 12:19:12.723234 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.723210 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5588aaf5-551b-484d-9766-977650d6b98a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr\" (UID: \"5588aaf5-551b-484d-9766-977650d6b98a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr" Jun 08 12:19:12.723325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.723249 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5588aaf5-551b-484d-9766-977650d6b98a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr\" (UID: \"5588aaf5-551b-484d-9766-977650d6b98a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr" Jun 08 12:19:12.723325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.723273 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5p5n\" (UniqueName: \"kubernetes.io/projected/5588aaf5-551b-484d-9766-977650d6b98a-kube-api-access-w5p5n\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr\" (UID: \"5588aaf5-551b-484d-9766-977650d6b98a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr" Jun 08 12:19:12.824288 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.824259 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5588aaf5-551b-484d-9766-977650d6b98a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr\" (UID: \"5588aaf5-551b-484d-9766-977650d6b98a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr" Jun 08 12:19:12.824430 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.824301 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5588aaf5-551b-484d-9766-977650d6b98a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr\" (UID: \"5588aaf5-551b-484d-9766-977650d6b98a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr" Jun 08 12:19:12.824430 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.824323 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5p5n\" (UniqueName: \"kubernetes.io/projected/5588aaf5-551b-484d-9766-977650d6b98a-kube-api-access-w5p5n\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr\" (UID: \"5588aaf5-551b-484d-9766-977650d6b98a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr" Jun 08 12:19:12.824644 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.824626 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5588aaf5-551b-484d-9766-977650d6b98a-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr\" (UID: \"5588aaf5-551b-484d-9766-977650d6b98a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr" Jun 08 12:19:12.824732 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.824713 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5588aaf5-551b-484d-9766-977650d6b98a-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr\" (UID: \"5588aaf5-551b-484d-9766-977650d6b98a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr" Jun 08 12:19:12.836673 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.836607 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5p5n\" (UniqueName: \"kubernetes.io/projected/5588aaf5-551b-484d-9766-977650d6b98a-kube-api-access-w5p5n\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr\" (UID: \"5588aaf5-551b-484d-9766-977650d6b98a\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr" Jun 08 12:19:12.904086 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.904063 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr" Jun 08 12:19:12.905580 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.905554 2565 generic.go:356] "Generic (PLEG): container finished" podID="f167c13a-2d11-49aa-8a89-1610f8861c32" containerID="e806046f2fc9de730a0335c1291fa6822318b128c7d02c5b6f7576da92fb69ac" exitCode=0 Jun 08 12:19:12.905700 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.905632 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8" event={"ID":"f167c13a-2d11-49aa-8a89-1610f8861c32","Type":"ContainerDied","Data":"e806046f2fc9de730a0335c1291fa6822318b128c7d02c5b6f7576da92fb69ac"} Jun 08 12:19:12.905700 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.905677 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8" event={"ID":"f167c13a-2d11-49aa-8a89-1610f8861c32","Type":"ContainerStarted","Data":"06cb7aa172197fe3d34f817434de0e4f8e36ed432f34d8e7c67057744ce09b58"} Jun 08 12:19:12.907175 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.907155 2565 generic.go:356] "Generic (PLEG): container finished" podID="fca9372a-9af8-46f6-8ff1-e08baf379bf5" containerID="a21835622be5fd3e85006e4a021ccfee91946579cdc7b8141ce5326d2f2859b0" exitCode=0 Jun 08 12:19:12.907263 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.907224 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx" event={"ID":"fca9372a-9af8-46f6-8ff1-e08baf379bf5","Type":"ContainerDied","Data":"a21835622be5fd3e85006e4a021ccfee91946579cdc7b8141ce5326d2f2859b0"} Jun 08 12:19:12.907263 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:12.907255 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx" event={"ID":"fca9372a-9af8-46f6-8ff1-e08baf379bf5","Type":"ContainerStarted","Data":"1c47591bc84e2d8b1a7749399c0af8264fe84bf268ae6d914cb58061c3c85b24"} Jun 08 12:19:13.076024 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:19:13.075998 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5588aaf5_551b_484d_9766_977650d6b98a.slice/crio-4c9973c113d4062b766cae2325223130cb1e615ccf5b5b3502fe3fb0e47655e5 WatchSource:0}: Error finding container 4c9973c113d4062b766cae2325223130cb1e615ccf5b5b3502fe3fb0e47655e5: Status 404 returned error can't find the container with id 4c9973c113d4062b766cae2325223130cb1e615ccf5b5b3502fe3fb0e47655e5 Jun 08 12:19:13.076144 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:13.076053 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr"] Jun 08 12:19:13.914073 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:13.914036 2565 generic.go:356] "Generic (PLEG): container finished" podID="097248d3-81fb-4af3-8868-3e4d416cff72" containerID="5e35059ba95b829630857fc3f298bfe5fbbd5123980283b3c732189441efc7e8" exitCode=0 Jun 08 12:19:13.914530 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:13.914117 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58" event={"ID":"097248d3-81fb-4af3-8868-3e4d416cff72","Type":"ContainerDied","Data":"5e35059ba95b829630857fc3f298bfe5fbbd5123980283b3c732189441efc7e8"} Jun 08 12:19:13.915670 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:13.915646 2565 generic.go:356] "Generic (PLEG): container finished" podID="5588aaf5-551b-484d-9766-977650d6b98a" containerID="be73b247911437559a364af4b409023f3b9866ce35cb7c1e66c8ebe848c2ac64" exitCode=0 Jun 08 12:19:13.915778 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:13.915675 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr" event={"ID":"5588aaf5-551b-484d-9766-977650d6b98a","Type":"ContainerDied","Data":"be73b247911437559a364af4b409023f3b9866ce35cb7c1e66c8ebe848c2ac64"} Jun 08 12:19:13.915778 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:13.915719 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr" event={"ID":"5588aaf5-551b-484d-9766-977650d6b98a","Type":"ContainerStarted","Data":"4c9973c113d4062b766cae2325223130cb1e615ccf5b5b3502fe3fb0e47655e5"} Jun 08 12:19:14.925524 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:14.925482 2565 generic.go:356] "Generic (PLEG): container finished" podID="fca9372a-9af8-46f6-8ff1-e08baf379bf5" containerID="300a43c8703965e169437a9aa4a288a05643a75377586b9b106a60ab4d6b7492" exitCode=0 Jun 08 12:19:14.925945 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:14.925563 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx" event={"ID":"fca9372a-9af8-46f6-8ff1-e08baf379bf5","Type":"ContainerDied","Data":"300a43c8703965e169437a9aa4a288a05643a75377586b9b106a60ab4d6b7492"} Jun 08 12:19:14.927962 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:14.927939 2565 generic.go:356] "Generic (PLEG): container finished" podID="097248d3-81fb-4af3-8868-3e4d416cff72" containerID="0ccff4eea4d0e02f5baee3b68ac42606416a12860d7510b4eb747a2203a73713" exitCode=0 Jun 08 12:19:14.928085 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:14.928016 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58" event={"ID":"097248d3-81fb-4af3-8868-3e4d416cff72","Type":"ContainerDied","Data":"0ccff4eea4d0e02f5baee3b68ac42606416a12860d7510b4eb747a2203a73713"} Jun 08 12:19:14.929736 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:14.929718 2565 generic.go:356] "Generic (PLEG): container finished" podID="f167c13a-2d11-49aa-8a89-1610f8861c32" containerID="36d5cc4d93fa3e788aab99a72467389d585b62afbafde7f10af3c429ae69b4d8" exitCode=0 Jun 08 12:19:14.929845 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:14.929749 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8" event={"ID":"f167c13a-2d11-49aa-8a89-1610f8861c32","Type":"ContainerDied","Data":"36d5cc4d93fa3e788aab99a72467389d585b62afbafde7f10af3c429ae69b4d8"} Jun 08 12:19:15.937003 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:15.936971 2565 generic.go:356] "Generic (PLEG): container finished" podID="5588aaf5-551b-484d-9766-977650d6b98a" containerID="59e8ac940f73486e100072bc7232544709830977aa3620c3d339732f34c4cac0" exitCode=0 Jun 08 12:19:15.937370 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:15.937063 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr" event={"ID":"5588aaf5-551b-484d-9766-977650d6b98a","Type":"ContainerDied","Data":"59e8ac940f73486e100072bc7232544709830977aa3620c3d339732f34c4cac0"} Jun 08 12:19:15.939222 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:15.939199 2565 generic.go:356] "Generic (PLEG): container finished" podID="f167c13a-2d11-49aa-8a89-1610f8861c32" containerID="21c5f960a8f1b7a505905f10092e5203c3ddf642a2227e8f2b7ce5557645fae5" exitCode=0 Jun 08 12:19:15.939320 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:15.939275 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8" event={"ID":"f167c13a-2d11-49aa-8a89-1610f8861c32","Type":"ContainerDied","Data":"21c5f960a8f1b7a505905f10092e5203c3ddf642a2227e8f2b7ce5557645fae5"} Jun 08 12:19:15.941226 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:15.941204 2565 generic.go:356] "Generic (PLEG): container finished" podID="fca9372a-9af8-46f6-8ff1-e08baf379bf5" containerID="5f0712e6ad00124f7f5bc89407a607ddfe5d1edac2c5162cc0492dc498e8d74e" exitCode=0 Jun 08 12:19:15.941312 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:15.941279 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx" event={"ID":"fca9372a-9af8-46f6-8ff1-e08baf379bf5","Type":"ContainerDied","Data":"5f0712e6ad00124f7f5bc89407a607ddfe5d1edac2c5162cc0492dc498e8d74e"} Jun 08 12:19:16.098394 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:16.098373 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58" Jun 08 12:19:16.259525 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:16.259447 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcg85\" (UniqueName: \"kubernetes.io/projected/097248d3-81fb-4af3-8868-3e4d416cff72-kube-api-access-hcg85\") pod \"097248d3-81fb-4af3-8868-3e4d416cff72\" (UID: \"097248d3-81fb-4af3-8868-3e4d416cff72\") " Jun 08 12:19:16.259664 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:16.259531 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/097248d3-81fb-4af3-8868-3e4d416cff72-bundle\") pod \"097248d3-81fb-4af3-8868-3e4d416cff72\" (UID: \"097248d3-81fb-4af3-8868-3e4d416cff72\") " Jun 08 12:19:16.259664 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:16.259554 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/097248d3-81fb-4af3-8868-3e4d416cff72-util\") pod \"097248d3-81fb-4af3-8868-3e4d416cff72\" (UID: \"097248d3-81fb-4af3-8868-3e4d416cff72\") " Jun 08 12:19:16.260010 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:16.259983 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/097248d3-81fb-4af3-8868-3e4d416cff72-bundle" (OuterVolumeSpecName: "bundle") pod "097248d3-81fb-4af3-8868-3e4d416cff72" (UID: "097248d3-81fb-4af3-8868-3e4d416cff72"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:19:16.261729 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:16.261705 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/097248d3-81fb-4af3-8868-3e4d416cff72-kube-api-access-hcg85" (OuterVolumeSpecName: "kube-api-access-hcg85") pod "097248d3-81fb-4af3-8868-3e4d416cff72" (UID: "097248d3-81fb-4af3-8868-3e4d416cff72"). InnerVolumeSpecName "kube-api-access-hcg85". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:19:16.265163 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:16.265141 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/097248d3-81fb-4af3-8868-3e4d416cff72-util" (OuterVolumeSpecName: "util") pod "097248d3-81fb-4af3-8868-3e4d416cff72" (UID: "097248d3-81fb-4af3-8868-3e4d416cff72"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:19:16.360235 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:16.360212 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/097248d3-81fb-4af3-8868-3e4d416cff72-bundle\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:19:16.360235 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:16.360235 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/097248d3-81fb-4af3-8868-3e4d416cff72-util\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:19:16.360380 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:16.360244 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcg85\" (UniqueName: \"kubernetes.io/projected/097248d3-81fb-4af3-8868-3e4d416cff72-kube-api-access-hcg85\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:19:16.948955 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:16.948925 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58" Jun 08 12:19:16.949472 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:16.948919 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58" event={"ID":"097248d3-81fb-4af3-8868-3e4d416cff72","Type":"ContainerDied","Data":"15db4b0ee1b4894cc1bd4b50898d5799aa79aa0da683c7fc6c1cab1e7bd05699"} Jun 08 12:19:16.949472 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:16.949035 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15db4b0ee1b4894cc1bd4b50898d5799aa79aa0da683c7fc6c1cab1e7bd05699" Jun 08 12:19:16.951170 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:16.951147 2565 generic.go:356] "Generic (PLEG): container finished" podID="5588aaf5-551b-484d-9766-977650d6b98a" containerID="dd2eb2c7b35f1c6452be0b9c820d3cfaea93507753351d724be017efd3385a0c" exitCode=0 Jun 08 12:19:16.951317 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:16.951248 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr" event={"ID":"5588aaf5-551b-484d-9766-977650d6b98a","Type":"ContainerDied","Data":"dd2eb2c7b35f1c6452be0b9c820d3cfaea93507753351d724be017efd3385a0c"} Jun 08 12:19:17.112058 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.112030 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx" Jun 08 12:19:17.114976 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.114956 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8" Jun 08 12:19:17.269882 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.269772 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzzrw\" (UniqueName: \"kubernetes.io/projected/f167c13a-2d11-49aa-8a89-1610f8861c32-kube-api-access-nzzrw\") pod \"f167c13a-2d11-49aa-8a89-1610f8861c32\" (UID: \"f167c13a-2d11-49aa-8a89-1610f8861c32\") " Jun 08 12:19:17.269882 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.269866 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f167c13a-2d11-49aa-8a89-1610f8861c32-util\") pod \"f167c13a-2d11-49aa-8a89-1610f8861c32\" (UID: \"f167c13a-2d11-49aa-8a89-1610f8861c32\") " Jun 08 12:19:17.270105 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.269922 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fca9372a-9af8-46f6-8ff1-e08baf379bf5-util\") pod \"fca9372a-9af8-46f6-8ff1-e08baf379bf5\" (UID: \"fca9372a-9af8-46f6-8ff1-e08baf379bf5\") " Jun 08 12:19:17.270105 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.269945 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cn9hz\" (UniqueName: \"kubernetes.io/projected/fca9372a-9af8-46f6-8ff1-e08baf379bf5-kube-api-access-cn9hz\") pod \"fca9372a-9af8-46f6-8ff1-e08baf379bf5\" (UID: \"fca9372a-9af8-46f6-8ff1-e08baf379bf5\") " Jun 08 12:19:17.270105 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.270042 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f167c13a-2d11-49aa-8a89-1610f8861c32-bundle\") pod \"f167c13a-2d11-49aa-8a89-1610f8861c32\" (UID: \"f167c13a-2d11-49aa-8a89-1610f8861c32\") " Jun 08 12:19:17.270105 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.270072 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fca9372a-9af8-46f6-8ff1-e08baf379bf5-bundle\") pod \"fca9372a-9af8-46f6-8ff1-e08baf379bf5\" (UID: \"fca9372a-9af8-46f6-8ff1-e08baf379bf5\") " Jun 08 12:19:17.270734 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.270698 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f167c13a-2d11-49aa-8a89-1610f8861c32-bundle" (OuterVolumeSpecName: "bundle") pod "f167c13a-2d11-49aa-8a89-1610f8861c32" (UID: "f167c13a-2d11-49aa-8a89-1610f8861c32"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:19:17.270940 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.270913 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fca9372a-9af8-46f6-8ff1-e08baf379bf5-bundle" (OuterVolumeSpecName: "bundle") pod "fca9372a-9af8-46f6-8ff1-e08baf379bf5" (UID: "fca9372a-9af8-46f6-8ff1-e08baf379bf5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:19:17.272178 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.272149 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f167c13a-2d11-49aa-8a89-1610f8861c32-kube-api-access-nzzrw" (OuterVolumeSpecName: "kube-api-access-nzzrw") pod "f167c13a-2d11-49aa-8a89-1610f8861c32" (UID: "f167c13a-2d11-49aa-8a89-1610f8861c32"). InnerVolumeSpecName "kube-api-access-nzzrw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:19:17.272297 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.272203 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fca9372a-9af8-46f6-8ff1-e08baf379bf5-kube-api-access-cn9hz" (OuterVolumeSpecName: "kube-api-access-cn9hz") pod "fca9372a-9af8-46f6-8ff1-e08baf379bf5" (UID: "fca9372a-9af8-46f6-8ff1-e08baf379bf5"). InnerVolumeSpecName "kube-api-access-cn9hz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:19:17.275330 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.275307 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f167c13a-2d11-49aa-8a89-1610f8861c32-util" (OuterVolumeSpecName: "util") pod "f167c13a-2d11-49aa-8a89-1610f8861c32" (UID: "f167c13a-2d11-49aa-8a89-1610f8861c32"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:19:17.275463 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.275441 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fca9372a-9af8-46f6-8ff1-e08baf379bf5-util" (OuterVolumeSpecName: "util") pod "fca9372a-9af8-46f6-8ff1-e08baf379bf5" (UID: "fca9372a-9af8-46f6-8ff1-e08baf379bf5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:19:17.371722 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.371679 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzzrw\" (UniqueName: \"kubernetes.io/projected/f167c13a-2d11-49aa-8a89-1610f8861c32-kube-api-access-nzzrw\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:19:17.371722 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.371717 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f167c13a-2d11-49aa-8a89-1610f8861c32-util\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:19:17.371891 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.371733 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fca9372a-9af8-46f6-8ff1-e08baf379bf5-util\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:19:17.371891 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.371745 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cn9hz\" (UniqueName: \"kubernetes.io/projected/fca9372a-9af8-46f6-8ff1-e08baf379bf5-kube-api-access-cn9hz\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:19:17.371891 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.371757 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f167c13a-2d11-49aa-8a89-1610f8861c32-bundle\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:19:17.371891 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.371769 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fca9372a-9af8-46f6-8ff1-e08baf379bf5-bundle\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:19:17.958455 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.958424 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx" Jun 08 12:19:17.958842 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.958461 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx" event={"ID":"fca9372a-9af8-46f6-8ff1-e08baf379bf5","Type":"ContainerDied","Data":"1c47591bc84e2d8b1a7749399c0af8264fe84bf268ae6d914cb58061c3c85b24"} Jun 08 12:19:17.958842 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.958510 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c47591bc84e2d8b1a7749399c0af8264fe84bf268ae6d914cb58061c3c85b24" Jun 08 12:19:17.960465 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.960445 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8" Jun 08 12:19:17.960465 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.960438 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8" event={"ID":"f167c13a-2d11-49aa-8a89-1610f8861c32","Type":"ContainerDied","Data":"06cb7aa172197fe3d34f817434de0e4f8e36ed432f34d8e7c67057744ce09b58"} Jun 08 12:19:17.960630 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:17.960493 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="06cb7aa172197fe3d34f817434de0e4f8e36ed432f34d8e7c67057744ce09b58" Jun 08 12:19:18.096883 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:18.096861 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr" Jun 08 12:19:18.180240 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:18.180202 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5588aaf5-551b-484d-9766-977650d6b98a-util\") pod \"5588aaf5-551b-484d-9766-977650d6b98a\" (UID: \"5588aaf5-551b-484d-9766-977650d6b98a\") " Jun 08 12:19:18.180400 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:18.180308 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5588aaf5-551b-484d-9766-977650d6b98a-bundle\") pod \"5588aaf5-551b-484d-9766-977650d6b98a\" (UID: \"5588aaf5-551b-484d-9766-977650d6b98a\") " Jun 08 12:19:18.180400 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:18.180348 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5p5n\" (UniqueName: \"kubernetes.io/projected/5588aaf5-551b-484d-9766-977650d6b98a-kube-api-access-w5p5n\") pod \"5588aaf5-551b-484d-9766-977650d6b98a\" (UID: \"5588aaf5-551b-484d-9766-977650d6b98a\") " Jun 08 12:19:18.180737 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:18.180713 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5588aaf5-551b-484d-9766-977650d6b98a-bundle" (OuterVolumeSpecName: "bundle") pod "5588aaf5-551b-484d-9766-977650d6b98a" (UID: "5588aaf5-551b-484d-9766-977650d6b98a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:19:18.182482 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:18.182460 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5588aaf5-551b-484d-9766-977650d6b98a-kube-api-access-w5p5n" (OuterVolumeSpecName: "kube-api-access-w5p5n") pod "5588aaf5-551b-484d-9766-977650d6b98a" (UID: "5588aaf5-551b-484d-9766-977650d6b98a"). InnerVolumeSpecName "kube-api-access-w5p5n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:19:18.185881 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:18.185844 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5588aaf5-551b-484d-9766-977650d6b98a-util" (OuterVolumeSpecName: "util") pod "5588aaf5-551b-484d-9766-977650d6b98a" (UID: "5588aaf5-551b-484d-9766-977650d6b98a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:19:18.281157 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:18.281090 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5588aaf5-551b-484d-9766-977650d6b98a-util\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:19:18.281157 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:18.281116 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5588aaf5-551b-484d-9766-977650d6b98a-bundle\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:19:18.281157 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:18.281125 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5p5n\" (UniqueName: \"kubernetes.io/projected/5588aaf5-551b-484d-9766-977650d6b98a-kube-api-access-w5p5n\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:19:18.967780 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:18.967748 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr" event={"ID":"5588aaf5-551b-484d-9766-977650d6b98a","Type":"ContainerDied","Data":"4c9973c113d4062b766cae2325223130cb1e615ccf5b5b3502fe3fb0e47655e5"} Jun 08 12:19:18.967780 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:18.967767 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr" Jun 08 12:19:18.968214 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:18.967796 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c9973c113d4062b766cae2325223130cb1e615ccf5b5b3502fe3fb0e47655e5" Jun 08 12:19:24.908276 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:24.908223 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:28.026961 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:28.026911 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:30.453494 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.453464 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8"] Jun 08 12:19:30.454499 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454472 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fca9372a-9af8-46f6-8ff1-e08baf379bf5" containerName="util" Jun 08 12:19:30.454499 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454500 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fca9372a-9af8-46f6-8ff1-e08baf379bf5" containerName="util" Jun 08 12:19:30.454664 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454533 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f167c13a-2d11-49aa-8a89-1610f8861c32" containerName="util" Jun 08 12:19:30.454664 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454541 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f167c13a-2d11-49aa-8a89-1610f8861c32" containerName="util" Jun 08 12:19:30.454664 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454550 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f167c13a-2d11-49aa-8a89-1610f8861c32" containerName="pull" Jun 08 12:19:30.454664 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454558 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f167c13a-2d11-49aa-8a89-1610f8861c32" containerName="pull" Jun 08 12:19:30.454664 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454568 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f167c13a-2d11-49aa-8a89-1610f8861c32" containerName="extract" Jun 08 12:19:30.454664 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454575 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f167c13a-2d11-49aa-8a89-1610f8861c32" containerName="extract" Jun 08 12:19:30.454664 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454588 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="097248d3-81fb-4af3-8868-3e4d416cff72" containerName="pull" Jun 08 12:19:30.454664 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454596 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="097248d3-81fb-4af3-8868-3e4d416cff72" containerName="pull" Jun 08 12:19:30.454664 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454605 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="097248d3-81fb-4af3-8868-3e4d416cff72" containerName="extract" Jun 08 12:19:30.454664 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454613 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="097248d3-81fb-4af3-8868-3e4d416cff72" containerName="extract" Jun 08 12:19:30.454664 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454622 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fca9372a-9af8-46f6-8ff1-e08baf379bf5" containerName="extract" Jun 08 12:19:30.454664 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454630 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fca9372a-9af8-46f6-8ff1-e08baf379bf5" containerName="extract" Jun 08 12:19:30.454664 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454637 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5588aaf5-551b-484d-9766-977650d6b98a" containerName="pull" Jun 08 12:19:30.454664 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454645 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5588aaf5-551b-484d-9766-977650d6b98a" containerName="pull" Jun 08 12:19:30.454664 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454656 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5588aaf5-551b-484d-9766-977650d6b98a" containerName="extract" Jun 08 12:19:30.454664 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454663 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5588aaf5-551b-484d-9766-977650d6b98a" containerName="extract" Jun 08 12:19:30.454664 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454673 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="097248d3-81fb-4af3-8868-3e4d416cff72" containerName="util" Jun 08 12:19:30.455447 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454681 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="097248d3-81fb-4af3-8868-3e4d416cff72" containerName="util" Jun 08 12:19:30.455447 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454692 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fca9372a-9af8-46f6-8ff1-e08baf379bf5" containerName="pull" Jun 08 12:19:30.455447 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454699 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fca9372a-9af8-46f6-8ff1-e08baf379bf5" containerName="pull" Jun 08 12:19:30.455447 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454712 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5588aaf5-551b-484d-9766-977650d6b98a" containerName="util" Jun 08 12:19:30.455447 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454719 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5588aaf5-551b-484d-9766-977650d6b98a" containerName="util" Jun 08 12:19:30.455447 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454807 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5588aaf5-551b-484d-9766-977650d6b98a" containerName="extract" Jun 08 12:19:30.455447 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454835 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="097248d3-81fb-4af3-8868-3e4d416cff72" containerName="extract" Jun 08 12:19:30.455447 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454846 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f167c13a-2d11-49aa-8a89-1610f8861c32" containerName="extract" Jun 08 12:19:30.455447 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.454855 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fca9372a-9af8-46f6-8ff1-e08baf379bf5" containerName="extract" Jun 08 12:19:30.480294 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.480269 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8" Jun 08 12:19:30.484576 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.484560 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wq4rb\"" Jun 08 12:19:30.489026 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.489002 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvkhx\" (UniqueName: \"kubernetes.io/projected/9c172b9a-7b97-4b60-9e38-941d521193e0-kube-api-access-rvkhx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-44tx8\" (UID: \"9c172b9a-7b97-4b60-9e38-941d521193e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8" Jun 08 12:19:30.489126 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.489050 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c172b9a-7b97-4b60-9e38-941d521193e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-44tx8\" (UID: \"9c172b9a-7b97-4b60-9e38-941d521193e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8" Jun 08 12:19:30.493557 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.493530 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8"] Jun 08 12:19:30.590540 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.590509 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvkhx\" (UniqueName: \"kubernetes.io/projected/9c172b9a-7b97-4b60-9e38-941d521193e0-kube-api-access-rvkhx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-44tx8\" (UID: \"9c172b9a-7b97-4b60-9e38-941d521193e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8" Jun 08 12:19:30.590713 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.590546 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c172b9a-7b97-4b60-9e38-941d521193e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-44tx8\" (UID: \"9c172b9a-7b97-4b60-9e38-941d521193e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8" Jun 08 12:19:30.590891 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.590866 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c172b9a-7b97-4b60-9e38-941d521193e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-44tx8\" (UID: \"9c172b9a-7b97-4b60-9e38-941d521193e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8" Jun 08 12:19:30.601084 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.601059 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:30.607508 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.607487 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvkhx\" (UniqueName: \"kubernetes.io/projected/9c172b9a-7b97-4b60-9e38-941d521193e0-kube-api-access-rvkhx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-44tx8\" (UID: \"9c172b9a-7b97-4b60-9e38-941d521193e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8" Jun 08 12:19:30.790093 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.790011 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8" Jun 08 12:19:30.838264 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.838234 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:30.947070 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:30.947045 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8"] Jun 08 12:19:30.949462 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:19:30.949430 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c172b9a_7b97_4b60_9e38_941d521193e0.slice/crio-e3dff064d8623a49ad9236f447288dab88a1c05cf15cfee5e1496e927c70b783 WatchSource:0}: Error finding container e3dff064d8623a49ad9236f447288dab88a1c05cf15cfee5e1496e927c70b783: Status 404 returned error can't find the container with id e3dff064d8623a49ad9236f447288dab88a1c05cf15cfee5e1496e927c70b783 Jun 08 12:19:31.038161 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:31.038125 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8" event={"ID":"9c172b9a-7b97-4b60-9e38-941d521193e0","Type":"ContainerStarted","Data":"e3dff064d8623a49ad9236f447288dab88a1c05cf15cfee5e1496e927c70b783"} Jun 08 12:19:31.090309 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:31.090244 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:31.212546 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:31.212508 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:32.485470 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:32.485442 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/2.log" Jun 08 12:19:32.486759 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:32.485958 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/2.log" Jun 08 12:19:32.503066 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:32.503044 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwxhk_1aa340eb-58d2-4e29-9cbd-4f1b831abf58/ovn-acl-logging/0.log" Jun 08 12:19:32.503382 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:32.503368 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwxhk_1aa340eb-58d2-4e29-9cbd-4f1b831abf58/ovn-acl-logging/0.log" Jun 08 12:19:32.873046 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:32.873012 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-g8g5l"] Jun 08 12:19:32.875529 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:32.875507 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g8g5l" Jun 08 12:19:32.879938 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:32.879913 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-qwj26\"" Jun 08 12:19:32.904382 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:32.904357 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-g8g5l"] Jun 08 12:19:32.911823 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:32.911789 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qspfz\" (UniqueName: \"kubernetes.io/projected/78974448-565f-4a7e-8be5-1f1f2f7b8821-kube-api-access-qspfz\") pod \"authorino-operator-75cc8d5cb7-g8g5l\" (UID: \"78974448-565f-4a7e-8be5-1f1f2f7b8821\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-g8g5l" Jun 08 12:19:33.012890 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:33.012858 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qspfz\" (UniqueName: \"kubernetes.io/projected/78974448-565f-4a7e-8be5-1f1f2f7b8821-kube-api-access-qspfz\") pod \"authorino-operator-75cc8d5cb7-g8g5l\" (UID: \"78974448-565f-4a7e-8be5-1f1f2f7b8821\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-g8g5l" Jun 08 12:19:33.024500 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:33.024466 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qspfz\" (UniqueName: \"kubernetes.io/projected/78974448-565f-4a7e-8be5-1f1f2f7b8821-kube-api-access-qspfz\") pod \"authorino-operator-75cc8d5cb7-g8g5l\" (UID: \"78974448-565f-4a7e-8be5-1f1f2f7b8821\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-g8g5l" Jun 08 12:19:33.185880 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:33.185767 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g8g5l" Jun 08 12:19:33.369285 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:33.369255 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-g8g5l"] Jun 08 12:19:33.380552 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:19:33.380508 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78974448_565f_4a7e_8be5_1f1f2f7b8821.slice/crio-a447f2f0aa2f25c3eb73b6c195a9f3c24064ccb51290c785e73a3b0cd42ee1ed WatchSource:0}: Error finding container a447f2f0aa2f25c3eb73b6c195a9f3c24064ccb51290c785e73a3b0cd42ee1ed: Status 404 returned error can't find the container with id a447f2f0aa2f25c3eb73b6c195a9f3c24064ccb51290c785e73a3b0cd42ee1ed Jun 08 12:19:33.516696 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:33.516602 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:34.061393 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:34.061355 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g8g5l" event={"ID":"78974448-565f-4a7e-8be5-1f1f2f7b8821","Type":"ContainerStarted","Data":"a447f2f0aa2f25c3eb73b6c195a9f3c24064ccb51290c785e73a3b0cd42ee1ed"} Jun 08 12:19:34.542345 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:34.542301 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:35.885541 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:35.885507 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:36.076419 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.076384 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g8g5l" event={"ID":"78974448-565f-4a7e-8be5-1f1f2f7b8821","Type":"ContainerStarted","Data":"90f4dd22116ce8a30c8f2443a52964a4ac90856410a6ac3726c6bc51635cf165"} Jun 08 12:19:36.076583 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.076531 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g8g5l" Jun 08 12:19:36.116651 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.116598 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g8g5l" podStartSLOduration=1.9085330090000001 podStartE2EDuration="4.116585714s" totalImagesPullingTime="2.208052705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:19:36.114471191 +0000 UTC m=+604.230289330" watchObservedRunningTime="2026-06-08 12:19:36.116585714 +0000 UTC m=+604.232403851" Jun 08 12:19:36.445864 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.445830 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d7db6f7df-bhb4n"] Jun 08 12:19:36.448328 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.448306 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:36.474404 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.474375 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d7db6f7df-bhb4n"] Jun 08 12:19:36.553939 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.553907 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d152fc70-7b58-470f-8cdf-71ff00c8feed-trusted-ca-bundle\") pod \"console-5d7db6f7df-bhb4n\" (UID: \"d152fc70-7b58-470f-8cdf-71ff00c8feed\") " pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:36.553939 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.553944 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d152fc70-7b58-470f-8cdf-71ff00c8feed-console-serving-cert\") pod \"console-5d7db6f7df-bhb4n\" (UID: \"d152fc70-7b58-470f-8cdf-71ff00c8feed\") " pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:36.554192 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.553981 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d152fc70-7b58-470f-8cdf-71ff00c8feed-console-config\") pod \"console-5d7db6f7df-bhb4n\" (UID: \"d152fc70-7b58-470f-8cdf-71ff00c8feed\") " pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:36.554192 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.554053 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p5bc\" (UniqueName: \"kubernetes.io/projected/d152fc70-7b58-470f-8cdf-71ff00c8feed-kube-api-access-4p5bc\") pod \"console-5d7db6f7df-bhb4n\" (UID: \"d152fc70-7b58-470f-8cdf-71ff00c8feed\") " pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:36.554192 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.554079 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d152fc70-7b58-470f-8cdf-71ff00c8feed-service-ca\") pod \"console-5d7db6f7df-bhb4n\" (UID: \"d152fc70-7b58-470f-8cdf-71ff00c8feed\") " pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:36.554192 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.554136 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d152fc70-7b58-470f-8cdf-71ff00c8feed-oauth-serving-cert\") pod \"console-5d7db6f7df-bhb4n\" (UID: \"d152fc70-7b58-470f-8cdf-71ff00c8feed\") " pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:36.554388 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.554198 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d152fc70-7b58-470f-8cdf-71ff00c8feed-console-oauth-config\") pod \"console-5d7db6f7df-bhb4n\" (UID: \"d152fc70-7b58-470f-8cdf-71ff00c8feed\") " pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:36.559228 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.559181 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:36.655133 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.655105 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d152fc70-7b58-470f-8cdf-71ff00c8feed-console-oauth-config\") pod \"console-5d7db6f7df-bhb4n\" (UID: \"d152fc70-7b58-470f-8cdf-71ff00c8feed\") " pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:36.655298 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.655145 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d152fc70-7b58-470f-8cdf-71ff00c8feed-trusted-ca-bundle\") pod \"console-5d7db6f7df-bhb4n\" (UID: \"d152fc70-7b58-470f-8cdf-71ff00c8feed\") " pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:36.655298 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.655173 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d152fc70-7b58-470f-8cdf-71ff00c8feed-console-serving-cert\") pod \"console-5d7db6f7df-bhb4n\" (UID: \"d152fc70-7b58-470f-8cdf-71ff00c8feed\") " pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:36.655298 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.655211 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d152fc70-7b58-470f-8cdf-71ff00c8feed-console-config\") pod \"console-5d7db6f7df-bhb4n\" (UID: \"d152fc70-7b58-470f-8cdf-71ff00c8feed\") " pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:36.655298 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.655246 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p5bc\" (UniqueName: \"kubernetes.io/projected/d152fc70-7b58-470f-8cdf-71ff00c8feed-kube-api-access-4p5bc\") pod \"console-5d7db6f7df-bhb4n\" (UID: \"d152fc70-7b58-470f-8cdf-71ff00c8feed\") " pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:36.655936 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.655760 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d152fc70-7b58-470f-8cdf-71ff00c8feed-service-ca\") pod \"console-5d7db6f7df-bhb4n\" (UID: \"d152fc70-7b58-470f-8cdf-71ff00c8feed\") " pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:36.655936 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.655888 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d152fc70-7b58-470f-8cdf-71ff00c8feed-oauth-serving-cert\") pod \"console-5d7db6f7df-bhb4n\" (UID: \"d152fc70-7b58-470f-8cdf-71ff00c8feed\") " pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:36.660256 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.656522 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d152fc70-7b58-470f-8cdf-71ff00c8feed-trusted-ca-bundle\") pod \"console-5d7db6f7df-bhb4n\" (UID: \"d152fc70-7b58-470f-8cdf-71ff00c8feed\") " pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:36.660256 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.656647 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d152fc70-7b58-470f-8cdf-71ff00c8feed-oauth-serving-cert\") pod \"console-5d7db6f7df-bhb4n\" (UID: \"d152fc70-7b58-470f-8cdf-71ff00c8feed\") " pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:36.660256 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.656702 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d152fc70-7b58-470f-8cdf-71ff00c8feed-console-config\") pod \"console-5d7db6f7df-bhb4n\" (UID: \"d152fc70-7b58-470f-8cdf-71ff00c8feed\") " pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:36.660256 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.656944 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d152fc70-7b58-470f-8cdf-71ff00c8feed-service-ca\") pod \"console-5d7db6f7df-bhb4n\" (UID: \"d152fc70-7b58-470f-8cdf-71ff00c8feed\") " pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:36.662698 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.661143 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d152fc70-7b58-470f-8cdf-71ff00c8feed-console-serving-cert\") pod \"console-5d7db6f7df-bhb4n\" (UID: \"d152fc70-7b58-470f-8cdf-71ff00c8feed\") " pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:36.664454 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.664430 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d152fc70-7b58-470f-8cdf-71ff00c8feed-console-oauth-config\") pod \"console-5d7db6f7df-bhb4n\" (UID: \"d152fc70-7b58-470f-8cdf-71ff00c8feed\") " pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:36.672590 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.672565 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p5bc\" (UniqueName: \"kubernetes.io/projected/d152fc70-7b58-470f-8cdf-71ff00c8feed-kube-api-access-4p5bc\") pod \"console-5d7db6f7df-bhb4n\" (UID: \"d152fc70-7b58-470f-8cdf-71ff00c8feed\") " pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:36.757069 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.757001 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:36.936739 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:19:36.936709 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd152fc70_7b58_470f_8cdf_71ff00c8feed.slice/crio-7ccec98d3c6bd3de9704b511eecc808dc6b9240464e20c50bf45e7588932d0e1 WatchSource:0}: Error finding container 7ccec98d3c6bd3de9704b511eecc808dc6b9240464e20c50bf45e7588932d0e1: Status 404 returned error can't find the container with id 7ccec98d3c6bd3de9704b511eecc808dc6b9240464e20c50bf45e7588932d0e1 Jun 08 12:19:36.937076 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:36.936792 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d7db6f7df-bhb4n"] Jun 08 12:19:37.083317 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:37.083212 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:37.085765 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:37.085732 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7db6f7df-bhb4n" event={"ID":"d152fc70-7b58-470f-8cdf-71ff00c8feed","Type":"ContainerStarted","Data":"b621d8821f25504f0cd35400da988cdcccbae8c2b331ee0aca5312eb811eddea"} Jun 08 12:19:37.085927 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:37.085792 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7db6f7df-bhb4n" event={"ID":"d152fc70-7b58-470f-8cdf-71ff00c8feed","Type":"ContainerStarted","Data":"7ccec98d3c6bd3de9704b511eecc808dc6b9240464e20c50bf45e7588932d0e1"} Jun 08 12:19:39.099967 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:39.099935 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8" event={"ID":"9c172b9a-7b97-4b60-9e38-941d521193e0","Type":"ContainerStarted","Data":"01a621a755773f47e811b138b8e6e544a1a2a72db42da05228586581bf042fa9"} Jun 08 12:19:39.100324 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:39.100074 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8" Jun 08 12:19:39.198208 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:39.198156 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8" podStartSLOduration=1.908528899 podStartE2EDuration="9.198138977s" totalImagesPullingTime="7.289610078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:19:39.198031731 +0000 UTC m=+607.313849868" watchObservedRunningTime="2026-06-08 12:19:39.198138977 +0000 UTC m=+607.313957114" Jun 08 12:19:39.199398 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:39.199367 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d7db6f7df-bhb4n" podStartSLOduration=3.199357111 podStartE2EDuration="3.199357111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:19:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:19:37.114804817 +0000 UTC m=+605.230622954" watchObservedRunningTime="2026-06-08 12:19:39.199357111 +0000 UTC m=+607.315175229" Jun 08 12:19:40.130671 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:40.130640 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:40.336724 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:40.336690 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:41.782575 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:41.782533 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:41.977387 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:41.977356 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:46.757345 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:46.757267 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:46.757345 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:46.757328 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:46.761865 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:46.761845 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:47.088035 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:47.087939 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g8g5l" Jun 08 12:19:47.150876 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:47.150842 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d7db6f7df-bhb4n" Jun 08 12:19:47.323835 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:47.323783 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c7bd6498f-vsxnt"] Jun 08 12:19:47.915923 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:47.915888 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:48.081332 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:48.081282 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:48.291207 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:48.291092 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:50.109414 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:50.109386 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8" Jun 08 12:19:50.415085 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:50.415055 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:50.796380 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:50.796290 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:50.938495 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:50.938464 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:51.424475 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:51.424423 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:53.377490 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:53.377455 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8"] Jun 08 12:19:53.377984 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:53.377641 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8" podUID="9c172b9a-7b97-4b60-9e38-941d521193e0" containerName="manager" containerID="cri-o://01a621a755773f47e811b138b8e6e544a1a2a72db42da05228586581bf042fa9" gracePeriod=2 Jun 08 12:19:53.408063 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:53.408035 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8"] Jun 08 12:19:53.412695 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:19:53.412663 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-44tx8\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="9c172b9a-7b97-4b60-9e38-941d521193e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8" Jun 08 12:19:53.566655 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:53.566615 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56"] Jun 08 12:19:53.567089 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:53.567074 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c172b9a-7b97-4b60-9e38-941d521193e0" containerName="manager" Jun 08 12:19:53.567089 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:53.567090 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c172b9a-7b97-4b60-9e38-941d521193e0" containerName="manager" Jun 08 12:19:53.567246 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:53.567178 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c172b9a-7b97-4b60-9e38-941d521193e0" containerName="manager" Jun 08 12:19:53.570447 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:53.570427 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56" Jun 08 12:19:53.647090 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:53.647063 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56"] Jun 08 12:19:53.648143 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:53.648125 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8" Jun 08 12:19:53.724560 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:53.724530 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvkhx\" (UniqueName: \"kubernetes.io/projected/9c172b9a-7b97-4b60-9e38-941d521193e0-kube-api-access-rvkhx\") pod \"9c172b9a-7b97-4b60-9e38-941d521193e0\" (UID: \"9c172b9a-7b97-4b60-9e38-941d521193e0\") " Jun 08 12:19:53.724699 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:53.724635 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c172b9a-7b97-4b60-9e38-941d521193e0-extensions-socket-volume\") pod \"9c172b9a-7b97-4b60-9e38-941d521193e0\" (UID: \"9c172b9a-7b97-4b60-9e38-941d521193e0\") " Jun 08 12:19:53.724948 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:53.724927 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttm2l\" (UniqueName: \"kubernetes.io/projected/76908467-1f4b-4d3d-a856-e8bb4a280391-kube-api-access-ttm2l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t8m56\" (UID: \"76908467-1f4b-4d3d-a856-e8bb4a280391\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56" Jun 08 12:19:53.725072 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:53.725059 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76908467-1f4b-4d3d-a856-e8bb4a280391-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t8m56\" (UID: \"76908467-1f4b-4d3d-a856-e8bb4a280391\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56" Jun 08 12:19:53.725158 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:53.725137 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c172b9a-7b97-4b60-9e38-941d521193e0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9c172b9a-7b97-4b60-9e38-941d521193e0" (UID: "9c172b9a-7b97-4b60-9e38-941d521193e0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:19:53.726804 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:53.726783 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c172b9a-7b97-4b60-9e38-941d521193e0-kube-api-access-rvkhx" (OuterVolumeSpecName: "kube-api-access-rvkhx") pod "9c172b9a-7b97-4b60-9e38-941d521193e0" (UID: "9c172b9a-7b97-4b60-9e38-941d521193e0"). InnerVolumeSpecName "kube-api-access-rvkhx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:19:53.756772 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:19:53.756739 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-44tx8\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="9c172b9a-7b97-4b60-9e38-941d521193e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8" Jun 08 12:19:53.763489 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:19:53.763465 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-44tx8\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="9c172b9a-7b97-4b60-9e38-941d521193e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8" Jun 08 12:19:53.826376 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:53.826351 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttm2l\" (UniqueName: \"kubernetes.io/projected/76908467-1f4b-4d3d-a856-e8bb4a280391-kube-api-access-ttm2l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t8m56\" (UID: \"76908467-1f4b-4d3d-a856-e8bb4a280391\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56" Jun 08 12:19:53.826473 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:53.826420 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76908467-1f4b-4d3d-a856-e8bb4a280391-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t8m56\" (UID: \"76908467-1f4b-4d3d-a856-e8bb4a280391\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56" Jun 08 12:19:53.826523 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:53.826482 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvkhx\" (UniqueName: \"kubernetes.io/projected/9c172b9a-7b97-4b60-9e38-941d521193e0-kube-api-access-rvkhx\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:19:53.826523 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:53.826492 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9c172b9a-7b97-4b60-9e38-941d521193e0-extensions-socket-volume\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:19:53.826852 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:53.826804 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76908467-1f4b-4d3d-a856-e8bb4a280391-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t8m56\" (UID: \"76908467-1f4b-4d3d-a856-e8bb4a280391\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56" Jun 08 12:19:53.856747 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:53.856725 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttm2l\" (UniqueName: \"kubernetes.io/projected/76908467-1f4b-4d3d-a856-e8bb4a280391-kube-api-access-ttm2l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t8m56\" (UID: \"76908467-1f4b-4d3d-a856-e8bb4a280391\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56" Jun 08 12:19:53.881619 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:53.881562 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56" Jun 08 12:19:54.074372 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:54.074347 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56"] Jun 08 12:19:54.076336 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:19:54.076311 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76908467_1f4b_4d3d_a856_e8bb4a280391.slice/crio-f52c0474e08f7adf1b58a6a74cbd12965508b81c81d08f8bbdf707456697b392 WatchSource:0}: Error finding container f52c0474e08f7adf1b58a6a74cbd12965508b81c81d08f8bbdf707456697b392: Status 404 returned error can't find the container with id f52c0474e08f7adf1b58a6a74cbd12965508b81c81d08f8bbdf707456697b392 Jun 08 12:19:54.188013 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:54.187977 2565 generic.go:356] "Generic (PLEG): container finished" podID="9c172b9a-7b97-4b60-9e38-941d521193e0" containerID="01a621a755773f47e811b138b8e6e544a1a2a72db42da05228586581bf042fa9" exitCode=0 Jun 08 12:19:54.188158 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:54.188024 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8" Jun 08 12:19:54.188158 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:54.188038 2565 scope.go:117] "RemoveContainer" containerID="01a621a755773f47e811b138b8e6e544a1a2a72db42da05228586581bf042fa9" Jun 08 12:19:54.190107 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:54.190074 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56" event={"ID":"76908467-1f4b-4d3d-a856-e8bb4a280391","Type":"ContainerStarted","Data":"9b9c5f2486162b27dc47bd3b12b75990d885b6ffe3c90fa4c04f92e2e06dae50"} Jun 08 12:19:54.190403 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:54.190131 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56" event={"ID":"76908467-1f4b-4d3d-a856-e8bb4a280391","Type":"ContainerStarted","Data":"f52c0474e08f7adf1b58a6a74cbd12965508b81c81d08f8bbdf707456697b392"} Jun 08 12:19:54.190403 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:54.190162 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56" Jun 08 12:19:54.190843 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:19:54.190782 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-44tx8\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="9c172b9a-7b97-4b60-9e38-941d521193e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8" Jun 08 12:19:54.198864 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:54.198847 2565 scope.go:117] "RemoveContainer" containerID="01a621a755773f47e811b138b8e6e544a1a2a72db42da05228586581bf042fa9" Jun 08 12:19:54.199107 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:19:54.199088 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01a621a755773f47e811b138b8e6e544a1a2a72db42da05228586581bf042fa9\": container with ID starting with 01a621a755773f47e811b138b8e6e544a1a2a72db42da05228586581bf042fa9 not found: ID does not exist" containerID="01a621a755773f47e811b138b8e6e544a1a2a72db42da05228586581bf042fa9" Jun 08 12:19:54.199173 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:19:54.199104 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-44tx8\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="9c172b9a-7b97-4b60-9e38-941d521193e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8" Jun 08 12:19:54.199173 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:54.199115 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01a621a755773f47e811b138b8e6e544a1a2a72db42da05228586581bf042fa9"} err="failed to get container status \"01a621a755773f47e811b138b8e6e544a1a2a72db42da05228586581bf042fa9\": rpc error: code = NotFound desc = could not find container \"01a621a755773f47e811b138b8e6e544a1a2a72db42da05228586581bf042fa9\": container with ID starting with 01a621a755773f47e811b138b8e6e544a1a2a72db42da05228586581bf042fa9 not found: ID does not exist" Jun 08 12:19:54.274542 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:19:54.274510 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-44tx8\" is forbidden: User \"system:node:ip-10-0-137-94.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-94.ec2.internal' and this object" podUID="9c172b9a-7b97-4b60-9e38-941d521193e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-44tx8" Jun 08 12:19:54.275319 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:54.275279 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56" podStartSLOduration=1.275265618 podStartE2EDuration="1.275265618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:19:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:19:54.272008815 +0000 UTC m=+622.387826953" watchObservedRunningTime="2026-06-08 12:19:54.275265618 +0000 UTC m=+622.391083755" Jun 08 12:19:54.348625 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:54.348597 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c172b9a-7b97-4b60-9e38-941d521193e0" path="/var/lib/kubelet/pods/9c172b9a-7b97-4b60-9e38-941d521193e0/volumes" Jun 08 12:19:55.364197 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:55.364150 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:55.536340 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:55.536307 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:59.854199 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:59.854160 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:19:59.954048 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:19:59.953995 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:04.772745 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:04.772708 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:04.916508 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:04.916468 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:05.200357 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:05.200324 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56" Jun 08 12:20:12.343919 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:12.343876 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5c7bd6498f-vsxnt" podUID="9ad56932-969e-4fef-b1ef-c87af6276e89" containerName="console" containerID="cri-o://8076f7e72d459824722b941e6502f8ad7638f9d65f46a4c8ee6cd359afea7ae2" gracePeriod=15 Jun 08 12:20:12.596508 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:12.596456 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:20:12.701535 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:12.701503 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ad56932-969e-4fef-b1ef-c87af6276e89-console-oauth-config\") pod \"9ad56932-969e-4fef-b1ef-c87af6276e89\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " Jun 08 12:20:12.701691 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:12.701549 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-trusted-ca-bundle\") pod \"9ad56932-969e-4fef-b1ef-c87af6276e89\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " Jun 08 12:20:12.701691 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:12.701575 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-console-config\") pod \"9ad56932-969e-4fef-b1ef-c87af6276e89\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " Jun 08 12:20:12.701691 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:12.701619 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ad56932-969e-4fef-b1ef-c87af6276e89-console-serving-cert\") pod \"9ad56932-969e-4fef-b1ef-c87af6276e89\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " Jun 08 12:20:12.701691 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:12.701667 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4x25f\" (UniqueName: \"kubernetes.io/projected/9ad56932-969e-4fef-b1ef-c87af6276e89-kube-api-access-4x25f\") pod \"9ad56932-969e-4fef-b1ef-c87af6276e89\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " Jun 08 12:20:12.701940 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:12.701718 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-oauth-serving-cert\") pod \"9ad56932-969e-4fef-b1ef-c87af6276e89\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " Jun 08 12:20:12.701940 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:12.701747 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-service-ca\") pod \"9ad56932-969e-4fef-b1ef-c87af6276e89\" (UID: \"9ad56932-969e-4fef-b1ef-c87af6276e89\") " Jun 08 12:20:12.702074 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:12.702050 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-console-config" (OuterVolumeSpecName: "console-config") pod "9ad56932-969e-4fef-b1ef-c87af6276e89" (UID: "9ad56932-969e-4fef-b1ef-c87af6276e89"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:20:12.702136 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:12.702065 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9ad56932-969e-4fef-b1ef-c87af6276e89" (UID: "9ad56932-969e-4fef-b1ef-c87af6276e89"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:20:12.702187 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:12.702139 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9ad56932-969e-4fef-b1ef-c87af6276e89" (UID: "9ad56932-969e-4fef-b1ef-c87af6276e89"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:20:12.702300 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:12.702186 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-service-ca" (OuterVolumeSpecName: "service-ca") pod "9ad56932-969e-4fef-b1ef-c87af6276e89" (UID: "9ad56932-969e-4fef-b1ef-c87af6276e89"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:20:12.704003 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:12.703982 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ad56932-969e-4fef-b1ef-c87af6276e89-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9ad56932-969e-4fef-b1ef-c87af6276e89" (UID: "9ad56932-969e-4fef-b1ef-c87af6276e89"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:20:12.704079 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:12.704006 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ad56932-969e-4fef-b1ef-c87af6276e89-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9ad56932-969e-4fef-b1ef-c87af6276e89" (UID: "9ad56932-969e-4fef-b1ef-c87af6276e89"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:20:12.704169 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:12.704150 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ad56932-969e-4fef-b1ef-c87af6276e89-kube-api-access-4x25f" (OuterVolumeSpecName: "kube-api-access-4x25f") pod "9ad56932-969e-4fef-b1ef-c87af6276e89" (UID: "9ad56932-969e-4fef-b1ef-c87af6276e89"). InnerVolumeSpecName "kube-api-access-4x25f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:20:12.803017 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:12.802978 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4x25f\" (UniqueName: \"kubernetes.io/projected/9ad56932-969e-4fef-b1ef-c87af6276e89-kube-api-access-4x25f\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:20:12.803017 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:12.803015 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-oauth-serving-cert\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:20:12.803017 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:12.803024 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-service-ca\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:20:12.803017 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:12.803034 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ad56932-969e-4fef-b1ef-c87af6276e89-console-oauth-config\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:20:12.803017 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:12.803042 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-trusted-ca-bundle\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:20:12.803310 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:12.803050 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ad56932-969e-4fef-b1ef-c87af6276e89-console-config\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:20:12.803310 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:12.803058 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ad56932-969e-4fef-b1ef-c87af6276e89-console-serving-cert\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:20:13.305791 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:13.305754 2565 generic.go:356] "Generic (PLEG): container finished" podID="9ad56932-969e-4fef-b1ef-c87af6276e89" containerID="8076f7e72d459824722b941e6502f8ad7638f9d65f46a4c8ee6cd359afea7ae2" exitCode=0 Jun 08 12:20:13.305977 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:13.305804 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c7bd6498f-vsxnt" Jun 08 12:20:13.305977 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:13.305839 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7bd6498f-vsxnt" event={"ID":"9ad56932-969e-4fef-b1ef-c87af6276e89","Type":"ContainerDied","Data":"8076f7e72d459824722b941e6502f8ad7638f9d65f46a4c8ee6cd359afea7ae2"} Jun 08 12:20:13.305977 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:13.305895 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c7bd6498f-vsxnt" event={"ID":"9ad56932-969e-4fef-b1ef-c87af6276e89","Type":"ContainerDied","Data":"5554aad2b6f633ad52c0c4781bb2ede049dd8bd118c727129f726a7588012483"} Jun 08 12:20:13.305977 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:13.305912 2565 scope.go:117] "RemoveContainer" containerID="8076f7e72d459824722b941e6502f8ad7638f9d65f46a4c8ee6cd359afea7ae2" Jun 08 12:20:13.316276 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:13.316262 2565 scope.go:117] "RemoveContainer" containerID="8076f7e72d459824722b941e6502f8ad7638f9d65f46a4c8ee6cd359afea7ae2" Jun 08 12:20:13.316519 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:20:13.316500 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8076f7e72d459824722b941e6502f8ad7638f9d65f46a4c8ee6cd359afea7ae2\": container with ID starting with 8076f7e72d459824722b941e6502f8ad7638f9d65f46a4c8ee6cd359afea7ae2 not found: ID does not exist" containerID="8076f7e72d459824722b941e6502f8ad7638f9d65f46a4c8ee6cd359afea7ae2" Jun 08 12:20:13.316589 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:13.316530 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8076f7e72d459824722b941e6502f8ad7638f9d65f46a4c8ee6cd359afea7ae2"} err="failed to get container status \"8076f7e72d459824722b941e6502f8ad7638f9d65f46a4c8ee6cd359afea7ae2\": rpc error: code = NotFound desc = could not find container \"8076f7e72d459824722b941e6502f8ad7638f9d65f46a4c8ee6cd359afea7ae2\": container with ID starting with 8076f7e72d459824722b941e6502f8ad7638f9d65f46a4c8ee6cd359afea7ae2 not found: ID does not exist" Jun 08 12:20:13.328892 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:13.328870 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c7bd6498f-vsxnt"] Jun 08 12:20:13.338951 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:13.338923 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c7bd6498f-vsxnt"] Jun 08 12:20:14.348171 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:14.348139 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ad56932-969e-4fef-b1ef-c87af6276e89" path="/var/lib/kubelet/pods/9ad56932-969e-4fef-b1ef-c87af6276e89/volumes" Jun 08 12:20:14.690404 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:14.690363 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:14.779066 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:14.779030 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:15.270411 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:15.270380 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:15.366642 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:15.366608 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:18.291858 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:18.291808 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:18.432069 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:18.432032 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:22.283568 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:22.283536 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:22.373802 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:22.373762 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:28.732497 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:28.732460 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56"] Jun 08 12:20:28.732988 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:28.732700 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56" podUID="76908467-1f4b-4d3d-a856-e8bb4a280391" containerName="manager" containerID="cri-o://9b9c5f2486162b27dc47bd3b12b75990d885b6ffe3c90fa4c04f92e2e06dae50" gracePeriod=10 Jun 08 12:20:28.988587 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:28.988537 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56" Jun 08 12:20:29.044977 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:29.044944 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76908467-1f4b-4d3d-a856-e8bb4a280391-extensions-socket-volume\") pod \"76908467-1f4b-4d3d-a856-e8bb4a280391\" (UID: \"76908467-1f4b-4d3d-a856-e8bb4a280391\") " Jun 08 12:20:29.045128 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:29.045024 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttm2l\" (UniqueName: \"kubernetes.io/projected/76908467-1f4b-4d3d-a856-e8bb4a280391-kube-api-access-ttm2l\") pod \"76908467-1f4b-4d3d-a856-e8bb4a280391\" (UID: \"76908467-1f4b-4d3d-a856-e8bb4a280391\") " Jun 08 12:20:29.045312 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:29.045287 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76908467-1f4b-4d3d-a856-e8bb4a280391-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "76908467-1f4b-4d3d-a856-e8bb4a280391" (UID: "76908467-1f4b-4d3d-a856-e8bb4a280391"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:20:29.045386 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:29.045372 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76908467-1f4b-4d3d-a856-e8bb4a280391-extensions-socket-volume\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:20:29.047155 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:29.047128 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76908467-1f4b-4d3d-a856-e8bb4a280391-kube-api-access-ttm2l" (OuterVolumeSpecName: "kube-api-access-ttm2l") pod "76908467-1f4b-4d3d-a856-e8bb4a280391" (UID: "76908467-1f4b-4d3d-a856-e8bb4a280391"). InnerVolumeSpecName "kube-api-access-ttm2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:20:29.146429 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:29.146395 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttm2l\" (UniqueName: \"kubernetes.io/projected/76908467-1f4b-4d3d-a856-e8bb4a280391-kube-api-access-ttm2l\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:20:29.408453 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:29.408418 2565 generic.go:356] "Generic (PLEG): container finished" podID="76908467-1f4b-4d3d-a856-e8bb4a280391" containerID="9b9c5f2486162b27dc47bd3b12b75990d885b6ffe3c90fa4c04f92e2e06dae50" exitCode=0 Jun 08 12:20:29.408624 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:29.408463 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56" Jun 08 12:20:29.408624 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:29.408512 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56" event={"ID":"76908467-1f4b-4d3d-a856-e8bb4a280391","Type":"ContainerDied","Data":"9b9c5f2486162b27dc47bd3b12b75990d885b6ffe3c90fa4c04f92e2e06dae50"} Jun 08 12:20:29.408624 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:29.408563 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56" event={"ID":"76908467-1f4b-4d3d-a856-e8bb4a280391","Type":"ContainerDied","Data":"f52c0474e08f7adf1b58a6a74cbd12965508b81c81d08f8bbdf707456697b392"} Jun 08 12:20:29.408624 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:29.408587 2565 scope.go:117] "RemoveContainer" containerID="9b9c5f2486162b27dc47bd3b12b75990d885b6ffe3c90fa4c04f92e2e06dae50" Jun 08 12:20:29.418311 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:29.418292 2565 scope.go:117] "RemoveContainer" containerID="9b9c5f2486162b27dc47bd3b12b75990d885b6ffe3c90fa4c04f92e2e06dae50" Jun 08 12:20:29.418564 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:20:29.418546 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b9c5f2486162b27dc47bd3b12b75990d885b6ffe3c90fa4c04f92e2e06dae50\": container with ID starting with 9b9c5f2486162b27dc47bd3b12b75990d885b6ffe3c90fa4c04f92e2e06dae50 not found: ID does not exist" containerID="9b9c5f2486162b27dc47bd3b12b75990d885b6ffe3c90fa4c04f92e2e06dae50" Jun 08 12:20:29.418643 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:29.418576 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b9c5f2486162b27dc47bd3b12b75990d885b6ffe3c90fa4c04f92e2e06dae50"} err="failed to get container status \"9b9c5f2486162b27dc47bd3b12b75990d885b6ffe3c90fa4c04f92e2e06dae50\": rpc error: code = NotFound desc = could not find container \"9b9c5f2486162b27dc47bd3b12b75990d885b6ffe3c90fa4c04f92e2e06dae50\": container with ID starting with 9b9c5f2486162b27dc47bd3b12b75990d885b6ffe3c90fa4c04f92e2e06dae50 not found: ID does not exist" Jun 08 12:20:29.448521 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:29.448498 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56"] Jun 08 12:20:29.451018 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:29.450997 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t8m56"] Jun 08 12:20:30.347532 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:30.347498 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76908467-1f4b-4d3d-a856-e8bb4a280391" path="/var/lib/kubelet/pods/76908467-1f4b-4d3d-a856-e8bb4a280391/volumes" Jun 08 12:20:43.767556 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:43.767513 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:45.156782 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.156752 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h"] Jun 08 12:20:45.157230 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.157214 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76908467-1f4b-4d3d-a856-e8bb4a280391" containerName="manager" Jun 08 12:20:45.157230 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.157232 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="76908467-1f4b-4d3d-a856-e8bb4a280391" containerName="manager" Jun 08 12:20:45.157356 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.157247 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ad56932-969e-4fef-b1ef-c87af6276e89" containerName="console" Jun 08 12:20:45.157356 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.157253 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ad56932-969e-4fef-b1ef-c87af6276e89" containerName="console" Jun 08 12:20:45.157356 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.157327 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ad56932-969e-4fef-b1ef-c87af6276e89" containerName="console" Jun 08 12:20:45.157356 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.157339 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="76908467-1f4b-4d3d-a856-e8bb4a280391" containerName="manager" Jun 08 12:20:45.160347 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.160330 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.165655 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.165633 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-8vn4t\"" Jun 08 12:20:45.182447 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.182426 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h"] Jun 08 12:20:45.206612 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.206588 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:45.270277 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.270249 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:45.291552 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.291528 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.291662 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.291576 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.291662 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.291607 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.291662 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.291642 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.291768 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.291723 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.291807 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.291794 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbxsl\" (UniqueName: \"kubernetes.io/projected/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-kube-api-access-fbxsl\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.291889 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.291874 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.291926 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.291911 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.291961 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.291942 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.393297 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.393275 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbxsl\" (UniqueName: \"kubernetes.io/projected/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-kube-api-access-fbxsl\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.393426 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.393310 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.393426 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.393330 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.393426 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.393356 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.393426 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.393391 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.393646 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.393427 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.393646 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.393459 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.393646 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.393492 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.393646 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.393564 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.393856 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.393706 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.393856 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.393740 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.393856 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.393840 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.394025 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.393957 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.394225 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.394203 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.395914 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.395895 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.396064 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.396044 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.401946 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.401918 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.402058 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.402042 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbxsl\" (UniqueName: \"kubernetes.io/projected/14ebf361-7f3d-42cf-9a35-d537e92f1d7e-kube-api-access-fbxsl\") pod \"maas-default-gateway-openshift-default-8559cd5744-ljn8h\" (UID: \"14ebf361-7f3d-42cf-9a35-d537e92f1d7e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.471583 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.471513 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:45.632282 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:20:45.632237 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ebf361_7f3d_42cf_9a35_d537e92f1d7e.slice/crio-051fd4cea0d64e41428822a630b3059448d64b882dcac43cf78671270568bf26 WatchSource:0}: Error finding container 051fd4cea0d64e41428822a630b3059448d64b882dcac43cf78671270568bf26: Status 404 returned error can't find the container with id 051fd4cea0d64e41428822a630b3059448d64b882dcac43cf78671270568bf26 Jun 08 12:20:45.632282 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.632248 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h"] Jun 08 12:20:45.634440 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.634405 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 08 12:20:45.634562 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.634505 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 08 12:20:45.634562 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:45.634550 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 08 12:20:46.516952 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:46.516911 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" event={"ID":"14ebf361-7f3d-42cf-9a35-d537e92f1d7e","Type":"ContainerStarted","Data":"24902615318e25985b1cbbbc6bc23e87a69b496303418951b8f35dd37620c3d3"} Jun 08 12:20:46.517335 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:46.516970 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" event={"ID":"14ebf361-7f3d-42cf-9a35-d537e92f1d7e","Type":"ContainerStarted","Data":"051fd4cea0d64e41428822a630b3059448d64b882dcac43cf78671270568bf26"} Jun 08 12:20:46.550068 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:46.550020 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" podStartSLOduration=1.550005921 podStartE2EDuration="1.550005921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:20:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:20:46.546133558 +0000 UTC m=+674.661951697" watchObservedRunningTime="2026-06-08 12:20:46.550005921 +0000 UTC m=+674.665824059" Jun 08 12:20:47.472587 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:47.472552 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:47.477319 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:47.477295 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:47.523091 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:47.523062 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:47.523919 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:47.523902 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:20:49.293026 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:49.292996 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:49.701694 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:49.701661 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:49.717710 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:49.717676 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-x64m5"] Jun 08 12:20:49.721364 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:49.721346 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-x64m5" Jun 08 12:20:49.724099 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:49.724079 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 08 12:20:49.724362 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:49.724347 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4pvhh\"" Jun 08 12:20:49.730635 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:49.730612 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47z9s\" (UniqueName: \"kubernetes.io/projected/c236a848-c913-4b37-ac8e-fa984f1ae0d9-kube-api-access-47z9s\") pod \"limitador-limitador-64c94fd64f-x64m5\" (UID: \"c236a848-c913-4b37-ac8e-fa984f1ae0d9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-x64m5" Jun 08 12:20:49.730741 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:49.730723 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c236a848-c913-4b37-ac8e-fa984f1ae0d9-config-file\") pod \"limitador-limitador-64c94fd64f-x64m5\" (UID: \"c236a848-c913-4b37-ac8e-fa984f1ae0d9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-x64m5" Jun 08 12:20:49.735719 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:49.735690 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-x64m5"] Jun 08 12:20:49.797121 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:49.797088 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:49.811281 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:49.811246 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-x64m5"] Jun 08 12:20:49.831715 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:49.831692 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47z9s\" (UniqueName: \"kubernetes.io/projected/c236a848-c913-4b37-ac8e-fa984f1ae0d9-kube-api-access-47z9s\") pod \"limitador-limitador-64c94fd64f-x64m5\" (UID: \"c236a848-c913-4b37-ac8e-fa984f1ae0d9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-x64m5" Jun 08 12:20:49.831800 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:49.831765 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c236a848-c913-4b37-ac8e-fa984f1ae0d9-config-file\") pod \"limitador-limitador-64c94fd64f-x64m5\" (UID: \"c236a848-c913-4b37-ac8e-fa984f1ae0d9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-x64m5" Jun 08 12:20:49.832365 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:49.832345 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c236a848-c913-4b37-ac8e-fa984f1ae0d9-config-file\") pod \"limitador-limitador-64c94fd64f-x64m5\" (UID: \"c236a848-c913-4b37-ac8e-fa984f1ae0d9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-x64m5" Jun 08 12:20:49.840572 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:49.840553 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47z9s\" (UniqueName: \"kubernetes.io/projected/c236a848-c913-4b37-ac8e-fa984f1ae0d9-kube-api-access-47z9s\") pod \"limitador-limitador-64c94fd64f-x64m5\" (UID: \"c236a848-c913-4b37-ac8e-fa984f1ae0d9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-x64m5" Jun 08 12:20:49.900133 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:49.900107 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:50.032207 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:50.032126 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-x64m5" Jun 08 12:20:50.182054 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:20:50.182025 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc236a848_c913_4b37_ac8e_fa984f1ae0d9.slice/crio-04d25b576f61bbec89c049c2eb63231b812f1b822ddedd358e9d04d349e64b5d WatchSource:0}: Error finding container 04d25b576f61bbec89c049c2eb63231b812f1b822ddedd358e9d04d349e64b5d: Status 404 returned error can't find the container with id 04d25b576f61bbec89c049c2eb63231b812f1b822ddedd358e9d04d349e64b5d Jun 08 12:20:50.184388 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:50.184365 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-x64m5"] Jun 08 12:20:50.542712 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:50.542666 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-x64m5" event={"ID":"c236a848-c913-4b37-ac8e-fa984f1ae0d9","Type":"ContainerStarted","Data":"04d25b576f61bbec89c049c2eb63231b812f1b822ddedd358e9d04d349e64b5d"} Jun 08 12:20:50.592965 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:50.592937 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:50.695519 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:50.695484 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:20:50.768548 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:50.768518 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-d4h2t"] Jun 08 12:20:50.773337 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:50.773321 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d4h2t" Jun 08 12:20:50.776005 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:50.775987 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ll99m\"" Jun 08 12:20:50.783000 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:50.782970 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d4h2t"] Jun 08 12:20:50.840972 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:50.840906 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjv28\" (UniqueName: \"kubernetes.io/projected/f67a3d41-fddd-4b2b-b4f4-a74b591da475-kube-api-access-cjv28\") pod \"authorino-75d556bd77-d4h2t\" (UID: \"f67a3d41-fddd-4b2b-b4f4-a74b591da475\") " pod="kuadrant-system/authorino-75d556bd77-d4h2t" Jun 08 12:20:50.942215 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:50.942187 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjv28\" (UniqueName: \"kubernetes.io/projected/f67a3d41-fddd-4b2b-b4f4-a74b591da475-kube-api-access-cjv28\") pod \"authorino-75d556bd77-d4h2t\" (UID: \"f67a3d41-fddd-4b2b-b4f4-a74b591da475\") " pod="kuadrant-system/authorino-75d556bd77-d4h2t" Jun 08 12:20:50.951835 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:50.951802 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjv28\" (UniqueName: \"kubernetes.io/projected/f67a3d41-fddd-4b2b-b4f4-a74b591da475-kube-api-access-cjv28\") pod \"authorino-75d556bd77-d4h2t\" (UID: \"f67a3d41-fddd-4b2b-b4f4-a74b591da475\") " pod="kuadrant-system/authorino-75d556bd77-d4h2t" Jun 08 12:20:51.083918 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:51.083885 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d4h2t" Jun 08 12:20:51.223831 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:51.223790 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d4h2t"] Jun 08 12:20:51.223992 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:20:51.223974 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf67a3d41_fddd_4b2b_b4f4_a74b591da475.slice/crio-f656326757fe4a454335ac221c314917e8fadc48bb0941b0951a734c030363b5 WatchSource:0}: Error finding container f656326757fe4a454335ac221c314917e8fadc48bb0941b0951a734c030363b5: Status 404 returned error can't find the container with id f656326757fe4a454335ac221c314917e8fadc48bb0941b0951a734c030363b5 Jun 08 12:20:51.555685 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:51.555647 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d4h2t" event={"ID":"f67a3d41-fddd-4b2b-b4f4-a74b591da475","Type":"ContainerStarted","Data":"f656326757fe4a454335ac221c314917e8fadc48bb0941b0951a734c030363b5"} Jun 08 12:20:55.591097 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:55.590999 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d4h2t" event={"ID":"f67a3d41-fddd-4b2b-b4f4-a74b591da475","Type":"ContainerStarted","Data":"af589e714f8459c8a33a224573386c5712cb206fca1139ef198389b9c6c1e767"} Jun 08 12:20:55.592679 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:55.592655 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-x64m5" event={"ID":"c236a848-c913-4b37-ac8e-fa984f1ae0d9","Type":"ContainerStarted","Data":"a131df34d13872c63cd23aa2a62c0bd2700d14ddb40ace17941d26f95f23fba9"} Jun 08 12:20:55.592797 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:55.592782 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-x64m5" Jun 08 12:20:55.617406 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:55.617357 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-d4h2t" podStartSLOduration=1.499383839 podStartE2EDuration="5.617344479s" totalImagesPullingTime="4.11796064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:20:55.616234164 +0000 UTC m=+683.732052302" watchObservedRunningTime="2026-06-08 12:20:55.617344479 +0000 UTC m=+683.733162616" Jun 08 12:20:55.640279 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:20:55.640230 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-x64m5" podStartSLOduration=1.481847543 podStartE2EDuration="6.640218843s" totalImagesPullingTime="5.1583713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:20:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:20:55.636769208 +0000 UTC m=+683.752587347" watchObservedRunningTime="2026-06-08 12:20:55.640218843 +0000 UTC m=+683.756036980" Jun 08 12:21:05.389135 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:05.389099 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-x64m5"] Jun 08 12:21:05.389680 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:05.389277 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-x64m5" podUID="c236a848-c913-4b37-ac8e-fa984f1ae0d9" containerName="limitador" containerID="cri-o://a131df34d13872c63cd23aa2a62c0bd2700d14ddb40ace17941d26f95f23fba9" gracePeriod=30 Jun 08 12:21:05.390090 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:05.389963 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-x64m5" Jun 08 12:21:05.939445 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:05.939421 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-x64m5" Jun 08 12:21:05.991971 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:05.991909 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47z9s\" (UniqueName: \"kubernetes.io/projected/c236a848-c913-4b37-ac8e-fa984f1ae0d9-kube-api-access-47z9s\") pod \"c236a848-c913-4b37-ac8e-fa984f1ae0d9\" (UID: \"c236a848-c913-4b37-ac8e-fa984f1ae0d9\") " Jun 08 12:21:05.991971 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:05.991945 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c236a848-c913-4b37-ac8e-fa984f1ae0d9-config-file\") pod \"c236a848-c913-4b37-ac8e-fa984f1ae0d9\" (UID: \"c236a848-c913-4b37-ac8e-fa984f1ae0d9\") " Jun 08 12:21:05.992361 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:05.992336 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c236a848-c913-4b37-ac8e-fa984f1ae0d9-config-file" (OuterVolumeSpecName: "config-file") pod "c236a848-c913-4b37-ac8e-fa984f1ae0d9" (UID: "c236a848-c913-4b37-ac8e-fa984f1ae0d9"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:21:05.994143 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:05.994118 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c236a848-c913-4b37-ac8e-fa984f1ae0d9-kube-api-access-47z9s" (OuterVolumeSpecName: "kube-api-access-47z9s") pod "c236a848-c913-4b37-ac8e-fa984f1ae0d9" (UID: "c236a848-c913-4b37-ac8e-fa984f1ae0d9"). InnerVolumeSpecName "kube-api-access-47z9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:21:06.093375 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:06.093343 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47z9s\" (UniqueName: \"kubernetes.io/projected/c236a848-c913-4b37-ac8e-fa984f1ae0d9-kube-api-access-47z9s\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:21:06.093375 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:06.093370 2565 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c236a848-c913-4b37-ac8e-fa984f1ae0d9-config-file\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:21:06.663476 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:06.663443 2565 generic.go:356] "Generic (PLEG): container finished" podID="c236a848-c913-4b37-ac8e-fa984f1ae0d9" containerID="a131df34d13872c63cd23aa2a62c0bd2700d14ddb40ace17941d26f95f23fba9" exitCode=0 Jun 08 12:21:06.663968 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:06.663505 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-x64m5" Jun 08 12:21:06.663968 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:06.663535 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-x64m5" event={"ID":"c236a848-c913-4b37-ac8e-fa984f1ae0d9","Type":"ContainerDied","Data":"a131df34d13872c63cd23aa2a62c0bd2700d14ddb40ace17941d26f95f23fba9"} Jun 08 12:21:06.663968 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:06.663609 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-x64m5" event={"ID":"c236a848-c913-4b37-ac8e-fa984f1ae0d9","Type":"ContainerDied","Data":"04d25b576f61bbec89c049c2eb63231b812f1b822ddedd358e9d04d349e64b5d"} Jun 08 12:21:06.663968 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:06.663632 2565 scope.go:117] "RemoveContainer" containerID="a131df34d13872c63cd23aa2a62c0bd2700d14ddb40ace17941d26f95f23fba9" Jun 08 12:21:06.673900 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:06.673880 2565 scope.go:117] "RemoveContainer" containerID="a131df34d13872c63cd23aa2a62c0bd2700d14ddb40ace17941d26f95f23fba9" Jun 08 12:21:06.674178 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:21:06.674160 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a131df34d13872c63cd23aa2a62c0bd2700d14ddb40ace17941d26f95f23fba9\": container with ID starting with a131df34d13872c63cd23aa2a62c0bd2700d14ddb40ace17941d26f95f23fba9 not found: ID does not exist" containerID="a131df34d13872c63cd23aa2a62c0bd2700d14ddb40ace17941d26f95f23fba9" Jun 08 12:21:06.674234 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:06.674186 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a131df34d13872c63cd23aa2a62c0bd2700d14ddb40ace17941d26f95f23fba9"} err="failed to get container status \"a131df34d13872c63cd23aa2a62c0bd2700d14ddb40ace17941d26f95f23fba9\": rpc error: code = NotFound desc = could not find container \"a131df34d13872c63cd23aa2a62c0bd2700d14ddb40ace17941d26f95f23fba9\": container with ID starting with a131df34d13872c63cd23aa2a62c0bd2700d14ddb40ace17941d26f95f23fba9 not found: ID does not exist" Jun 08 12:21:06.685174 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:06.685151 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-x64m5"] Jun 08 12:21:06.689284 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:06.689260 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-x64m5"] Jun 08 12:21:08.348579 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:08.348546 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c236a848-c913-4b37-ac8e-fa984f1ae0d9" path="/var/lib/kubelet/pods/c236a848-c913-4b37-ac8e-fa984f1ae0d9/volumes" Jun 08 12:21:11.022236 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:11.022203 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:21:11.127455 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:11.127418 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:21:11.439957 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:11.439928 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-lq2bf"] Jun 08 12:21:11.440371 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:11.440358 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c236a848-c913-4b37-ac8e-fa984f1ae0d9" containerName="limitador" Jun 08 12:21:11.440371 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:11.440372 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c236a848-c913-4b37-ac8e-fa984f1ae0d9" containerName="limitador" Jun 08 12:21:11.440497 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:11.440441 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c236a848-c913-4b37-ac8e-fa984f1ae0d9" containerName="limitador" Jun 08 12:21:11.444934 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:11.444911 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-lq2bf" Jun 08 12:21:11.448468 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:11.448436 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"default-dockercfg-p5lck\"" Jun 08 12:21:11.448644 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:11.448476 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"postgres-creds\"" Jun 08 12:21:11.448902 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:11.448868 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 08 12:21:11.449204 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:11.449186 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 08 12:21:11.459688 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:11.459664 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-lq2bf"] Jun 08 12:21:11.483838 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:11.483793 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:21:11.545903 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:11.545862 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnndk\" (UniqueName: \"kubernetes.io/projected/26ec22d6-f0e0-4734-9aa0-5563727b5178-kube-api-access-hnndk\") pod \"postgres-69fb4594cf-lq2bf\" (UID: \"26ec22d6-f0e0-4734-9aa0-5563727b5178\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-lq2bf" Jun 08 12:21:11.546069 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:11.546006 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/26ec22d6-f0e0-4734-9aa0-5563727b5178-data\") pod \"postgres-69fb4594cf-lq2bf\" (UID: \"26ec22d6-f0e0-4734-9aa0-5563727b5178\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-lq2bf" Jun 08 12:21:11.646857 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:11.646792 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnndk\" (UniqueName: \"kubernetes.io/projected/26ec22d6-f0e0-4734-9aa0-5563727b5178-kube-api-access-hnndk\") pod \"postgres-69fb4594cf-lq2bf\" (UID: \"26ec22d6-f0e0-4734-9aa0-5563727b5178\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-lq2bf" Jun 08 12:21:11.647054 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:11.646908 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/26ec22d6-f0e0-4734-9aa0-5563727b5178-data\") pod \"postgres-69fb4594cf-lq2bf\" (UID: \"26ec22d6-f0e0-4734-9aa0-5563727b5178\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-lq2bf" Jun 08 12:21:11.647299 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:11.647281 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/26ec22d6-f0e0-4734-9aa0-5563727b5178-data\") pod \"postgres-69fb4594cf-lq2bf\" (UID: \"26ec22d6-f0e0-4734-9aa0-5563727b5178\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-lq2bf" Jun 08 12:21:11.656561 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:11.656536 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnndk\" (UniqueName: \"kubernetes.io/projected/26ec22d6-f0e0-4734-9aa0-5563727b5178-kube-api-access-hnndk\") pod \"postgres-69fb4594cf-lq2bf\" (UID: \"26ec22d6-f0e0-4734-9aa0-5563727b5178\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-lq2bf" Jun 08 12:21:11.760622 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:11.760542 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-lq2bf" Jun 08 12:21:11.903625 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:11.903594 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-lq2bf"] Jun 08 12:21:11.905545 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:21:11.905518 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ec22d6_f0e0_4734_9aa0_5563727b5178.slice/crio-69ca3877fdf0e47dffe1c59494f00fa1744d2116d6d3a97f4dfd3fb86cc06306 WatchSource:0}: Error finding container 69ca3877fdf0e47dffe1c59494f00fa1744d2116d6d3a97f4dfd3fb86cc06306: Status 404 returned error can't find the container with id 69ca3877fdf0e47dffe1c59494f00fa1744d2116d6d3a97f4dfd3fb86cc06306 Jun 08 12:21:12.705463 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:12.705418 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-lq2bf" event={"ID":"26ec22d6-f0e0-4734-9aa0-5563727b5178","Type":"ContainerStarted","Data":"69ca3877fdf0e47dffe1c59494f00fa1744d2116d6d3a97f4dfd3fb86cc06306"} Jun 08 12:21:14.720342 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:14.720310 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-lq2bf" event={"ID":"26ec22d6-f0e0-4734-9aa0-5563727b5178","Type":"ContainerStarted","Data":"db1953cfd459017f7ed783ff1bf9376a1c861b7369bf5069d12ecd199ab5623e"} Jun 08 12:21:14.720749 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:14.720369 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-lq2bf" Jun 08 12:21:14.742781 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:14.742728 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-lq2bf" podStartSLOduration=1.524031163 podStartE2EDuration="3.742713973s" totalImagesPullingTime="2.21868281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:21:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:21:14.741685339 +0000 UTC m=+702.857503477" watchObservedRunningTime="2026-06-08 12:21:14.742713973 +0000 UTC m=+702.858532112" Jun 08 12:21:20.761425 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:20.761397 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-lq2bf" Jun 08 12:21:21.131020 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:21.130982 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:21:21.257887 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:21.257856 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:21:21.412315 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:21.412237 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:21:22.925013 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:22.924982 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r"] Jun 08 12:21:22.931201 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:22.931181 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r" Jun 08 12:21:22.935485 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:22.935464 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 12:21:22.936116 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:22.936104 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 12:21:22.936988 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:22.936973 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2wp8n\"" Jun 08 12:21:22.947503 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:22.947483 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r"] Jun 08 12:21:23.062724 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:23.062692 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf515632-c815-420e-8125-0a408897add1-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r\" (UID: \"cf515632-c815-420e-8125-0a408897add1\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r" Jun 08 12:21:23.062903 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:23.062734 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf515632-c815-420e-8125-0a408897add1-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r\" (UID: \"cf515632-c815-420e-8125-0a408897add1\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r" Jun 08 12:21:23.062903 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:23.062855 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g742\" (UniqueName: \"kubernetes.io/projected/cf515632-c815-420e-8125-0a408897add1-kube-api-access-7g742\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r\" (UID: \"cf515632-c815-420e-8125-0a408897add1\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r" Jun 08 12:21:23.164095 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:23.164063 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf515632-c815-420e-8125-0a408897add1-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r\" (UID: \"cf515632-c815-420e-8125-0a408897add1\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r" Jun 08 12:21:23.164252 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:23.164102 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf515632-c815-420e-8125-0a408897add1-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r\" (UID: \"cf515632-c815-420e-8125-0a408897add1\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r" Jun 08 12:21:23.164252 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:23.164160 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g742\" (UniqueName: \"kubernetes.io/projected/cf515632-c815-420e-8125-0a408897add1-kube-api-access-7g742\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r\" (UID: \"cf515632-c815-420e-8125-0a408897add1\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r" Jun 08 12:21:23.164469 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:23.164448 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf515632-c815-420e-8125-0a408897add1-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r\" (UID: \"cf515632-c815-420e-8125-0a408897add1\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r" Jun 08 12:21:23.164508 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:23.164486 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf515632-c815-420e-8125-0a408897add1-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r\" (UID: \"cf515632-c815-420e-8125-0a408897add1\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r" Jun 08 12:21:23.189949 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:23.189877 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g742\" (UniqueName: \"kubernetes.io/projected/cf515632-c815-420e-8125-0a408897add1-kube-api-access-7g742\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r\" (UID: \"cf515632-c815-420e-8125-0a408897add1\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r" Jun 08 12:21:23.240613 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:23.240585 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r" Jun 08 12:21:23.396917 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:23.396892 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r"] Jun 08 12:21:23.398403 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:21:23.398376 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf515632_c815_420e_8125_0a408897add1.slice/crio-aa6ed1f9a34383654b6a4b8fea45e502796b7e2e25887c2ff61347c1aae61721 WatchSource:0}: Error finding container aa6ed1f9a34383654b6a4b8fea45e502796b7e2e25887c2ff61347c1aae61721: Status 404 returned error can't find the container with id aa6ed1f9a34383654b6a4b8fea45e502796b7e2e25887c2ff61347c1aae61721 Jun 08 12:21:23.777124 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:23.777038 2565 generic.go:356] "Generic (PLEG): container finished" podID="cf515632-c815-420e-8125-0a408897add1" containerID="fca3c70cb37282b5cbaf4572d8e5fbbcd793661e93aa92b86c6b6cd3454b6002" exitCode=0 Jun 08 12:21:23.777124 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:23.777110 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r" event={"ID":"cf515632-c815-420e-8125-0a408897add1","Type":"ContainerDied","Data":"fca3c70cb37282b5cbaf4572d8e5fbbcd793661e93aa92b86c6b6cd3454b6002"} Jun 08 12:21:23.777326 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:23.777145 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r" event={"ID":"cf515632-c815-420e-8125-0a408897add1","Type":"ContainerStarted","Data":"aa6ed1f9a34383654b6a4b8fea45e502796b7e2e25887c2ff61347c1aae61721"} Jun 08 12:21:23.778134 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:23.778109 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 12:21:24.785178 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:24.785089 2565 generic.go:356] "Generic (PLEG): container finished" podID="cf515632-c815-420e-8125-0a408897add1" containerID="5a79fee067c934500604914c24971e38c35a3843ff1c6f78f66635abc94bc03a" exitCode=0 Jun 08 12:21:24.785548 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:24.785178 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r" event={"ID":"cf515632-c815-420e-8125-0a408897add1","Type":"ContainerDied","Data":"5a79fee067c934500604914c24971e38c35a3843ff1c6f78f66635abc94bc03a"} Jun 08 12:21:25.793903 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:25.793871 2565 generic.go:356] "Generic (PLEG): container finished" podID="cf515632-c815-420e-8125-0a408897add1" containerID="2e4251811b8dc8589ff55cb684087322b4b46cd86374b6f1adad5a919ab91c88" exitCode=0 Jun 08 12:21:25.794319 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:25.793958 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r" event={"ID":"cf515632-c815-420e-8125-0a408897add1","Type":"ContainerDied","Data":"2e4251811b8dc8589ff55cb684087322b4b46cd86374b6f1adad5a919ab91c88"} Jun 08 12:21:26.986015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:26.985988 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r" Jun 08 12:21:27.005443 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:27.005415 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf515632-c815-420e-8125-0a408897add1-util\") pod \"cf515632-c815-420e-8125-0a408897add1\" (UID: \"cf515632-c815-420e-8125-0a408897add1\") " Jun 08 12:21:27.005588 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:27.005486 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7g742\" (UniqueName: \"kubernetes.io/projected/cf515632-c815-420e-8125-0a408897add1-kube-api-access-7g742\") pod \"cf515632-c815-420e-8125-0a408897add1\" (UID: \"cf515632-c815-420e-8125-0a408897add1\") " Jun 08 12:21:27.005588 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:27.005567 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf515632-c815-420e-8125-0a408897add1-bundle\") pod \"cf515632-c815-420e-8125-0a408897add1\" (UID: \"cf515632-c815-420e-8125-0a408897add1\") " Jun 08 12:21:27.006440 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:27.006410 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf515632-c815-420e-8125-0a408897add1-bundle" (OuterVolumeSpecName: "bundle") pod "cf515632-c815-420e-8125-0a408897add1" (UID: "cf515632-c815-420e-8125-0a408897add1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:21:27.007944 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:27.007911 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf515632-c815-420e-8125-0a408897add1-kube-api-access-7g742" (OuterVolumeSpecName: "kube-api-access-7g742") pod "cf515632-c815-420e-8125-0a408897add1" (UID: "cf515632-c815-420e-8125-0a408897add1"). InnerVolumeSpecName "kube-api-access-7g742". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:21:27.015143 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:27.015115 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf515632-c815-420e-8125-0a408897add1-util" (OuterVolumeSpecName: "util") pod "cf515632-c815-420e-8125-0a408897add1" (UID: "cf515632-c815-420e-8125-0a408897add1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 12:21:27.106644 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:27.106587 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7g742\" (UniqueName: \"kubernetes.io/projected/cf515632-c815-420e-8125-0a408897add1-kube-api-access-7g742\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:21:27.106644 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:27.106611 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf515632-c815-420e-8125-0a408897add1-bundle\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:21:27.106644 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:27.106621 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf515632-c815-420e-8125-0a408897add1-util\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:21:27.815802 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:27.815777 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r" Jun 08 12:21:27.816011 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:27.815807 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7482956r" event={"ID":"cf515632-c815-420e-8125-0a408897add1","Type":"ContainerDied","Data":"aa6ed1f9a34383654b6a4b8fea45e502796b7e2e25887c2ff61347c1aae61721"} Jun 08 12:21:27.816011 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:27.815876 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa6ed1f9a34383654b6a4b8fea45e502796b7e2e25887c2ff61347c1aae61721" Jun 08 12:21:29.167163 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:29.167126 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:21:31.179476 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:31.179445 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-gfsnz"] Jun 08 12:21:31.179897 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:31.179884 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf515632-c815-420e-8125-0a408897add1" containerName="pull" Jun 08 12:21:31.179957 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:31.179898 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf515632-c815-420e-8125-0a408897add1" containerName="pull" Jun 08 12:21:31.179957 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:31.179912 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf515632-c815-420e-8125-0a408897add1" containerName="extract" Jun 08 12:21:31.179957 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:31.179917 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf515632-c815-420e-8125-0a408897add1" containerName="extract" Jun 08 12:21:31.179957 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:31.179944 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf515632-c815-420e-8125-0a408897add1" containerName="util" Jun 08 12:21:31.179957 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:31.179949 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf515632-c815-420e-8125-0a408897add1" containerName="util" Jun 08 12:21:31.180113 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:31.180013 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf515632-c815-420e-8125-0a408897add1" containerName="extract" Jun 08 12:21:31.182151 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:31.182136 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-gfsnz" Jun 08 12:21:31.184927 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:31.184901 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 12:21:31.185943 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:31.185927 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-8rj57\"" Jun 08 12:21:31.186020 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:31.185931 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 12:21:31.196922 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:31.196899 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-gfsnz"] Jun 08 12:21:31.245410 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:31.245378 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxpvp\" (UniqueName: \"kubernetes.io/projected/012ef5fd-89b8-483a-b031-e0717f5d8295-kube-api-access-rxpvp\") pod \"keycloak-operator-d67dbbb48-gfsnz\" (UID: \"012ef5fd-89b8-483a-b031-e0717f5d8295\") " pod="keycloak-system/keycloak-operator-d67dbbb48-gfsnz" Jun 08 12:21:31.346439 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:31.346409 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxpvp\" (UniqueName: \"kubernetes.io/projected/012ef5fd-89b8-483a-b031-e0717f5d8295-kube-api-access-rxpvp\") pod \"keycloak-operator-d67dbbb48-gfsnz\" (UID: \"012ef5fd-89b8-483a-b031-e0717f5d8295\") " pod="keycloak-system/keycloak-operator-d67dbbb48-gfsnz" Jun 08 12:21:31.364139 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:31.364116 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxpvp\" (UniqueName: \"kubernetes.io/projected/012ef5fd-89b8-483a-b031-e0717f5d8295-kube-api-access-rxpvp\") pod \"keycloak-operator-d67dbbb48-gfsnz\" (UID: \"012ef5fd-89b8-483a-b031-e0717f5d8295\") " pod="keycloak-system/keycloak-operator-d67dbbb48-gfsnz" Jun 08 12:21:31.493097 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:31.493031 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-gfsnz" Jun 08 12:21:31.655780 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:31.655748 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-gfsnz"] Jun 08 12:21:31.656516 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:21:31.656491 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod012ef5fd_89b8_483a_b031_e0717f5d8295.slice/crio-0b5732b4d052608357fd711c6d0c3c8eaf7981a3ea317ea047dcd7208c70ba49 WatchSource:0}: Error finding container 0b5732b4d052608357fd711c6d0c3c8eaf7981a3ea317ea047dcd7208c70ba49: Status 404 returned error can't find the container with id 0b5732b4d052608357fd711c6d0c3c8eaf7981a3ea317ea047dcd7208c70ba49 Jun 08 12:21:31.841756 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:31.841667 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-gfsnz" event={"ID":"012ef5fd-89b8-483a-b031-e0717f5d8295","Type":"ContainerStarted","Data":"0b5732b4d052608357fd711c6d0c3c8eaf7981a3ea317ea047dcd7208c70ba49"} Jun 08 12:21:36.890657 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:36.890620 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-gfsnz" event={"ID":"012ef5fd-89b8-483a-b031-e0717f5d8295","Type":"ContainerStarted","Data":"9a593ca0eca4d1a9c6fc5ad46c38d442dbb330f00666ee10deb690bcf4afd4cc"} Jun 08 12:21:36.936106 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:36.936062 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-gfsnz" podStartSLOduration=0.873666051 podStartE2EDuration="5.936047495s" totalImagesPullingTime="5.062381444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:21:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:21:36.933670299 +0000 UTC m=+725.049488437" watchObservedRunningTime="2026-06-08 12:21:36.936047495 +0000 UTC m=+725.051865633" Jun 08 12:21:45.417495 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:45.417461 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:21:45.517930 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:21:45.517890 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:22:15.932557 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:15.932520 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:22:16.178015 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:16.177973 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2z29q"] Jun 08 12:22:16.180449 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:16.180426 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2z29q" Jun 08 12:22:16.197558 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:16.197533 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2z29q"] Jun 08 12:22:16.280914 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:16.280874 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sqjl\" (UniqueName: \"kubernetes.io/projected/b0c0566a-0e94-4d43-9811-0beed080efe1-kube-api-access-9sqjl\") pod \"authorino-5d4b67c446-2z29q\" (UID: \"b0c0566a-0e94-4d43-9811-0beed080efe1\") " pod="kuadrant-system/authorino-5d4b67c446-2z29q" Jun 08 12:22:16.331494 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:16.331457 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:22:16.382211 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:16.382177 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sqjl\" (UniqueName: \"kubernetes.io/projected/b0c0566a-0e94-4d43-9811-0beed080efe1-kube-api-access-9sqjl\") pod \"authorino-5d4b67c446-2z29q\" (UID: \"b0c0566a-0e94-4d43-9811-0beed080efe1\") " pod="kuadrant-system/authorino-5d4b67c446-2z29q" Jun 08 12:22:16.394653 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:16.394625 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sqjl\" (UniqueName: \"kubernetes.io/projected/b0c0566a-0e94-4d43-9811-0beed080efe1-kube-api-access-9sqjl\") pod \"authorino-5d4b67c446-2z29q\" (UID: \"b0c0566a-0e94-4d43-9811-0beed080efe1\") " pod="kuadrant-system/authorino-5d4b67c446-2z29q" Jun 08 12:22:16.414462 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:16.414435 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2z29q"] Jun 08 12:22:16.414720 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:16.414707 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2z29q" Jun 08 12:22:16.447328 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:16.447266 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8685db7f59-rrk7g"] Jun 08 12:22:16.450048 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:16.450029 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8685db7f59-rrk7g" Jun 08 12:22:16.470912 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:16.465781 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8685db7f59-rrk7g"] Jun 08 12:22:16.567762 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:16.567736 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2z29q"] Jun 08 12:22:16.569363 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:22:16.569334 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0c0566a_0e94_4d43_9811_0beed080efe1.slice/crio-eca102d6c66d16aaf039733d9086635508b58f3c9995f5bf5488090a20955c24 WatchSource:0}: Error finding container eca102d6c66d16aaf039733d9086635508b58f3c9995f5bf5488090a20955c24: Status 404 returned error can't find the container with id eca102d6c66d16aaf039733d9086635508b58f3c9995f5bf5488090a20955c24 Jun 08 12:22:16.584272 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:16.584249 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb2bb\" (UniqueName: \"kubernetes.io/projected/31457254-7efd-4bb0-bf47-24ca5f142ff9-kube-api-access-gb2bb\") pod \"authorino-8685db7f59-rrk7g\" (UID: \"31457254-7efd-4bb0-bf47-24ca5f142ff9\") " pod="kuadrant-system/authorino-8685db7f59-rrk7g" Jun 08 12:22:16.652095 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:16.652065 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8685db7f59-rrk7g"] Jun 08 12:22:16.652367 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:22:16.652349 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gb2bb], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8685db7f59-rrk7g" podUID="31457254-7efd-4bb0-bf47-24ca5f142ff9" Jun 08 12:22:16.685590 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:16.685562 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb2bb\" (UniqueName: \"kubernetes.io/projected/31457254-7efd-4bb0-bf47-24ca5f142ff9-kube-api-access-gb2bb\") pod \"authorino-8685db7f59-rrk7g\" (UID: \"31457254-7efd-4bb0-bf47-24ca5f142ff9\") " pod="kuadrant-system/authorino-8685db7f59-rrk7g" Jun 08 12:22:16.703237 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:16.703177 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb2bb\" (UniqueName: \"kubernetes.io/projected/31457254-7efd-4bb0-bf47-24ca5f142ff9-kube-api-access-gb2bb\") pod \"authorino-8685db7f59-rrk7g\" (UID: \"31457254-7efd-4bb0-bf47-24ca5f142ff9\") " pod="kuadrant-system/authorino-8685db7f59-rrk7g" Jun 08 12:22:17.144940 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:17.144184 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8685db7f59-rrk7g" Jun 08 12:22:17.144940 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:17.144722 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-2z29q" podUID="b0c0566a-0e94-4d43-9811-0beed080efe1" containerName="authorino" containerID="cri-o://b3c5ee760fa8893769c9c208d3e7efe16c662291e204b489d1a1e2bd8654c3e9" gracePeriod=30 Jun 08 12:22:17.144940 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:17.144731 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2z29q" event={"ID":"b0c0566a-0e94-4d43-9811-0beed080efe1","Type":"ContainerStarted","Data":"b3c5ee760fa8893769c9c208d3e7efe16c662291e204b489d1a1e2bd8654c3e9"} Jun 08 12:22:17.145524 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:17.144958 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2z29q" event={"ID":"b0c0566a-0e94-4d43-9811-0beed080efe1","Type":"ContainerStarted","Data":"eca102d6c66d16aaf039733d9086635508b58f3c9995f5bf5488090a20955c24"} Jun 08 12:22:17.151619 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:17.151596 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8685db7f59-rrk7g" Jun 08 12:22:17.213688 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:17.213636 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-2z29q" podStartSLOduration=0.770970041 podStartE2EDuration="1.213620472s" totalImagesPullingTime="442.650431ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:22:17.183945917 +0000 UTC m=+765.299764056" watchObservedRunningTime="2026-06-08 12:22:17.213620472 +0000 UTC m=+765.329438656" Jun 08 12:22:17.289839 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:17.289746 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gb2bb\" (UniqueName: \"kubernetes.io/projected/31457254-7efd-4bb0-bf47-24ca5f142ff9-kube-api-access-gb2bb\") pod \"31457254-7efd-4bb0-bf47-24ca5f142ff9\" (UID: \"31457254-7efd-4bb0-bf47-24ca5f142ff9\") " Jun 08 12:22:17.292054 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:17.292007 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31457254-7efd-4bb0-bf47-24ca5f142ff9-kube-api-access-gb2bb" (OuterVolumeSpecName: "kube-api-access-gb2bb") pod "31457254-7efd-4bb0-bf47-24ca5f142ff9" (UID: "31457254-7efd-4bb0-bf47-24ca5f142ff9"). InnerVolumeSpecName "kube-api-access-gb2bb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:22:17.387480 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:17.387453 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2z29q" Jun 08 12:22:17.391606 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:17.391585 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gb2bb\" (UniqueName: \"kubernetes.io/projected/31457254-7efd-4bb0-bf47-24ca5f142ff9-kube-api-access-gb2bb\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:22:17.492941 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:17.492908 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sqjl\" (UniqueName: \"kubernetes.io/projected/b0c0566a-0e94-4d43-9811-0beed080efe1-kube-api-access-9sqjl\") pod \"b0c0566a-0e94-4d43-9811-0beed080efe1\" (UID: \"b0c0566a-0e94-4d43-9811-0beed080efe1\") " Jun 08 12:22:17.495105 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:17.495076 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0c0566a-0e94-4d43-9811-0beed080efe1-kube-api-access-9sqjl" (OuterVolumeSpecName: "kube-api-access-9sqjl") pod "b0c0566a-0e94-4d43-9811-0beed080efe1" (UID: "b0c0566a-0e94-4d43-9811-0beed080efe1"). InnerVolumeSpecName "kube-api-access-9sqjl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:22:17.594310 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:17.594223 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sqjl\" (UniqueName: \"kubernetes.io/projected/b0c0566a-0e94-4d43-9811-0beed080efe1-kube-api-access-9sqjl\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:22:18.151435 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:18.151401 2565 generic.go:356] "Generic (PLEG): container finished" podID="b0c0566a-0e94-4d43-9811-0beed080efe1" containerID="b3c5ee760fa8893769c9c208d3e7efe16c662291e204b489d1a1e2bd8654c3e9" exitCode=0 Jun 08 12:22:18.151908 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:18.151438 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2z29q" Jun 08 12:22:18.151908 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:18.151482 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2z29q" event={"ID":"b0c0566a-0e94-4d43-9811-0beed080efe1","Type":"ContainerDied","Data":"b3c5ee760fa8893769c9c208d3e7efe16c662291e204b489d1a1e2bd8654c3e9"} Jun 08 12:22:18.151908 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:18.151521 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2z29q" event={"ID":"b0c0566a-0e94-4d43-9811-0beed080efe1","Type":"ContainerDied","Data":"eca102d6c66d16aaf039733d9086635508b58f3c9995f5bf5488090a20955c24"} Jun 08 12:22:18.151908 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:18.151537 2565 scope.go:117] "RemoveContainer" containerID="b3c5ee760fa8893769c9c208d3e7efe16c662291e204b489d1a1e2bd8654c3e9" Jun 08 12:22:18.151908 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:18.151667 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8685db7f59-rrk7g" Jun 08 12:22:18.161754 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:18.161733 2565 scope.go:117] "RemoveContainer" containerID="b3c5ee760fa8893769c9c208d3e7efe16c662291e204b489d1a1e2bd8654c3e9" Jun 08 12:22:18.162036 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:22:18.162016 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3c5ee760fa8893769c9c208d3e7efe16c662291e204b489d1a1e2bd8654c3e9\": container with ID starting with b3c5ee760fa8893769c9c208d3e7efe16c662291e204b489d1a1e2bd8654c3e9 not found: ID does not exist" containerID="b3c5ee760fa8893769c9c208d3e7efe16c662291e204b489d1a1e2bd8654c3e9" Jun 08 12:22:18.162100 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:18.162045 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3c5ee760fa8893769c9c208d3e7efe16c662291e204b489d1a1e2bd8654c3e9"} err="failed to get container status \"b3c5ee760fa8893769c9c208d3e7efe16c662291e204b489d1a1e2bd8654c3e9\": rpc error: code = NotFound desc = could not find container \"b3c5ee760fa8893769c9c208d3e7efe16c662291e204b489d1a1e2bd8654c3e9\": container with ID starting with b3c5ee760fa8893769c9c208d3e7efe16c662291e204b489d1a1e2bd8654c3e9 not found: ID does not exist" Jun 08 12:22:18.189370 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:18.189340 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8685db7f59-rrk7g"] Jun 08 12:22:18.194848 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:18.194798 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8685db7f59-rrk7g"] Jun 08 12:22:18.207807 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:18.207782 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2z29q"] Jun 08 12:22:18.210686 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:18.210666 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2z29q"] Jun 08 12:22:18.353850 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:18.353794 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31457254-7efd-4bb0-bf47-24ca5f142ff9" path="/var/lib/kubelet/pods/31457254-7efd-4bb0-bf47-24ca5f142ff9/volumes" Jun 08 12:22:18.354157 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:18.354139 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0c0566a-0e94-4d43-9811-0beed080efe1" path="/var/lib/kubelet/pods/b0c0566a-0e94-4d43-9811-0beed080efe1/volumes" Jun 08 12:22:19.279051 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:19.279019 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d4h2t"] Jun 08 12:22:19.279429 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:19.279197 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-d4h2t" podUID="f67a3d41-fddd-4b2b-b4f4-a74b591da475" containerName="authorino" containerID="cri-o://af589e714f8459c8a33a224573386c5712cb206fca1139ef198389b9c6c1e767" gracePeriod=30 Jun 08 12:22:19.535679 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:19.535619 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d4h2t" Jun 08 12:22:19.612999 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:19.612968 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjv28\" (UniqueName: \"kubernetes.io/projected/f67a3d41-fddd-4b2b-b4f4-a74b591da475-kube-api-access-cjv28\") pod \"f67a3d41-fddd-4b2b-b4f4-a74b591da475\" (UID: \"f67a3d41-fddd-4b2b-b4f4-a74b591da475\") " Jun 08 12:22:19.615082 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:19.615053 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f67a3d41-fddd-4b2b-b4f4-a74b591da475-kube-api-access-cjv28" (OuterVolumeSpecName: "kube-api-access-cjv28") pod "f67a3d41-fddd-4b2b-b4f4-a74b591da475" (UID: "f67a3d41-fddd-4b2b-b4f4-a74b591da475"). InnerVolumeSpecName "kube-api-access-cjv28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:22:19.713894 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:19.713866 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjv28\" (UniqueName: \"kubernetes.io/projected/f67a3d41-fddd-4b2b-b4f4-a74b591da475-kube-api-access-cjv28\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:22:20.165894 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:20.165857 2565 generic.go:356] "Generic (PLEG): container finished" podID="f67a3d41-fddd-4b2b-b4f4-a74b591da475" containerID="af589e714f8459c8a33a224573386c5712cb206fca1139ef198389b9c6c1e767" exitCode=0 Jun 08 12:22:20.166092 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:20.165901 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d4h2t" Jun 08 12:22:20.166092 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:20.165953 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d4h2t" event={"ID":"f67a3d41-fddd-4b2b-b4f4-a74b591da475","Type":"ContainerDied","Data":"af589e714f8459c8a33a224573386c5712cb206fca1139ef198389b9c6c1e767"} Jun 08 12:22:20.166092 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:20.166001 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d4h2t" event={"ID":"f67a3d41-fddd-4b2b-b4f4-a74b591da475","Type":"ContainerDied","Data":"f656326757fe4a454335ac221c314917e8fadc48bb0941b0951a734c030363b5"} Jun 08 12:22:20.166092 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:20.166025 2565 scope.go:117] "RemoveContainer" containerID="af589e714f8459c8a33a224573386c5712cb206fca1139ef198389b9c6c1e767" Jun 08 12:22:20.175471 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:20.175450 2565 scope.go:117] "RemoveContainer" containerID="af589e714f8459c8a33a224573386c5712cb206fca1139ef198389b9c6c1e767" Jun 08 12:22:20.175707 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:22:20.175687 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af589e714f8459c8a33a224573386c5712cb206fca1139ef198389b9c6c1e767\": container with ID starting with af589e714f8459c8a33a224573386c5712cb206fca1139ef198389b9c6c1e767 not found: ID does not exist" containerID="af589e714f8459c8a33a224573386c5712cb206fca1139ef198389b9c6c1e767" Jun 08 12:22:20.175754 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:20.175718 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af589e714f8459c8a33a224573386c5712cb206fca1139ef198389b9c6c1e767"} err="failed to get container status \"af589e714f8459c8a33a224573386c5712cb206fca1139ef198389b9c6c1e767\": rpc error: code = NotFound desc = could not find container \"af589e714f8459c8a33a224573386c5712cb206fca1139ef198389b9c6c1e767\": container with ID starting with af589e714f8459c8a33a224573386c5712cb206fca1139ef198389b9c6c1e767 not found: ID does not exist" Jun 08 12:22:20.200509 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:20.200482 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d4h2t"] Jun 08 12:22:20.203147 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:20.203128 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d4h2t"] Jun 08 12:22:20.347966 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:20.347937 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f67a3d41-fddd-4b2b-b4f4-a74b591da475" path="/var/lib/kubelet/pods/f67a3d41-fddd-4b2b-b4f4-a74b591da475/volumes" Jun 08 12:22:23.044914 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:23.044875 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:22:23.169485 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:23.169445 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:22:23.278411 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:23.278379 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:22:23.413905 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:23.413867 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:22:26.652290 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:26.652250 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:22:26.769977 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:26.769941 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:22:55.676563 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:55.676523 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:22:55.809843 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:55.809780 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:22:56.224505 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:56.224467 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:22:56.327253 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:22:56.327214 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:23:03.563961 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:03.563922 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-ljn8h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jun 08 12:23:03.564327 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:03.563989 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" podUID="14ebf361-7f3d-42cf-9a35-d537e92f1d7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 08 12:23:04.437028 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:04.436995 2565 generic.go:356] "Generic (PLEG): container finished" podID="14ebf361-7f3d-42cf-9a35-d537e92f1d7e" containerID="24902615318e25985b1cbbbc6bc23e87a69b496303418951b8f35dd37620c3d3" exitCode=0 Jun 08 12:23:04.437232 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:04.437047 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" event={"ID":"14ebf361-7f3d-42cf-9a35-d537e92f1d7e","Type":"ContainerDied","Data":"24902615318e25985b1cbbbc6bc23e87a69b496303418951b8f35dd37620c3d3"} Jun 08 12:23:04.437426 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:04.437412 2565 scope.go:117] "RemoveContainer" containerID="24902615318e25985b1cbbbc6bc23e87a69b496303418951b8f35dd37620c3d3" Jun 08 12:23:04.438436 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:04.438408 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 08 12:23:04.438507 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:04.438475 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 08 12:23:04.438544 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:04.438507 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 08 12:23:05.453846 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:05.452929 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" event={"ID":"14ebf361-7f3d-42cf-9a35-d537e92f1d7e","Type":"ContainerStarted","Data":"c5c1863470bfb33c064a280c561315958594d0ce78c6102533c184d4370c1ef2"} Jun 08 12:23:05.472551 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:05.472511 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:23:05.472722 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:05.472682 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-ljn8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Jun 08 12:23:05.472765 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:05.472740 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" podUID="14ebf361-7f3d-42cf-9a35-d537e92f1d7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Jun 08 12:23:06.472437 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:06.472400 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-ljn8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Jun 08 12:23:06.472860 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:06.472452 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" podUID="14ebf361-7f3d-42cf-9a35-d537e92f1d7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Jun 08 12:23:07.476523 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:07.476477 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-ljn8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Jun 08 12:23:07.477052 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:07.476553 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" podUID="14ebf361-7f3d-42cf-9a35-d537e92f1d7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Jun 08 12:23:08.472658 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:08.472623 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-ljn8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body= Jun 08 12:23:08.472872 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:08.472677 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" podUID="14ebf361-7f3d-42cf-9a35-d537e92f1d7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" Jun 08 12:23:09.475755 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:09.475719 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:23:09.476213 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:09.476198 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:23:09.476916 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:09.476896 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-ljn8h" Jun 08 12:23:45.670235 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:45.670197 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76b5588f6c-s78zt"] Jun 08 12:23:45.670679 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:45.670623 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0c0566a-0e94-4d43-9811-0beed080efe1" containerName="authorino" Jun 08 12:23:45.670679 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:45.670635 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0c0566a-0e94-4d43-9811-0beed080efe1" containerName="authorino" Jun 08 12:23:45.670679 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:45.670654 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f67a3d41-fddd-4b2b-b4f4-a74b591da475" containerName="authorino" Jun 08 12:23:45.670679 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:45.670659 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f67a3d41-fddd-4b2b-b4f4-a74b591da475" containerName="authorino" Jun 08 12:23:45.670873 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:45.670718 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f67a3d41-fddd-4b2b-b4f4-a74b591da475" containerName="authorino" Jun 08 12:23:45.670873 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:45.670729 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0c0566a-0e94-4d43-9811-0beed080efe1" containerName="authorino" Jun 08 12:23:45.673861 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:45.673837 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76b5588f6c-s78zt" Jun 08 12:23:45.678050 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:45.678030 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ll99m\"" Jun 08 12:23:45.678277 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:45.678260 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 08 12:23:45.678277 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:45.678269 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 08 12:23:45.686133 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:45.686111 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76b5588f6c-s78zt"] Jun 08 12:23:45.820437 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:45.820397 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v7qw\" (UniqueName: \"kubernetes.io/projected/2ebfa5b9-5ef2-4557-909c-492616e03d2b-kube-api-access-4v7qw\") pod \"authorino-76b5588f6c-s78zt\" (UID: \"2ebfa5b9-5ef2-4557-909c-492616e03d2b\") " pod="kuadrant-system/authorino-76b5588f6c-s78zt" Jun 08 12:23:45.820597 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:45.820461 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2ebfa5b9-5ef2-4557-909c-492616e03d2b-oidc-ca\") pod \"authorino-76b5588f6c-s78zt\" (UID: \"2ebfa5b9-5ef2-4557-909c-492616e03d2b\") " pod="kuadrant-system/authorino-76b5588f6c-s78zt" Jun 08 12:23:45.820597 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:45.820546 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2ebfa5b9-5ef2-4557-909c-492616e03d2b-tls-cert\") pod \"authorino-76b5588f6c-s78zt\" (UID: \"2ebfa5b9-5ef2-4557-909c-492616e03d2b\") " pod="kuadrant-system/authorino-76b5588f6c-s78zt" Jun 08 12:23:45.922018 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:45.921936 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2ebfa5b9-5ef2-4557-909c-492616e03d2b-tls-cert\") pod \"authorino-76b5588f6c-s78zt\" (UID: \"2ebfa5b9-5ef2-4557-909c-492616e03d2b\") " pod="kuadrant-system/authorino-76b5588f6c-s78zt" Jun 08 12:23:45.922174 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:45.922050 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v7qw\" (UniqueName: \"kubernetes.io/projected/2ebfa5b9-5ef2-4557-909c-492616e03d2b-kube-api-access-4v7qw\") pod \"authorino-76b5588f6c-s78zt\" (UID: \"2ebfa5b9-5ef2-4557-909c-492616e03d2b\") " pod="kuadrant-system/authorino-76b5588f6c-s78zt" Jun 08 12:23:45.922174 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:45.922121 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2ebfa5b9-5ef2-4557-909c-492616e03d2b-oidc-ca\") pod \"authorino-76b5588f6c-s78zt\" (UID: \"2ebfa5b9-5ef2-4557-909c-492616e03d2b\") " pod="kuadrant-system/authorino-76b5588f6c-s78zt" Jun 08 12:23:45.922703 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:45.922680 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2ebfa5b9-5ef2-4557-909c-492616e03d2b-oidc-ca\") pod \"authorino-76b5588f6c-s78zt\" (UID: \"2ebfa5b9-5ef2-4557-909c-492616e03d2b\") " pod="kuadrant-system/authorino-76b5588f6c-s78zt" Jun 08 12:23:45.924371 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:45.924351 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2ebfa5b9-5ef2-4557-909c-492616e03d2b-tls-cert\") pod \"authorino-76b5588f6c-s78zt\" (UID: \"2ebfa5b9-5ef2-4557-909c-492616e03d2b\") " pod="kuadrant-system/authorino-76b5588f6c-s78zt" Jun 08 12:23:45.931921 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:45.931900 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v7qw\" (UniqueName: \"kubernetes.io/projected/2ebfa5b9-5ef2-4557-909c-492616e03d2b-kube-api-access-4v7qw\") pod \"authorino-76b5588f6c-s78zt\" (UID: \"2ebfa5b9-5ef2-4557-909c-492616e03d2b\") " pod="kuadrant-system/authorino-76b5588f6c-s78zt" Jun 08 12:23:45.983699 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:45.983676 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76b5588f6c-s78zt" Jun 08 12:23:46.121879 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:46.121851 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76b5588f6c-s78zt"] Jun 08 12:23:46.122955 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:23:46.122930 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ebfa5b9_5ef2_4557_909c_492616e03d2b.slice/crio-ec79b6bf5e6263256d343108e13803d1e888519a70372554a35f4c9f667eb9b7 WatchSource:0}: Error finding container ec79b6bf5e6263256d343108e13803d1e888519a70372554a35f4c9f667eb9b7: Status 404 returned error can't find the container with id ec79b6bf5e6263256d343108e13803d1e888519a70372554a35f4c9f667eb9b7 Jun 08 12:23:46.710346 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:46.710258 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76b5588f6c-s78zt" event={"ID":"2ebfa5b9-5ef2-4557-909c-492616e03d2b","Type":"ContainerStarted","Data":"4d07598aed085462a02345c705518c1d7682893b3b50104706604d6eb6936864"} Jun 08 12:23:46.710346 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:46.710303 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76b5588f6c-s78zt" event={"ID":"2ebfa5b9-5ef2-4557-909c-492616e03d2b","Type":"ContainerStarted","Data":"ec79b6bf5e6263256d343108e13803d1e888519a70372554a35f4c9f667eb9b7"} Jun 08 12:23:46.732875 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:46.732795 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-76b5588f6c-s78zt" podStartSLOduration=1.397343595 podStartE2EDuration="1.732780201s" totalImagesPullingTime="335.436606ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:23:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:23:46.730727533 +0000 UTC m=+854.846545670" watchObservedRunningTime="2026-06-08 12:23:46.732780201 +0000 UTC m=+854.848598339" Jun 08 12:23:46.890070 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:46.890030 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:23:48.844762 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:23:48.844723 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:24:03.337200 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:03.337155 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:24:09.313710 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.313672 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d"] Jun 08 12:24:09.317858 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.317836 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:09.320618 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.320599 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wj8pd\"" Jun 08 12:24:09.320918 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.320904 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 08 12:24:09.322000 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.321981 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 08 12:24:09.322082 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.321992 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 08 12:24:09.333701 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.333676 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d"] Jun 08 12:24:09.358749 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.358716 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:24:09.442808 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.442779 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2eed1c2-894c-4f42-b866-93ec0b5a0752-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jpn4d\" (UID: \"c2eed1c2-894c-4f42-b866-93ec0b5a0752\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:09.443001 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.442870 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2eed1c2-894c-4f42-b866-93ec0b5a0752-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jpn4d\" (UID: \"c2eed1c2-894c-4f42-b866-93ec0b5a0752\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:09.443001 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.442912 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddjzw\" (UniqueName: \"kubernetes.io/projected/c2eed1c2-894c-4f42-b866-93ec0b5a0752-kube-api-access-ddjzw\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jpn4d\" (UID: \"c2eed1c2-894c-4f42-b866-93ec0b5a0752\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:09.443001 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.442956 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2eed1c2-894c-4f42-b866-93ec0b5a0752-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jpn4d\" (UID: \"c2eed1c2-894c-4f42-b866-93ec0b5a0752\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:09.443001 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.442994 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2eed1c2-894c-4f42-b866-93ec0b5a0752-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jpn4d\" (UID: \"c2eed1c2-894c-4f42-b866-93ec0b5a0752\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:09.443175 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.443060 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c2eed1c2-894c-4f42-b866-93ec0b5a0752-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jpn4d\" (UID: \"c2eed1c2-894c-4f42-b866-93ec0b5a0752\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:09.544245 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.544213 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2eed1c2-894c-4f42-b866-93ec0b5a0752-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jpn4d\" (UID: \"c2eed1c2-894c-4f42-b866-93ec0b5a0752\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:09.544387 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.544257 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2eed1c2-894c-4f42-b866-93ec0b5a0752-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jpn4d\" (UID: \"c2eed1c2-894c-4f42-b866-93ec0b5a0752\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:09.544387 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.544370 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddjzw\" (UniqueName: \"kubernetes.io/projected/c2eed1c2-894c-4f42-b866-93ec0b5a0752-kube-api-access-ddjzw\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jpn4d\" (UID: \"c2eed1c2-894c-4f42-b866-93ec0b5a0752\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:09.544465 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.544411 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2eed1c2-894c-4f42-b866-93ec0b5a0752-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jpn4d\" (UID: \"c2eed1c2-894c-4f42-b866-93ec0b5a0752\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:09.544465 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.544451 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2eed1c2-894c-4f42-b866-93ec0b5a0752-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jpn4d\" (UID: \"c2eed1c2-894c-4f42-b866-93ec0b5a0752\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:09.544554 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.544489 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c2eed1c2-894c-4f42-b866-93ec0b5a0752-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jpn4d\" (UID: \"c2eed1c2-894c-4f42-b866-93ec0b5a0752\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:09.544608 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.544589 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2eed1c2-894c-4f42-b866-93ec0b5a0752-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jpn4d\" (UID: \"c2eed1c2-894c-4f42-b866-93ec0b5a0752\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:09.544860 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.544837 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c2eed1c2-894c-4f42-b866-93ec0b5a0752-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jpn4d\" (UID: \"c2eed1c2-894c-4f42-b866-93ec0b5a0752\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:09.544974 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.544880 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2eed1c2-894c-4f42-b866-93ec0b5a0752-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jpn4d\" (UID: \"c2eed1c2-894c-4f42-b866-93ec0b5a0752\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:09.546630 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.546606 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2eed1c2-894c-4f42-b866-93ec0b5a0752-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jpn4d\" (UID: \"c2eed1c2-894c-4f42-b866-93ec0b5a0752\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:09.546872 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.546857 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2eed1c2-894c-4f42-b866-93ec0b5a0752-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jpn4d\" (UID: \"c2eed1c2-894c-4f42-b866-93ec0b5a0752\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:09.553654 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.553636 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddjzw\" (UniqueName: \"kubernetes.io/projected/c2eed1c2-894c-4f42-b866-93ec0b5a0752-kube-api-access-ddjzw\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-jpn4d\" (UID: \"c2eed1c2-894c-4f42-b866-93ec0b5a0752\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:09.663670 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.663644 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:09.808099 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.808076 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d"] Jun 08 12:24:09.809575 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:24:09.809548 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2eed1c2_894c_4f42_b866_93ec0b5a0752.slice/crio-179f797a7bdb72357b52d53904bf832cee416e029cdc3663fa73d646d20e19c7 WatchSource:0}: Error finding container 179f797a7bdb72357b52d53904bf832cee416e029cdc3663fa73d646d20e19c7: Status 404 returned error can't find the container with id 179f797a7bdb72357b52d53904bf832cee416e029cdc3663fa73d646d20e19c7 Jun 08 12:24:09.859120 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:09.859094 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" event={"ID":"c2eed1c2-894c-4f42-b866-93ec0b5a0752","Type":"ContainerStarted","Data":"179f797a7bdb72357b52d53904bf832cee416e029cdc3663fa73d646d20e19c7"} Jun 08 12:24:13.886063 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:13.885981 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" event={"ID":"c2eed1c2-894c-4f42-b866-93ec0b5a0752","Type":"ContainerStarted","Data":"8a79b44393d343729c9b8528ef703d8a552e438d869158e3bf63d0fe76875244"} Jun 08 12:24:14.191184 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:14.191093 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:24:14.895581 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:14.894011 2565 generic.go:356] "Generic (PLEG): container finished" podID="c2eed1c2-894c-4f42-b866-93ec0b5a0752" containerID="8a79b44393d343729c9b8528ef703d8a552e438d869158e3bf63d0fe76875244" exitCode=0 Jun 08 12:24:14.895581 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:14.894225 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" event={"ID":"c2eed1c2-894c-4f42-b866-93ec0b5a0752","Type":"ContainerDied","Data":"8a79b44393d343729c9b8528ef703d8a552e438d869158e3bf63d0fe76875244"} Jun 08 12:24:19.927490 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:19.927450 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" event={"ID":"c2eed1c2-894c-4f42-b866-93ec0b5a0752","Type":"ContainerStarted","Data":"ab8282a2fa4e3e0c3f65ab7f61eb895704b80a73ed628a7f7ff76a82df1ea646"} Jun 08 12:24:19.958605 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:19.958557 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" podStartSLOduration=2.399204289 podStartE2EDuration="10.95854246s" totalImagesPullingTime="7.269551876s" totalInitContainerRuntime="1.289786295s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:24:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:24:19.95542986 +0000 UTC m=+888.071247997" watchObservedRunningTime="2026-06-08 12:24:19.95854246 +0000 UTC m=+888.074360597" Jun 08 12:24:27.842594 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:27.842549 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:24:29.664802 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:29.664763 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:29.665282 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:29.664876 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:29.677599 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:29.677569 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:30.001960 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:30.001881 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-jpn4d" Jun 08 12:24:32.543503 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:32.543473 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/2.log" Jun 08 12:24:32.544003 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:32.543983 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/2.log" Jun 08 12:24:32.548936 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:32.548913 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwxhk_1aa340eb-58d2-4e29-9cbd-4f1b831abf58/ovn-acl-logging/0.log" Jun 08 12:24:32.549808 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:32.549790 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwxhk_1aa340eb-58d2-4e29-9cbd-4f1b831abf58/ovn-acl-logging/0.log" Jun 08 12:24:39.345287 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:39.345247 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:24:51.020935 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:24:51.020898 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:25:32.805415 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:32.805371 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:25:39.954925 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:39.954892 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b68897b4b-d5bv2"] Jun 08 12:25:39.958544 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:39.958526 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b68897b4b-d5bv2" Jun 08 12:25:39.969703 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:39.969680 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b68897b4b-d5bv2"] Jun 08 12:25:40.101298 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:40.101262 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4864f666-4622-49c4-878a-f05699a738d0-tls-cert\") pod \"authorino-b68897b4b-d5bv2\" (UID: \"4864f666-4622-49c4-878a-f05699a738d0\") " pod="kuadrant-system/authorino-b68897b4b-d5bv2" Jun 08 12:25:40.101298 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:40.101303 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4d29\" (UniqueName: \"kubernetes.io/projected/4864f666-4622-49c4-878a-f05699a738d0-kube-api-access-j4d29\") pod \"authorino-b68897b4b-d5bv2\" (UID: \"4864f666-4622-49c4-878a-f05699a738d0\") " pod="kuadrant-system/authorino-b68897b4b-d5bv2" Jun 08 12:25:40.101513 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:40.101437 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4864f666-4622-49c4-878a-f05699a738d0-oidc-ca\") pod \"authorino-b68897b4b-d5bv2\" (UID: \"4864f666-4622-49c4-878a-f05699a738d0\") " pod="kuadrant-system/authorino-b68897b4b-d5bv2" Jun 08 12:25:40.202325 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:40.202290 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4864f666-4622-49c4-878a-f05699a738d0-oidc-ca\") pod \"authorino-b68897b4b-d5bv2\" (UID: \"4864f666-4622-49c4-878a-f05699a738d0\") " pod="kuadrant-system/authorino-b68897b4b-d5bv2" Jun 08 12:25:40.202512 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:40.202391 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4864f666-4622-49c4-878a-f05699a738d0-tls-cert\") pod \"authorino-b68897b4b-d5bv2\" (UID: \"4864f666-4622-49c4-878a-f05699a738d0\") " pod="kuadrant-system/authorino-b68897b4b-d5bv2" Jun 08 12:25:40.202512 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:40.202422 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4d29\" (UniqueName: \"kubernetes.io/projected/4864f666-4622-49c4-878a-f05699a738d0-kube-api-access-j4d29\") pod \"authorino-b68897b4b-d5bv2\" (UID: \"4864f666-4622-49c4-878a-f05699a738d0\") " pod="kuadrant-system/authorino-b68897b4b-d5bv2" Jun 08 12:25:40.202993 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:40.202973 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4864f666-4622-49c4-878a-f05699a738d0-oidc-ca\") pod \"authorino-b68897b4b-d5bv2\" (UID: \"4864f666-4622-49c4-878a-f05699a738d0\") " pod="kuadrant-system/authorino-b68897b4b-d5bv2" Jun 08 12:25:40.205179 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:40.205119 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4864f666-4622-49c4-878a-f05699a738d0-tls-cert\") pod \"authorino-b68897b4b-d5bv2\" (UID: \"4864f666-4622-49c4-878a-f05699a738d0\") " pod="kuadrant-system/authorino-b68897b4b-d5bv2" Jun 08 12:25:40.218630 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:40.218606 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4d29\" (UniqueName: \"kubernetes.io/projected/4864f666-4622-49c4-878a-f05699a738d0-kube-api-access-j4d29\") pod \"authorino-b68897b4b-d5bv2\" (UID: \"4864f666-4622-49c4-878a-f05699a738d0\") " pod="kuadrant-system/authorino-b68897b4b-d5bv2" Jun 08 12:25:40.244480 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:40.244450 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:25:40.267992 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:40.267965 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b68897b4b-d5bv2" Jun 08 12:25:40.346588 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:40.346558 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:25:40.424233 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:40.424203 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b68897b4b-d5bv2"] Jun 08 12:25:40.424499 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:25:40.424464 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4864f666_4622_49c4_878a_f05699a738d0.slice/crio-bb106e3caf3ad507f590d843de938fe99788b59fef7b0a6f8c0a8a2a58fbcac4 WatchSource:0}: Error finding container bb106e3caf3ad507f590d843de938fe99788b59fef7b0a6f8c0a8a2a58fbcac4: Status 404 returned error can't find the container with id bb106e3caf3ad507f590d843de938fe99788b59fef7b0a6f8c0a8a2a58fbcac4 Jun 08 12:25:41.393883 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:41.393842 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:25:41.436540 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:41.436505 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b68897b4b-d5bv2" event={"ID":"4864f666-4622-49c4-878a-f05699a738d0","Type":"ContainerStarted","Data":"1413ce0f95b65a7d7c496f60d3de5499352df5d1ad75b2c32111036811f41dd8"} Jun 08 12:25:41.436728 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:41.436553 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b68897b4b-d5bv2" event={"ID":"4864f666-4622-49c4-878a-f05699a738d0","Type":"ContainerStarted","Data":"bb106e3caf3ad507f590d843de938fe99788b59fef7b0a6f8c0a8a2a58fbcac4"} Jun 08 12:25:41.458255 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:41.458207 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b68897b4b-d5bv2" podStartSLOduration=1.90200894 podStartE2EDuration="2.458191823s" totalImagesPullingTime="556.182883ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:25:41.455500596 +0000 UTC m=+969.571318735" watchObservedRunningTime="2026-06-08 12:25:41.458191823 +0000 UTC m=+969.574009960" Jun 08 12:25:41.509515 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:41.509474 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76b5588f6c-s78zt"] Jun 08 12:25:41.509710 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:41.509664 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-76b5588f6c-s78zt" podUID="2ebfa5b9-5ef2-4557-909c-492616e03d2b" containerName="authorino" containerID="cri-o://4d07598aed085462a02345c705518c1d7682893b3b50104706604d6eb6936864" gracePeriod=30 Jun 08 12:25:41.531948 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:41.531383 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:25:41.787548 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:41.787519 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76b5588f6c-s78zt" Jun 08 12:25:41.922535 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:41.922501 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2ebfa5b9-5ef2-4557-909c-492616e03d2b-tls-cert\") pod \"2ebfa5b9-5ef2-4557-909c-492616e03d2b\" (UID: \"2ebfa5b9-5ef2-4557-909c-492616e03d2b\") " Jun 08 12:25:41.922705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:41.922565 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2ebfa5b9-5ef2-4557-909c-492616e03d2b-oidc-ca\") pod \"2ebfa5b9-5ef2-4557-909c-492616e03d2b\" (UID: \"2ebfa5b9-5ef2-4557-909c-492616e03d2b\") " Jun 08 12:25:41.922705 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:41.922601 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v7qw\" (UniqueName: \"kubernetes.io/projected/2ebfa5b9-5ef2-4557-909c-492616e03d2b-kube-api-access-4v7qw\") pod \"2ebfa5b9-5ef2-4557-909c-492616e03d2b\" (UID: \"2ebfa5b9-5ef2-4557-909c-492616e03d2b\") " Jun 08 12:25:41.924784 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:41.924754 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ebfa5b9-5ef2-4557-909c-492616e03d2b-kube-api-access-4v7qw" (OuterVolumeSpecName: "kube-api-access-4v7qw") pod "2ebfa5b9-5ef2-4557-909c-492616e03d2b" (UID: "2ebfa5b9-5ef2-4557-909c-492616e03d2b"). InnerVolumeSpecName "kube-api-access-4v7qw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 12:25:41.929750 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:41.929722 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ebfa5b9-5ef2-4557-909c-492616e03d2b-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "2ebfa5b9-5ef2-4557-909c-492616e03d2b" (UID: "2ebfa5b9-5ef2-4557-909c-492616e03d2b"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 12:25:41.939740 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:41.939713 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ebfa5b9-5ef2-4557-909c-492616e03d2b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "2ebfa5b9-5ef2-4557-909c-492616e03d2b" (UID: "2ebfa5b9-5ef2-4557-909c-492616e03d2b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 12:25:42.024048 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:42.024010 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4v7qw\" (UniqueName: \"kubernetes.io/projected/2ebfa5b9-5ef2-4557-909c-492616e03d2b-kube-api-access-4v7qw\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:25:42.024048 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:42.024043 2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2ebfa5b9-5ef2-4557-909c-492616e03d2b-tls-cert\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:25:42.024048 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:42.024053 2565 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2ebfa5b9-5ef2-4557-909c-492616e03d2b-oidc-ca\") on node \"ip-10-0-137-94.ec2.internal\" DevicePath \"\"" Jun 08 12:25:42.444104 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:42.444064 2565 generic.go:356] "Generic (PLEG): container finished" podID="2ebfa5b9-5ef2-4557-909c-492616e03d2b" containerID="4d07598aed085462a02345c705518c1d7682893b3b50104706604d6eb6936864" exitCode=0 Jun 08 12:25:42.444104 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:42.444104 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76b5588f6c-s78zt" Jun 08 12:25:42.444538 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:42.444143 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76b5588f6c-s78zt" event={"ID":"2ebfa5b9-5ef2-4557-909c-492616e03d2b","Type":"ContainerDied","Data":"4d07598aed085462a02345c705518c1d7682893b3b50104706604d6eb6936864"} Jun 08 12:25:42.444538 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:42.444184 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76b5588f6c-s78zt" event={"ID":"2ebfa5b9-5ef2-4557-909c-492616e03d2b","Type":"ContainerDied","Data":"ec79b6bf5e6263256d343108e13803d1e888519a70372554a35f4c9f667eb9b7"} Jun 08 12:25:42.444538 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:42.444200 2565 scope.go:117] "RemoveContainer" containerID="4d07598aed085462a02345c705518c1d7682893b3b50104706604d6eb6936864" Jun 08 12:25:42.453969 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:42.453951 2565 scope.go:117] "RemoveContainer" containerID="4d07598aed085462a02345c705518c1d7682893b3b50104706604d6eb6936864" Jun 08 12:25:42.454213 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:25:42.454194 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d07598aed085462a02345c705518c1d7682893b3b50104706604d6eb6936864\": container with ID starting with 4d07598aed085462a02345c705518c1d7682893b3b50104706604d6eb6936864 not found: ID does not exist" containerID="4d07598aed085462a02345c705518c1d7682893b3b50104706604d6eb6936864" Jun 08 12:25:42.454281 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:42.454225 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d07598aed085462a02345c705518c1d7682893b3b50104706604d6eb6936864"} err="failed to get container status \"4d07598aed085462a02345c705518c1d7682893b3b50104706604d6eb6936864\": rpc error: code = NotFound desc = could not find container \"4d07598aed085462a02345c705518c1d7682893b3b50104706604d6eb6936864\": container with ID starting with 4d07598aed085462a02345c705518c1d7682893b3b50104706604d6eb6936864 not found: ID does not exist" Jun 08 12:25:42.468630 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:42.468569 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76b5588f6c-s78zt"] Jun 08 12:25:42.474900 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:42.474881 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76b5588f6c-s78zt"] Jun 08 12:25:44.348581 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:25:44.348505 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ebfa5b9-5ef2-4557-909c-492616e03d2b" path="/var/lib/kubelet/pods/2ebfa5b9-5ef2-4557-909c-492616e03d2b/volumes" Jun 08 12:26:15.230859 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:26:15.230796 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:26:23.633588 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:26:23.633531 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:26:25.081046 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:26:25.081011 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:26:32.092113 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:26:32.092058 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:27:09.567340 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:27:09.567305 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:27:10.800061 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:27:10.800028 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:27:22.718046 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:27:22.717958 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:27:50.689606 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:27:50.689565 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:27:50.780600 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:27:50.780569 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:27:50.902299 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:27:50.902263 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:27:51.507560 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:27:51.507517 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:27:51.610858 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:27:51.610791 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:27:59.209801 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:27:59.209759 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:28:06.574747 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:28:06.574712 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:28:06.660444 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:28:06.660409 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:28:38.698247 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:28:38.698215 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:28:38.796022 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:28:38.795984 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:28:38.931213 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:28:38.931180 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:28:39.473673 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:28:39.473642 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:28:39.574577 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:28:39.574532 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:29:02.694218 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:29:02.694178 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:29:08.956051 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:29:08.956009 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:29:09.097851 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:29:09.097804 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:29:09.188658 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:29:09.188617 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:29:09.321498 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:29:09.321407 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:29:09.428347 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:29:09.428305 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:29:25.857478 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:29:25.857446 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:29:25.977608 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:29:25.977569 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:29:26.088335 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:29:26.088296 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:29:32.511317 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:29:32.511276 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:29:32.586888 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:29:32.586857 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/2.log" Jun 08 12:29:32.590117 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:29:32.590093 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/2.log" Jun 08 12:29:32.592517 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:29:32.592495 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwxhk_1aa340eb-58d2-4e29-9cbd-4f1b831abf58/ovn-acl-logging/0.log" Jun 08 12:29:32.595520 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:29:32.595502 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwxhk_1aa340eb-58d2-4e29-9cbd-4f1b831abf58/ovn-acl-logging/0.log" Jun 08 12:29:32.612674 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:29:32.612649 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:29:40.686835 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:29:40.686789 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:29:40.791255 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:29:40.791223 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:29:40.899639 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:29:40.899603 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:29:40.992919 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:29:40.992832 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:29:57.409157 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:29:57.409117 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:29:57.514712 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:29:57.514673 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:29:57.627431 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:29:57.627393 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:30:04.558302 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:30:04.558264 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:30:04.641424 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:30:04.641383 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:30:27.169127 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:30:27.169035 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:30:27.272219 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:30:27.272189 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:30:27.384212 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:30:27.384172 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:30:33.935414 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:30:33.935373 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:30:34.040643 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:30:34.040605 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:30:34.146956 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:30:34.146915 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:30:34.245293 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:30:34.245211 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:30:34.380966 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:30:34.380929 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:30:40.590117 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:30:40.590072 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:30:40.667959 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:30:40.667930 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:30:49.224398 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:30:49.224357 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:32:31.864227 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:32:31.864185 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:32:32.309354 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:32:32.309320 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:32:32.409411 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:32:32.409373 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:32:52.216598 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:32:52.216559 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:32:52.286515 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:32:52.286471 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:33:43.391691 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:33:43.391601 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:34:32.658577 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:34:32.658546 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/2.log" Jun 08 12:34:32.659947 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:34:32.659922 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/2.log" Jun 08 12:34:32.664910 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:34:32.664888 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwxhk_1aa340eb-58d2-4e29-9cbd-4f1b831abf58/ovn-acl-logging/0.log" Jun 08 12:34:32.666105 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:34:32.666080 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwxhk_1aa340eb-58d2-4e29-9cbd-4f1b831abf58/ovn-acl-logging/0.log" Jun 08 12:38:06.481873 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:38:06.481798 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:39:10.431884 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:39:10.431843 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:39:17.441265 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:39:17.441152 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:39:17.546783 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:39:17.546743 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:39:32.706564 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:39:32.706535 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/2.log" Jun 08 12:39:32.709531 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:39:32.709505 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/2.log" Jun 08 12:39:32.712222 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:39:32.712206 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwxhk_1aa340eb-58d2-4e29-9cbd-4f1b831abf58/ovn-acl-logging/0.log" Jun 08 12:39:32.714402 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:39:32.714383 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwxhk_1aa340eb-58d2-4e29-9cbd-4f1b831abf58/ovn-acl-logging/0.log" Jun 08 12:43:16.802917 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:43:16.802880 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:44:32.751287 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:44:32.751256 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/2.log" Jun 08 12:44:32.754670 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:44:32.754646 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/2.log" Jun 08 12:44:32.756986 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:44:32.756955 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwxhk_1aa340eb-58d2-4e29-9cbd-4f1b831abf58/ovn-acl-logging/0.log" Jun 08 12:44:32.760340 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:44:32.760319 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwxhk_1aa340eb-58d2-4e29-9cbd-4f1b831abf58/ovn-acl-logging/0.log" Jun 08 12:45:12.846393 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:45:12.846352 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:45:12.924164 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:45:12.924134 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:47:38.022931 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:47:38.022886 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:47:45.470434 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:47:45.470379 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:47:59.131661 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:47:59.131626 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:09.732407 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:09.732368 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:22.805178 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:22.805087 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:24.414125 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:24.414060 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:24.476534 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:24.476498 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:24.626469 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:24.626428 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:24.725047 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:24.724951 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:24.760983 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:24.760948 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792"] Jun 08 12:48:24.761418 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:24.761405 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ebfa5b9-5ef2-4557-909c-492616e03d2b" containerName="authorino" Jun 08 12:48:24.761462 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:24.761420 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ebfa5b9-5ef2-4557-909c-492616e03d2b" containerName="authorino" Jun 08 12:48:24.761514 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:24.761506 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ebfa5b9-5ef2-4557-909c-492616e03d2b" containerName="authorino" Jun 08 12:48:24.764799 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:24.764783 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" Jun 08 12:48:24.767964 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:24.767944 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jun 08 12:48:24.769150 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:24.769107 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-5pztg\"" Jun 08 12:48:24.778079 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:24.778056 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792"] Jun 08 12:48:24.856311 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:24.856283 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:24.884540 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:24.884503 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6494\" (UniqueName: \"kubernetes.io/projected/fa3315fa-3910-4d64-ae58-d4e350ae7a96-kube-api-access-g6494\") pod \"maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792\" (UID: \"fa3315fa-3910-4d64-ae58-d4e350ae7a96\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" Jun 08 12:48:24.884680 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:24.884648 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa3315fa-3910-4d64-ae58-d4e350ae7a96-maas-api-tls\") pod \"maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792\" (UID: \"fa3315fa-3910-4d64-ae58-d4e350ae7a96\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" Jun 08 12:48:24.946060 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:24.946016 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:24.986265 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:24.986190 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6494\" (UniqueName: \"kubernetes.io/projected/fa3315fa-3910-4d64-ae58-d4e350ae7a96-kube-api-access-g6494\") pod \"maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792\" (UID: \"fa3315fa-3910-4d64-ae58-d4e350ae7a96\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" Jun 08 12:48:24.986385 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:24.986262 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa3315fa-3910-4d64-ae58-d4e350ae7a96-maas-api-tls\") pod \"maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792\" (UID: \"fa3315fa-3910-4d64-ae58-d4e350ae7a96\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" Jun 08 12:48:24.988827 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:24.988787 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa3315fa-3910-4d64-ae58-d4e350ae7a96-maas-api-tls\") pod \"maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792\" (UID: \"fa3315fa-3910-4d64-ae58-d4e350ae7a96\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" Jun 08 12:48:24.994383 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:24.994362 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6494\" (UniqueName: \"kubernetes.io/projected/fa3315fa-3910-4d64-ae58-d4e350ae7a96-kube-api-access-g6494\") pod \"maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792\" (UID: \"fa3315fa-3910-4d64-ae58-d4e350ae7a96\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" Jun 08 12:48:25.078183 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:25.078153 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" Jun 08 12:48:25.181484 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:25.181416 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:25.221235 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:25.221197 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792"] Jun 08 12:48:25.223029 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:48:25.223003 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa3315fa_3910_4d64_ae58_d4e350ae7a96.slice/crio-ba19e77a7d9926467f05144bae735a67c46a1e5e236819310688d7d3662fc92b WatchSource:0}: Error finding container ba19e77a7d9926467f05144bae735a67c46a1e5e236819310688d7d3662fc92b: Status 404 returned error can't find the container with id ba19e77a7d9926467f05144bae735a67c46a1e5e236819310688d7d3662fc92b Jun 08 12:48:25.224870 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:25.224848 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 12:48:25.368917 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:25.368833 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:25.469595 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:25.469561 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:25.571568 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:25.571534 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:25.784747 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:25.784709 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" event={"ID":"fa3315fa-3910-4d64-ae58-d4e350ae7a96","Type":"ContainerStarted","Data":"ba19e77a7d9926467f05144bae735a67c46a1e5e236819310688d7d3662fc92b"} Jun 08 12:48:25.817532 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:25.817489 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:26.446361 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:26.446241 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:26.957605 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:26.957531 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:27.787498 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:27.787395 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:27.799077 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:27.799045 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" event={"ID":"fa3315fa-3910-4d64-ae58-d4e350ae7a96","Type":"ContainerStarted","Data":"c6880f6368139f16c67efc86b431d0ec083084511410bdd0a4fd9867d318938a"} Jun 08 12:48:27.799225 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:27.799171 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" Jun 08 12:48:27.818163 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:27.818117 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" podStartSLOduration=1.5501013829999999 podStartE2EDuration="3.81810375s" totalImagesPullingTime="2.268002367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:48:27.816624102 +0000 UTC m=+2335.932442241" watchObservedRunningTime="2026-06-08 12:48:27.81810375 +0000 UTC m=+2335.933921887" Jun 08 12:48:28.380980 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:28.380936 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:28.477160 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:28.477125 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:28.807448 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:28.807416 2565 generic.go:356] "Generic (PLEG): container finished" podID="fa3315fa-3910-4d64-ae58-d4e350ae7a96" containerID="c6880f6368139f16c67efc86b431d0ec083084511410bdd0a4fd9867d318938a" exitCode=1 Jun 08 12:48:28.807616 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:28.807501 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" event={"ID":"fa3315fa-3910-4d64-ae58-d4e350ae7a96","Type":"ContainerDied","Data":"c6880f6368139f16c67efc86b431d0ec083084511410bdd0a4fd9867d318938a"} Jun 08 12:48:28.807730 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:28.807716 2565 scope.go:117] "RemoveContainer" containerID="c6880f6368139f16c67efc86b431d0ec083084511410bdd0a4fd9867d318938a" Jun 08 12:48:29.815774 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:29.815699 2565 generic.go:356] "Generic (PLEG): container finished" podID="fa3315fa-3910-4d64-ae58-d4e350ae7a96" containerID="3a97522961214434cf2eda4563b5e1b7acda26af48a80338825bb6e4346f4b05" exitCode=1 Jun 08 12:48:29.816193 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:29.815788 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" event={"ID":"fa3315fa-3910-4d64-ae58-d4e350ae7a96","Type":"ContainerDied","Data":"3a97522961214434cf2eda4563b5e1b7acda26af48a80338825bb6e4346f4b05"} Jun 08 12:48:29.816193 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:29.815867 2565 scope.go:117] "RemoveContainer" containerID="c6880f6368139f16c67efc86b431d0ec083084511410bdd0a4fd9867d318938a" Jun 08 12:48:29.816193 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:29.815967 2565 scope.go:117] "RemoveContainer" containerID="3a97522961214434cf2eda4563b5e1b7acda26af48a80338825bb6e4346f4b05" Jun 08 12:48:29.816325 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:48:29.816207 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792_redhat-ai-gateway-infra(fa3315fa-3910-4d64-ae58-d4e350ae7a96)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" podUID="fa3315fa-3910-4d64-ae58-d4e350ae7a96" Jun 08 12:48:29.844556 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:29.844529 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:30.178724 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:30.178686 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:30.715490 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:30.715455 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:30.824904 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:30.824870 2565 scope.go:117] "RemoveContainer" containerID="3a97522961214434cf2eda4563b5e1b7acda26af48a80338825bb6e4346f4b05" Jun 08 12:48:30.825250 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:48:30.825072 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792_redhat-ai-gateway-infra(fa3315fa-3910-4d64-ae58-d4e350ae7a96)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" podUID="fa3315fa-3910-4d64-ae58-d4e350ae7a96" Jun 08 12:48:30.875328 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:30.875287 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:30.976250 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:30.976154 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:32.138172 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:32.138122 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:32.800167 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:32.800123 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" Jun 08 12:48:32.800519 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:32.800506 2565 scope.go:117] "RemoveContainer" containerID="3a97522961214434cf2eda4563b5e1b7acda26af48a80338825bb6e4346f4b05" Jun 08 12:48:32.800711 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:48:32.800692 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792_redhat-ai-gateway-infra(fa3315fa-3910-4d64-ae58-d4e350ae7a96)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" podUID="fa3315fa-3910-4d64-ae58-d4e350ae7a96" Jun 08 12:48:35.079338 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:35.079293 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" Jun 08 12:48:35.079719 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:35.079705 2565 scope.go:117] "RemoveContainer" containerID="3a97522961214434cf2eda4563b5e1b7acda26af48a80338825bb6e4346f4b05" Jun 08 12:48:35.079931 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:48:35.079910 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792_redhat-ai-gateway-infra(fa3315fa-3910-4d64-ae58-d4e350ae7a96)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" podUID="fa3315fa-3910-4d64-ae58-d4e350ae7a96" Jun 08 12:48:37.361081 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:37.361039 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:37.425291 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:37.425260 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:37.591587 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:37.591553 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:37.696949 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:37.696909 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:37.792004 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:37.791968 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:38.111443 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:38.111346 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:38.363727 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:38.363630 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:38.657661 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:38.657626 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:38.760703 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:38.760661 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:38.858120 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:38.858085 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:39.532078 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:39.532045 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:40.366795 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:40.366757 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:40.707027 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:40.706994 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:40.970691 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:40.970582 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:41.139826 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:41.139770 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:41.477438 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:41.477403 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:41.734405 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:41.734323 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:42.344517 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:42.344480 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:43.879603 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:43.879559 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:45.107976 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:45.107940 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:45.219205 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:45.219165 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:46.515544 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:46.515506 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:50.342461 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:50.342433 2565 scope.go:117] "RemoveContainer" containerID="3a97522961214434cf2eda4563b5e1b7acda26af48a80338825bb6e4346f4b05" Jun 08 12:48:50.948377 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:50.948297 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" event={"ID":"fa3315fa-3910-4d64-ae58-d4e350ae7a96","Type":"ContainerStarted","Data":"bff39eccf283b6a73a1a394ae49769ea53d994fcd7c58bc9f1d5116be7049a0a"} Jun 08 12:48:50.948530 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:50.948496 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" Jun 08 12:48:51.663799 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:51.663751 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:51.733910 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:51.733871 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:48:51.956625 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:51.956531 2565 generic.go:356] "Generic (PLEG): container finished" podID="fa3315fa-3910-4d64-ae58-d4e350ae7a96" containerID="bff39eccf283b6a73a1a394ae49769ea53d994fcd7c58bc9f1d5116be7049a0a" exitCode=1 Jun 08 12:48:51.956798 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:51.956623 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" event={"ID":"fa3315fa-3910-4d64-ae58-d4e350ae7a96","Type":"ContainerDied","Data":"bff39eccf283b6a73a1a394ae49769ea53d994fcd7c58bc9f1d5116be7049a0a"} Jun 08 12:48:51.956798 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:51.956684 2565 scope.go:117] "RemoveContainer" containerID="3a97522961214434cf2eda4563b5e1b7acda26af48a80338825bb6e4346f4b05" Jun 08 12:48:51.956937 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:51.956912 2565 scope.go:117] "RemoveContainer" containerID="bff39eccf283b6a73a1a394ae49769ea53d994fcd7c58bc9f1d5116be7049a0a" Jun 08 12:48:51.957137 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:48:51.957112 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792_redhat-ai-gateway-infra(fa3315fa-3910-4d64-ae58-d4e350ae7a96)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" podUID="fa3315fa-3910-4d64-ae58-d4e350ae7a96" Jun 08 12:48:52.964368 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:52.964334 2565 scope.go:117] "RemoveContainer" containerID="bff39eccf283b6a73a1a394ae49769ea53d994fcd7c58bc9f1d5116be7049a0a" Jun 08 12:48:52.964747 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:48:52.964527 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792_redhat-ai-gateway-infra(fa3315fa-3910-4d64-ae58-d4e350ae7a96)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" podUID="fa3315fa-3910-4d64-ae58-d4e350ae7a96" Jun 08 12:48:55.078601 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:55.078570 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" Jun 08 12:48:55.078978 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:55.078949 2565 scope.go:117] "RemoveContainer" containerID="bff39eccf283b6a73a1a394ae49769ea53d994fcd7c58bc9f1d5116be7049a0a" Jun 08 12:48:55.079136 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:48:55.079117 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792_redhat-ai-gateway-infra(fa3315fa-3910-4d64-ae58-d4e350ae7a96)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" podUID="fa3315fa-3910-4d64-ae58-d4e350ae7a96" Jun 08 12:48:58.047923 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:48:58.047893 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b68897b4b-d5bv2_4864f666-4622-49c4-878a-f05699a738d0/authorino/0.log" Jun 08 12:49:02.734368 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:02.734339 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-556d9fc7f6-7jqvn_86e21543-6908-4d69-8e77-231dc46b875e/nginx/0.log" Jun 08 12:49:03.196692 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:03.196663 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-4mx5f_d3fbe2d0-11a7-4f4b-9e9c-6d5e6b58e0f6/server/0.log" Jun 08 12:49:03.315770 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:03.315733 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-9b8fm_39f7399a-b977-4b9e-b0c5-b0e67fe1f6fa/manager/0.log" Jun 08 12:49:03.570467 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:03.570381 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6858dfdb94-5pr6n_c456c4dc-1b2d-40a2-962e-45e1a8fb6a01/copy-manifests/0.log" Jun 08 12:49:03.577379 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:03.577350 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6858dfdb94-5pr6n_c456c4dc-1b2d-40a2-962e-45e1a8fb6a01/manager/0.log" Jun 08 12:49:04.471725 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:04.471694 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr_5588aaf5-551b-484d-9766-977650d6b98a/util/0.log" Jun 08 12:49:04.478725 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:04.478699 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr_5588aaf5-551b-484d-9766-977650d6b98a/pull/0.log" Jun 08 12:49:04.485349 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:04.485324 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr_5588aaf5-551b-484d-9766-977650d6b98a/extract/0.log" Jun 08 12:49:04.591280 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:04.591254 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58_097248d3-81fb-4af3-8868-3e4d416cff72/extract/0.log" Jun 08 12:49:04.597402 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:04.597385 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58_097248d3-81fb-4af3-8868-3e4d416cff72/util/0.log" Jun 08 12:49:04.604916 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:04.604899 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58_097248d3-81fb-4af3-8868-3e4d416cff72/pull/0.log" Jun 08 12:49:04.715253 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:04.715231 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8_f167c13a-2d11-49aa-8a89-1610f8861c32/util/0.log" Jun 08 12:49:04.722842 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:04.722744 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8_f167c13a-2d11-49aa-8a89-1610f8861c32/pull/0.log" Jun 08 12:49:04.729771 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:04.729751 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8_f167c13a-2d11-49aa-8a89-1610f8861c32/extract/0.log" Jun 08 12:49:04.841538 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:04.841518 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx_fca9372a-9af8-46f6-8ff1-e08baf379bf5/util/0.log" Jun 08 12:49:04.848420 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:04.848399 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx_fca9372a-9af8-46f6-8ff1-e08baf379bf5/pull/0.log" Jun 08 12:49:04.854944 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:04.854925 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx_fca9372a-9af8-46f6-8ff1-e08baf379bf5/extract/0.log" Jun 08 12:49:04.983104 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:04.983033 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b68897b4b-d5bv2_4864f666-4622-49c4-878a-f05699a738d0/authorino/0.log" Jun 08 12:49:05.111004 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:05.110962 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-g8g5l_78974448-565f-4a7e-8be5-1f1f2f7b8821/manager/0.log" Jun 08 12:49:05.453032 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:05.452998 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lwbj7_57d27191-f6ea-4e98-b267-7d7525e6f0c2/registry-server/0.log" Jun 08 12:49:06.153776 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:06.153743 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bckv4bg_efa6ca32-a146-4cc3-880f-7e11afa17bf1/istio-proxy/0.log" Jun 08 12:49:06.623406 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:06.623379 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-ljn8h_14ebf361-7f3d-42cf-9a35-d537e92f1d7e/istio-proxy/1.log" Jun 08 12:49:06.967949 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:06.967864 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b7fc957f7-d6lvs_d33beb41-9adf-42a6-9888-140d58450017/router/0.log" Jun 08 12:49:07.293675 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:07.293575 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:49:07.342497 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:07.342468 2565 scope.go:117] "RemoveContainer" containerID="bff39eccf283b6a73a1a394ae49769ea53d994fcd7c58bc9f1d5116be7049a0a" Jun 08 12:49:07.342641 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:49:07.342623 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792_redhat-ai-gateway-infra(fa3315fa-3910-4d64-ae58-d4e350ae7a96)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" podUID="fa3315fa-3910-4d64-ae58-d4e350ae7a96" Jun 08 12:49:07.432700 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:07.432671 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-jpn4d_c2eed1c2-894c-4f42-b866-93ec0b5a0752/main/0.log" Jun 08 12:49:07.439966 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:07.439944 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-jpn4d_c2eed1c2-894c-4f42-b866-93ec0b5a0752/storage-initializer/0.log" Jun 08 12:49:12.087398 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:12.084799 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vgzwv/must-gather-65v4w"] Jun 08 12:49:12.090419 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:12.090392 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vgzwv/must-gather-65v4w" Jun 08 12:49:12.093029 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:12.093001 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vgzwv\"/\"openshift-service-ca.crt\"" Jun 08 12:49:12.093029 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:12.093014 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vgzwv\"/\"kube-root-ca.crt\"" Jun 08 12:49:12.093713 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:12.093699 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vgzwv\"/\"default-dockercfg-kqpfq\"" Jun 08 12:49:12.098023 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:12.097970 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:49:12.099021 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:12.098611 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vgzwv/must-gather-65v4w"] Jun 08 12:49:12.195976 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:12.195940 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" limit=1024 Jun 08 12:49:12.245479 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:12.245440 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcsf4\" (UniqueName: \"kubernetes.io/projected/b2748f3b-c83f-46f4-b379-a0cb2eaec7b8-kube-api-access-bcsf4\") pod \"must-gather-65v4w\" (UID: \"b2748f3b-c83f-46f4-b379-a0cb2eaec7b8\") " pod="openshift-must-gather-vgzwv/must-gather-65v4w" Jun 08 12:49:12.245669 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:12.245589 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b2748f3b-c83f-46f4-b379-a0cb2eaec7b8-must-gather-output\") pod \"must-gather-65v4w\" (UID: \"b2748f3b-c83f-46f4-b379-a0cb2eaec7b8\") " pod="openshift-must-gather-vgzwv/must-gather-65v4w" Jun 08 12:49:12.346174 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:12.346089 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b2748f3b-c83f-46f4-b379-a0cb2eaec7b8-must-gather-output\") pod \"must-gather-65v4w\" (UID: \"b2748f3b-c83f-46f4-b379-a0cb2eaec7b8\") " pod="openshift-must-gather-vgzwv/must-gather-65v4w" Jun 08 12:49:12.346174 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:12.346154 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcsf4\" (UniqueName: \"kubernetes.io/projected/b2748f3b-c83f-46f4-b379-a0cb2eaec7b8-kube-api-access-bcsf4\") pod \"must-gather-65v4w\" (UID: \"b2748f3b-c83f-46f4-b379-a0cb2eaec7b8\") " pod="openshift-must-gather-vgzwv/must-gather-65v4w" Jun 08 12:49:12.346505 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:12.346394 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b2748f3b-c83f-46f4-b379-a0cb2eaec7b8-must-gather-output\") pod \"must-gather-65v4w\" (UID: \"b2748f3b-c83f-46f4-b379-a0cb2eaec7b8\") " pod="openshift-must-gather-vgzwv/must-gather-65v4w" Jun 08 12:49:12.354875 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:12.354851 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcsf4\" (UniqueName: \"kubernetes.io/projected/b2748f3b-c83f-46f4-b379-a0cb2eaec7b8-kube-api-access-bcsf4\") pod \"must-gather-65v4w\" (UID: \"b2748f3b-c83f-46f4-b379-a0cb2eaec7b8\") " pod="openshift-must-gather-vgzwv/must-gather-65v4w" Jun 08 12:49:12.401777 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:12.401738 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vgzwv/must-gather-65v4w" Jun 08 12:49:12.544020 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:12.543989 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vgzwv/must-gather-65v4w"] Jun 08 12:49:12.546170 ip-10-0-137-94 kubenswrapper[2565]: W0608 12:49:12.546139 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2748f3b_c83f_46f4_b379_a0cb2eaec7b8.slice/crio-76dca88713365764eb0e706d3e2c491ed897c5dc7fb7f2817ebd636e8e46984a WatchSource:0}: Error finding container 76dca88713365764eb0e706d3e2c491ed897c5dc7fb7f2817ebd636e8e46984a: Status 404 returned error can't find the container with id 76dca88713365764eb0e706d3e2c491ed897c5dc7fb7f2817ebd636e8e46984a Jun 08 12:49:13.097519 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:13.097475 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vgzwv/must-gather-65v4w" event={"ID":"b2748f3b-c83f-46f4-b379-a0cb2eaec7b8","Type":"ContainerStarted","Data":"76dca88713365764eb0e706d3e2c491ed897c5dc7fb7f2817ebd636e8e46984a"} Jun 08 12:49:14.109957 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:14.109916 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vgzwv/must-gather-65v4w" event={"ID":"b2748f3b-c83f-46f4-b379-a0cb2eaec7b8","Type":"ContainerStarted","Data":"e3981e8d87477c12bc08f1e17461d7c10a1a5b48a425ef814b91ca5e6446a077"} Jun 08 12:49:14.109957 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:14.109972 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vgzwv/must-gather-65v4w" event={"ID":"b2748f3b-c83f-46f4-b379-a0cb2eaec7b8","Type":"ContainerStarted","Data":"e11fdda59bde13bd000c477586e9264d7ea626c9f39857c9584727432807acf0"} Jun 08 12:49:14.129444 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:14.129390 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vgzwv/must-gather-65v4w" podStartSLOduration=1.274434078 podStartE2EDuration="2.129375117s" totalImagesPullingTime="854.941039ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 12:49:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:49:14.125987116 +0000 UTC m=+2382.241805255" watchObservedRunningTime="2026-06-08 12:49:14.129375117 +0000 UTC m=+2382.245193256" Jun 08 12:49:15.293743 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:15.293704 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7pwsz_4e3e7141-3861-4baa-b7ea-ca348f74a095/global-pull-secret-syncer/0.log" Jun 08 12:49:15.444194 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:15.444162 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4krtw_6a3de442-4644-42ce-a441-9b867aaf3071/konnectivity-agent/0.log" Jun 08 12:49:15.552998 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:15.552902 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-94.ec2.internal_694565ca45387930e7b7b65815bbef04/haproxy/0.log" Jun 08 12:49:20.602248 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:20.602216 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr_5588aaf5-551b-484d-9766-977650d6b98a/extract/0.log" Jun 08 12:49:20.627407 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:20.627325 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr_5588aaf5-551b-484d-9766-977650d6b98a/util/0.log" Jun 08 12:49:20.651171 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:20.651133 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l9prr_5588aaf5-551b-484d-9766-977650d6b98a/pull/0.log" Jun 08 12:49:20.683465 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:20.683433 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58_097248d3-81fb-4af3-8868-3e4d416cff72/extract/0.log" Jun 08 12:49:20.712395 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:20.712348 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58_097248d3-81fb-4af3-8868-3e4d416cff72/util/0.log" Jun 08 12:49:20.742496 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:20.742463 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rzb58_097248d3-81fb-4af3-8868-3e4d416cff72/pull/0.log" Jun 08 12:49:20.773279 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:20.773251 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8_f167c13a-2d11-49aa-8a89-1610f8861c32/extract/0.log" Jun 08 12:49:20.800628 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:20.800601 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8_f167c13a-2d11-49aa-8a89-1610f8861c32/util/0.log" Jun 08 12:49:20.824041 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:20.824005 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732nxl8_f167c13a-2d11-49aa-8a89-1610f8861c32/pull/0.log" Jun 08 12:49:20.856680 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:20.856598 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx_fca9372a-9af8-46f6-8ff1-e08baf379bf5/extract/0.log" Jun 08 12:49:20.888095 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:20.888065 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx_fca9372a-9af8-46f6-8ff1-e08baf379bf5/util/0.log" Jun 08 12:49:20.913554 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:20.913481 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12pzpx_fca9372a-9af8-46f6-8ff1-e08baf379bf5/pull/0.log" Jun 08 12:49:21.266061 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:21.266026 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b68897b4b-d5bv2_4864f666-4622-49c4-878a-f05699a738d0/authorino/0.log" Jun 08 12:49:21.318629 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:21.318600 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-g8g5l_78974448-565f-4a7e-8be5-1f1f2f7b8821/manager/0.log" Jun 08 12:49:21.443260 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:21.443230 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lwbj7_57d27191-f6ea-4e98-b267-7d7525e6f0c2/registry-server/0.log" Jun 08 12:49:22.353601 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:22.353570 2565 scope.go:117] "RemoveContainer" containerID="bff39eccf283b6a73a1a394ae49769ea53d994fcd7c58bc9f1d5116be7049a0a" Jun 08 12:49:23.158449 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:23.158103 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bc670b01-93b4-4f83-8451-4726403eaa46/alertmanager/0.log" Jun 08 12:49:23.187311 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:23.187232 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bc670b01-93b4-4f83-8451-4726403eaa46/config-reloader/0.log" Jun 08 12:49:23.214711 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:23.214601 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bc670b01-93b4-4f83-8451-4726403eaa46/kube-rbac-proxy-web/0.log" Jun 08 12:49:23.217304 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:23.217021 2565 generic.go:356] "Generic (PLEG): container finished" podID="fa3315fa-3910-4d64-ae58-d4e350ae7a96" containerID="1cf3cc57e76b5ff31dd790a786fe11e476739d1902ee398cd9603263920cf42e" exitCode=1 Jun 08 12:49:23.217304 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:23.217094 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" event={"ID":"fa3315fa-3910-4d64-ae58-d4e350ae7a96","Type":"ContainerDied","Data":"1cf3cc57e76b5ff31dd790a786fe11e476739d1902ee398cd9603263920cf42e"} Jun 08 12:49:23.217304 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:23.217165 2565 scope.go:117] "RemoveContainer" containerID="bff39eccf283b6a73a1a394ae49769ea53d994fcd7c58bc9f1d5116be7049a0a" Jun 08 12:49:23.217776 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:23.217651 2565 scope.go:117] "RemoveContainer" containerID="1cf3cc57e76b5ff31dd790a786fe11e476739d1902ee398cd9603263920cf42e" Jun 08 12:49:23.218502 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:49:23.218447 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792_redhat-ai-gateway-infra(fa3315fa-3910-4d64-ae58-d4e350ae7a96)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" podUID="fa3315fa-3910-4d64-ae58-d4e350ae7a96" Jun 08 12:49:23.239780 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:23.239690 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bc670b01-93b4-4f83-8451-4726403eaa46/kube-rbac-proxy/0.log" Jun 08 12:49:23.264260 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:23.264230 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bc670b01-93b4-4f83-8451-4726403eaa46/kube-rbac-proxy-metric/0.log" Jun 08 12:49:23.292575 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:23.292542 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bc670b01-93b4-4f83-8451-4726403eaa46/prom-label-proxy/0.log" Jun 08 12:49:23.319993 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:23.319951 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bc670b01-93b4-4f83-8451-4726403eaa46/init-config-reloader/0.log" Jun 08 12:49:23.408779 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:23.406014 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-ww6tn_13f7ee1f-daae-4663-88e0-4be29a8927d8/cluster-monitoring-operator/0.log" Jun 08 12:49:23.444833 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:23.443851 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-bwknb_320b65f6-3e0b-4719-baa9-bc6adb11fbe8/kube-state-metrics/0.log" Jun 08 12:49:23.468588 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:23.468555 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-bwknb_320b65f6-3e0b-4719-baa9-bc6adb11fbe8/kube-rbac-proxy-main/0.log" Jun 08 12:49:23.496698 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:23.496667 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-bwknb_320b65f6-3e0b-4719-baa9-bc6adb11fbe8/kube-rbac-proxy-self/0.log" Jun 08 12:49:23.557207 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:23.557175 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-f4ptf_9aa82ba9-0cdb-49a2-97c4-825ffaeb1f0a/monitoring-plugin/0.log" Jun 08 12:49:23.779763 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:23.779721 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r5qpz_2c1f6f38-34fa-4ddc-8442-2f7903793a9c/node-exporter/0.log" Jun 08 12:49:23.829446 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:23.829413 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r5qpz_2c1f6f38-34fa-4ddc-8442-2f7903793a9c/kube-rbac-proxy/0.log" Jun 08 12:49:23.853911 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:23.853879 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r5qpz_2c1f6f38-34fa-4ddc-8442-2f7903793a9c/init-textfile/0.log" Jun 08 12:49:23.888188 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:23.888155 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-8bhff_4a263f58-da15-4162-9ce6-4ebc07f7bc01/kube-rbac-proxy-main/0.log" Jun 08 12:49:23.916946 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:23.916912 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-8bhff_4a263f58-da15-4162-9ce6-4ebc07f7bc01/kube-rbac-proxy-self/0.log" Jun 08 12:49:23.945222 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:23.945139 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-8bhff_4a263f58-da15-4162-9ce6-4ebc07f7bc01/openshift-state-metrics/0.log" Jun 08 12:49:24.187991 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:24.187955 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-6wr2n_8ee41dd7-f05b-4f35-ab3b-bea879d64993/prometheus-operator/0.log" Jun 08 12:49:24.214769 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:24.214688 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-6wr2n_8ee41dd7-f05b-4f35-ab3b-bea879d64993/kube-rbac-proxy/0.log" Jun 08 12:49:24.244578 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:24.244547 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-7jfkl_054972c3-2e21-48ab-9b23-962398e4364b/prometheus-operator-admission-webhook/0.log" Jun 08 12:49:24.283738 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:24.283694 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d6bbcd6c9-9rrtp_adf4772b-a9f3-4185-9218-ab140455f591/telemeter-client/0.log" Jun 08 12:49:24.312411 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:24.312367 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d6bbcd6c9-9rrtp_adf4772b-a9f3-4185-9218-ab140455f591/reload/0.log" Jun 08 12:49:24.339438 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:24.339403 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7d6bbcd6c9-9rrtp_adf4772b-a9f3-4185-9218-ab140455f591/kube-rbac-proxy/0.log" Jun 08 12:49:24.378261 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:24.378230 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cc6bdfcc8-dtbpv_178e71f4-2694-4616-b847-bd42250ecc84/thanos-query/0.log" Jun 08 12:49:24.406045 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:24.406014 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cc6bdfcc8-dtbpv_178e71f4-2694-4616-b847-bd42250ecc84/kube-rbac-proxy-web/0.log" Jun 08 12:49:24.429904 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:24.429859 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cc6bdfcc8-dtbpv_178e71f4-2694-4616-b847-bd42250ecc84/kube-rbac-proxy/0.log" Jun 08 12:49:24.453981 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:24.453953 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cc6bdfcc8-dtbpv_178e71f4-2694-4616-b847-bd42250ecc84/prom-label-proxy/0.log" Jun 08 12:49:24.481755 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:24.481647 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cc6bdfcc8-dtbpv_178e71f4-2694-4616-b847-bd42250ecc84/kube-rbac-proxy-rules/0.log" Jun 08 12:49:24.507021 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:24.506991 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7cc6bdfcc8-dtbpv_178e71f4-2694-4616-b847-bd42250ecc84/kube-rbac-proxy-metrics/0.log" Jun 08 12:49:25.079193 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:25.079154 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" Jun 08 12:49:25.079727 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:25.079709 2565 scope.go:117] "RemoveContainer" containerID="1cf3cc57e76b5ff31dd790a786fe11e476739d1902ee398cd9603263920cf42e" Jun 08 12:49:25.080020 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:49:25.079995 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792_redhat-ai-gateway-infra(fa3315fa-3910-4d64-ae58-d4e350ae7a96)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" podUID="fa3315fa-3910-4d64-ae58-d4e350ae7a96" Jun 08 12:49:25.738739 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:25.738710 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-fk5fp_849e7162-23cb-4135-a99d-fc8cbfd20800/networking-console-plugin/0.log" Jun 08 12:49:25.949167 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:25.949128 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" Jun 08 12:49:25.949624 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:25.949608 2565 scope.go:117] "RemoveContainer" containerID="1cf3cc57e76b5ff31dd790a786fe11e476739d1902ee398cd9603263920cf42e" Jun 08 12:49:25.949927 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:49:25.949896 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792_redhat-ai-gateway-infra(fa3315fa-3910-4d64-ae58-d4e350ae7a96)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" podUID="fa3315fa-3910-4d64-ae58-d4e350ae7a96" Jun 08 12:49:26.371252 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:26.371214 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/2.log" Jun 08 12:49:26.376193 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:26.376153 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/3.log" Jun 08 12:49:26.593377 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:26.593083 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss"] Jun 08 12:49:26.606083 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:26.606043 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss" Jun 08 12:49:26.617229 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:26.616492 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss"] Jun 08 12:49:26.731904 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:26.730419 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k6n6\" (UniqueName: \"kubernetes.io/projected/cc1165c9-4e66-4d4e-9bda-f172cb6d3519-kube-api-access-6k6n6\") pod \"perf-node-gather-daemonset-v9hss\" (UID: \"cc1165c9-4e66-4d4e-9bda-f172cb6d3519\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss" Jun 08 12:49:26.731904 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:26.730527 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc1165c9-4e66-4d4e-9bda-f172cb6d3519-podres\") pod \"perf-node-gather-daemonset-v9hss\" (UID: \"cc1165c9-4e66-4d4e-9bda-f172cb6d3519\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss" Jun 08 12:49:26.731904 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:26.730585 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc1165c9-4e66-4d4e-9bda-f172cb6d3519-lib-modules\") pod \"perf-node-gather-daemonset-v9hss\" (UID: \"cc1165c9-4e66-4d4e-9bda-f172cb6d3519\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss" Jun 08 12:49:26.731904 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:26.730618 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc1165c9-4e66-4d4e-9bda-f172cb6d3519-sys\") pod \"perf-node-gather-daemonset-v9hss\" (UID: \"cc1165c9-4e66-4d4e-9bda-f172cb6d3519\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss" Jun 08 12:49:26.731904 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:26.730649 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc1165c9-4e66-4d4e-9bda-f172cb6d3519-proc\") pod \"perf-node-gather-daemonset-v9hss\" (UID: \"cc1165c9-4e66-4d4e-9bda-f172cb6d3519\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss" Jun 08 12:49:26.831998 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:26.831961 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k6n6\" (UniqueName: \"kubernetes.io/projected/cc1165c9-4e66-4d4e-9bda-f172cb6d3519-kube-api-access-6k6n6\") pod \"perf-node-gather-daemonset-v9hss\" (UID: \"cc1165c9-4e66-4d4e-9bda-f172cb6d3519\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss" Jun 08 12:49:26.832419 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:26.832028 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc1165c9-4e66-4d4e-9bda-f172cb6d3519-podres\") pod \"perf-node-gather-daemonset-v9hss\" (UID: \"cc1165c9-4e66-4d4e-9bda-f172cb6d3519\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss" Jun 08 12:49:26.832419 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:26.832057 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc1165c9-4e66-4d4e-9bda-f172cb6d3519-lib-modules\") pod \"perf-node-gather-daemonset-v9hss\" (UID: \"cc1165c9-4e66-4d4e-9bda-f172cb6d3519\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss" Jun 08 12:49:26.832419 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:26.832077 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc1165c9-4e66-4d4e-9bda-f172cb6d3519-sys\") pod \"perf-node-gather-daemonset-v9hss\" (UID: \"cc1165c9-4e66-4d4e-9bda-f172cb6d3519\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss" Jun 08 12:49:26.832419 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:26.832097 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc1165c9-4e66-4d4e-9bda-f172cb6d3519-proc\") pod \"perf-node-gather-daemonset-v9hss\" (UID: \"cc1165c9-4e66-4d4e-9bda-f172cb6d3519\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss" Jun 08 12:49:26.832419 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:26.832182 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc1165c9-4e66-4d4e-9bda-f172cb6d3519-proc\") pod \"perf-node-gather-daemonset-v9hss\" (UID: \"cc1165c9-4e66-4d4e-9bda-f172cb6d3519\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss" Jun 08 12:49:26.832419 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:26.832182 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc1165c9-4e66-4d4e-9bda-f172cb6d3519-sys\") pod \"perf-node-gather-daemonset-v9hss\" (UID: \"cc1165c9-4e66-4d4e-9bda-f172cb6d3519\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss" Jun 08 12:49:26.832419 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:26.832228 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc1165c9-4e66-4d4e-9bda-f172cb6d3519-podres\") pod \"perf-node-gather-daemonset-v9hss\" (UID: \"cc1165c9-4e66-4d4e-9bda-f172cb6d3519\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss" Jun 08 12:49:26.832419 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:26.832250 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc1165c9-4e66-4d4e-9bda-f172cb6d3519-lib-modules\") pod \"perf-node-gather-daemonset-v9hss\" (UID: \"cc1165c9-4e66-4d4e-9bda-f172cb6d3519\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss" Jun 08 12:49:26.844727 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:26.841628 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k6n6\" (UniqueName: \"kubernetes.io/projected/cc1165c9-4e66-4d4e-9bda-f172cb6d3519-kube-api-access-6k6n6\") pod \"perf-node-gather-daemonset-v9hss\" (UID: \"cc1165c9-4e66-4d4e-9bda-f172cb6d3519\") " pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss" Jun 08 12:49:26.936215 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:26.936124 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss" Jun 08 12:49:26.994030 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:26.993958 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5d7db6f7df-bhb4n_d152fc70-7b58-470f-8cdf-71ff00c8feed/console/0.log" Jun 08 12:49:27.153723 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:27.153673 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss"] Jun 08 12:49:27.261281 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:27.261236 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss" event={"ID":"cc1165c9-4e66-4d4e-9bda-f172cb6d3519","Type":"ContainerStarted","Data":"a009a14d182ca4eef558f79b506aa4a6707f573041d5be4690673a57d3c845b3"} Jun 08 12:49:27.772273 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:27.772242 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-h8ml2_82196494-14a7-469a-9647-b3c98b0bb4c5/volume-data-source-validator/0.log" Jun 08 12:49:28.271280 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:28.271240 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss" event={"ID":"cc1165c9-4e66-4d4e-9bda-f172cb6d3519","Type":"ContainerStarted","Data":"d587e3c6f068ede76b2464e1e18727c089ffb3366e807c5fbe323dab474aa9ea"} Jun 08 12:49:28.271658 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:28.271377 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss" Jun 08 12:49:28.289867 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:28.289781 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss" podStartSLOduration=2.289758501 podStartE2EDuration="2.289758501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 12:49:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 12:49:28.288549082 +0000 UTC m=+2396.404367220" watchObservedRunningTime="2026-06-08 12:49:28.289758501 +0000 UTC m=+2396.405576643" Jun 08 12:49:28.921197 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:28.921165 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g28p2_433d1661-5360-45df-8679-18cd4f85c03b/dns/0.log" Jun 08 12:49:28.944400 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:28.944371 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g28p2_433d1661-5360-45df-8679-18cd4f85c03b/kube-rbac-proxy/0.log" Jun 08 12:49:29.022579 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:29.022532 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8c2bq_aa07a65f-f29b-4938-8167-03e6245a6228/dns-node-resolver/0.log" Jun 08 12:49:29.656252 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:29.656222 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6rnhx_5bcb07d4-39cc-41fa-bf34-e7d119414144/node-ca/0.log" Jun 08 12:49:30.671707 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:30.671668 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bckv4bg_efa6ca32-a146-4cc3-880f-7e11afa17bf1/istio-proxy/0.log" Jun 08 12:49:30.824666 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:30.824621 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-ljn8h_14ebf361-7f3d-42cf-9a35-d537e92f1d7e/istio-proxy/0.log" Jun 08 12:49:30.899524 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:30.899492 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-ljn8h_14ebf361-7f3d-42cf-9a35-d537e92f1d7e/istio-proxy/1.log" Jun 08 12:49:31.016055 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:31.015968 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b7fc957f7-d6lvs_d33beb41-9adf-42a6-9888-140d58450017/router/0.log" Jun 08 12:49:31.715317 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:31.715270 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pn864_caa618ee-b34d-40f6-9615-8e41e2b90036/serve-healthcheck-canary/0.log" Jun 08 12:49:32.247245 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:32.247208 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-86bvt_3c6f655c-0584-4430-87ec-ead19aa53dd0/insights-operator/0.log" Jun 08 12:49:32.248530 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:32.248509 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-86bvt_3c6f655c-0584-4430-87ec-ead19aa53dd0/insights-operator/1.log" Jun 08 12:49:32.273339 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:32.273312 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-446r8_574bd504-23e6-470e-9f16-f001e3beeb34/kube-rbac-proxy/0.log" Jun 08 12:49:32.299865 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:32.299836 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-446r8_574bd504-23e6-470e-9f16-f001e3beeb34/exporter/0.log" Jun 08 12:49:32.328376 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:32.328344 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-446r8_574bd504-23e6-470e-9f16-f001e3beeb34/extractor/0.log" Jun 08 12:49:32.814302 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:32.814185 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/2.log" Jun 08 12:49:32.825617 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:32.817777 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-qvcwf_731f4b21-0de5-4184-aa7d-05eab33ce31e/console-operator/2.log" Jun 08 12:49:32.825617 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:32.822055 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwxhk_1aa340eb-58d2-4e29-9cbd-4f1b831abf58/ovn-acl-logging/0.log" Jun 08 12:49:32.826344 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:32.826315 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kwxhk_1aa340eb-58d2-4e29-9cbd-4f1b831abf58/ovn-acl-logging/0.log" Jun 08 12:49:34.293329 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:34.293299 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vgzwv/perf-node-gather-daemonset-v9hss" Jun 08 12:49:34.790674 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:34.790639 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-556d9fc7f6-7jqvn_86e21543-6908-4d69-8e77-231dc46b875e/nginx/0.log" Jun 08 12:49:35.001731 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:35.001706 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-4mx5f_d3fbe2d0-11a7-4f4b-9e9c-6d5e6b58e0f6/server/0.log" Jun 08 12:49:35.076833 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:35.076726 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-9b8fm_39f7399a-b977-4b9e-b0c5-b0e67fe1f6fa/manager/0.log" Jun 08 12:49:35.239605 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:35.239572 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6858dfdb94-5pr6n_c456c4dc-1b2d-40a2-962e-45e1a8fb6a01/manager/0.log" Jun 08 12:49:35.261423 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:35.261399 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6858dfdb94-5pr6n_c456c4dc-1b2d-40a2-962e-45e1a8fb6a01/copy-manifests/0.log" Jun 08 12:49:37.059549 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:37.059500 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6d9b9957d4-8zkp8_0291ce16-5730-47d2-be39-78e95036928e/manager/0.log" Jun 08 12:49:39.342804 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:39.342721 2565 scope.go:117] "RemoveContainer" containerID="1cf3cc57e76b5ff31dd790a786fe11e476739d1902ee398cd9603263920cf42e" Jun 08 12:49:39.343311 ip-10-0-137-94 kubenswrapper[2565]: E0608 12:49:39.343230 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792_redhat-ai-gateway-infra(fa3315fa-3910-4d64-ae58-d4e350ae7a96)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-4a9968cd-6674fc97d6-pj792" podUID="fa3315fa-3910-4d64-ae58-d4e350ae7a96" Jun 08 12:49:40.501540 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:40.501512 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bckv4bg_efa6ca32-a146-4cc3-880f-7e11afa17bf1/istio-proxy/0.log" Jun 08 12:49:40.612162 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:40.612131 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-ljn8h_14ebf361-7f3d-42cf-9a35-d537e92f1d7e/istio-proxy/0.log" Jun 08 12:49:40.669885 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:40.669236 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-ljn8h_14ebf361-7f3d-42cf-9a35-d537e92f1d7e/istio-proxy/1.log" Jun 08 12:49:40.775377 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:40.775288 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b7fc957f7-d6lvs_d33beb41-9adf-42a6-9888-140d58450017/router/0.log" Jun 08 12:49:41.916726 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:41.916697 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bckv4bg_efa6ca32-a146-4cc3-880f-7e11afa17bf1/istio-proxy/0.log" Jun 08 12:49:42.032060 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:42.032016 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-ljn8h_14ebf361-7f3d-42cf-9a35-d537e92f1d7e/istio-proxy/0.log" Jun 08 12:49:42.098872 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:42.098834 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-ljn8h_14ebf361-7f3d-42cf-9a35-d537e92f1d7e/istio-proxy/1.log" Jun 08 12:49:42.193362 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:42.193278 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b7fc957f7-d6lvs_d33beb41-9adf-42a6-9888-140d58450017/router/0.log" Jun 08 12:49:42.967000 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:42.966953 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-l2pq7_4b9681e8-a3af-4356-b6fc-f87994ccf29b/kube-storage-version-migrator-operator/1.log" Jun 08 12:49:42.969143 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:42.969100 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-l2pq7_4b9681e8-a3af-4356-b6fc-f87994ccf29b/kube-storage-version-migrator-operator/0.log" Jun 08 12:49:43.884563 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:43.884523 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bckv4bg_efa6ca32-a146-4cc3-880f-7e11afa17bf1/istio-proxy/0.log" Jun 08 12:49:43.986125 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:43.986049 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-ljn8h_14ebf361-7f3d-42cf-9a35-d537e92f1d7e/istio-proxy/0.log" Jun 08 12:49:44.049172 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:44.049139 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-ljn8h_14ebf361-7f3d-42cf-9a35-d537e92f1d7e/istio-proxy/1.log" Jun 08 12:49:44.152309 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:44.152247 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b7fc957f7-d6lvs_d33beb41-9adf-42a6-9888-140d58450017/router/0.log" Jun 08 12:49:44.304370 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:44.304210 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d9dk7_7680a2d2-3d3f-4a76-88c5-462b61659f38/kube-multus-additional-cni-plugins/0.log" Jun 08 12:49:44.326692 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:44.326655 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d9dk7_7680a2d2-3d3f-4a76-88c5-462b61659f38/egress-router-binary-copy/0.log" Jun 08 12:49:44.350928 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:44.350892 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d9dk7_7680a2d2-3d3f-4a76-88c5-462b61659f38/cni-plugins/0.log" Jun 08 12:49:44.376334 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:44.376298 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d9dk7_7680a2d2-3d3f-4a76-88c5-462b61659f38/bond-cni-plugin/0.log" Jun 08 12:49:44.398950 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:44.398917 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d9dk7_7680a2d2-3d3f-4a76-88c5-462b61659f38/routeoverride-cni/0.log" Jun 08 12:49:44.423636 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:44.423611 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d9dk7_7680a2d2-3d3f-4a76-88c5-462b61659f38/whereabouts-cni-bincopy/0.log" Jun 08 12:49:44.447480 ip-10-0-137-94 kubenswrapper[2565]: I0608 12:49:44.447442 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d9dk7_7680a2d2-3d3f-4a76-88c5-462b61659f38/whereabouts-cni/0.log"